-- Logs begin at Thu 2022-06-16 17:42:29 UTC, end at Thu 2022-06-16 19:14:48 UTC. -- Jun 16 18:35:53.597517 dv-cinder-813229-10-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 16 18:35:53.612337 dv-cinder-813229-10-smb devstack@keystone.service[86929]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 16 18:35:53.612337 dv-cinder-813229-10-smb devstack@keystone.service[86929]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 18:35:53 2022] *** Jun 16 18:35:53.612337 dv-cinder-813229-10-smb devstack@keystone.service[86929]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 18:35:53.612337 dv-cinder-813229-10-smb devstack@keystone.service[86929]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 18:35:53.612337 dv-cinder-813229-10-smb devstack@keystone.service[86929]: nodename: dv-cinder-813229-10-smb Jun 16 18:35:53.612337 dv-cinder-813229-10-smb devstack@keystone.service[86929]: machine: x86_64 Jun 16 18:35:53.612337 dv-cinder-813229-10-smb devstack@keystone.service[86929]: clock source: unix Jun 16 18:35:53.612337 dv-cinder-813229-10-smb devstack@keystone.service[86929]: pcre jit disabled Jun 16 18:35:53.612337 dv-cinder-813229-10-smb devstack@keystone.service[86929]: detected number of CPU cores: 4 Jun 16 18:35:53.612337 dv-cinder-813229-10-smb devstack@keystone.service[86929]: current working directory: / Jun 16 18:35:53.612337 dv-cinder-813229-10-smb devstack@keystone.service[86929]: detected binary path: /usr/bin/uwsgi-core Jun 16 18:35:53.612337 dv-cinder-813229-10-smb devstack@keystone.service[86929]: your processes number limit is 47680 Jun 16 18:35:53.612337 dv-cinder-813229-10-smb devstack@keystone.service[86929]: your memory page size is 4096 bytes Jun 16 18:35:53.612337 dv-cinder-813229-10-smb devstack@keystone.service[86929]: detected max file descriptor number: 2048 Jun 16 18:35:53.612337 dv-cinder-813229-10-smb devstack@keystone.service[86929]: lock engine: pthread robust mutexes Jun 16 18:35:53.612337 dv-cinder-813229-10-smb devstack@keystone.service[86929]: thunder lock: enabled Jun 16 18:35:53.612337 dv-cinder-813229-10-smb devstack@keystone.service[86929]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 16 18:35:53.612337 dv-cinder-813229-10-smb devstack@keystone.service[86929]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 18:35:53.651799 dv-cinder-813229-10-smb devstack@keystone.service[86929]: Python main interpreter initialized at 0x55ea0a0779c0 Jun 16 18:35:53.651799 dv-cinder-813229-10-smb devstack@keystone.service[86929]: python threads support enabled Jun 16 18:35:53.651799 dv-cinder-813229-10-smb devstack@keystone.service[86929]: your server socket listen backlog is limited to 100 connections Jun 16 18:35:53.651799 dv-cinder-813229-10-smb devstack@keystone.service[86929]: your mercy for graceful operations on workers is 90 seconds Jun 16 18:35:53.652139 dv-cinder-813229-10-smb devstack@keystone.service[86929]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 18:35:53.652216 dv-cinder-813229-10-smb devstack@keystone.service[86929]: *** Operational MODE: preforking *** Jun 16 18:35:53.652520 dv-cinder-813229-10-smb devstack@keystone.service[86929]: *** uWSGI is running in multiple interpreter mode *** Jun 16 18:35:53.652520 dv-cinder-813229-10-smb devstack@keystone.service[86929]: spawned uWSGI master process (pid: 86929) Jun 16 18:35:53.652717 dv-cinder-813229-10-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 16 18:35:53.653832 dv-cinder-813229-10-smb devstack@keystone.service[86929]: spawned uWSGI worker 1 (pid: 86942, cores: 1) Jun 16 18:35:53.653832 dv-cinder-813229-10-smb devstack@keystone.service[86929]: spawned uWSGI worker 2 (pid: 86943, cores: 1) Jun 16 18:35:53.653832 dv-cinder-813229-10-smb devstack@keystone.service[86929]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 18:35:59.221939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:35:59.221939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: from cryptography.utils import int_from_bytes Jun 16 18:35:59.222754 dv-cinder-813229-10-smb devstack@keystone.service[86942]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:35:59.222754 dv-cinder-813229-10-smb devstack@keystone.service[86942]: from cryptography.utils import int_from_bytes Jun 16 18:35:59.223243 dv-cinder-813229-10-smb devstack@keystone.service[86943]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:35:59.223243 dv-cinder-813229-10-smb devstack@keystone.service[86943]: from cryptography.utils import int_from_bytes Jun 16 18:35:59.223384 dv-cinder-813229-10-smb devstack@keystone.service[86942]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:35:59.223384 dv-cinder-813229-10-smb devstack@keystone.service[86942]: from cryptography.utils import int_from_bytes Jun 16 18:35:59.277444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:35:59.277652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:35:59.280953 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] command line args: [] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:35:59.281080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:35:59.281080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:35:59.281234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:35:59.281304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] command line args: [] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:35:59.281364 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ================================================================================ {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:35:59.281433 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:35:59.281498 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] admin_token = **** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.281562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ================================================================================ {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:35:59.281625 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] config_dir = [] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.281684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] admin_token = **** {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.281739 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.281739 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] config_source = [] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.281856 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] config_dir = [] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.281915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] debug = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.281983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.282048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.283165 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] config_source = [] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.283165 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] debug = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.283297 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.283362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.283450 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.283517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.283583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.283648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.283713 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.283772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.283866 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] list_limit = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.283947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.284012 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] log_config_append = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.284012 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.284120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] list_limit = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.284178 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] log_dir = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.284235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] log_config_append = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.284301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] log_file = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.284360 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.284422 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.284519 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] log_dir = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.284519 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] log_file = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.284634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.284703 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.284768 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.284832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.284895 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.284895 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.285009 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.285078 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.285143 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.285204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.285261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.285326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.285409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.285475 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.285475 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.285582 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.285646 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.285710 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.285779 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.285838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.286062 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.286126 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.286184 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.286240 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.286327 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.286441 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.286441 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.286613 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.93/identity {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.286682 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.286850 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] publish_errors = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.286934 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.287008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.287008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.287008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.287203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.93/identity {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.287277 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.287351 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] publish_errors = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.287428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.287505 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.287576 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] standard_threads = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.287661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.287661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.287795 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.287872 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.287942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.287942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.288067 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.288137 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] use_journal = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.288217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] standard_threads = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.288296 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] use_json = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.288373 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.288473 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] use_stderr = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.288473 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] use_syslog = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.288675 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.288675 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.288898 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.288972 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] use_journal = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.289043 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.289113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] use_json = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.289188 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.289267 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] use_stderr = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.289267 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] use_syslog = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.289396 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.289466 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:59.289536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.289611 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.289699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.289829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.289911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.290094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.290182 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.290341 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.290432 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.290598 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.290684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.290842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.290920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.291097 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.291182 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.291337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.291420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.291589 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.291673 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.291832 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.291919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.292083 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.292167 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.292321 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.292409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.292595 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.292732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.292852 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.292955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.293068 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.293190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.293307 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.293433 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.293552 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.293667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.293782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.293897 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.294088 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.294213 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.294329 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.294451 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.294567 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.294683 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.294807 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.294925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.295080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.295203 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.295203 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.295420 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.295543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.295662 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.295784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.295900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.295900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.296123 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.296250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.296367 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.296511 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.296629 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.296629 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.296846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.296974 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.297113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.297290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.297407 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.297522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.297637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.297744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.297849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.297953 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.298050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.298178 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.298285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.298392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.298490 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.299101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.299205 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.299328 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.299449 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.299578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.299696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.299811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.299928 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.300050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.300173 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.300298 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.300416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.300608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.300728 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.300844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.300962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.301077 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.301204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.301322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.301428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.301542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.301657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.301763 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.301884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.302003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.302119 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.302235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.302351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.302475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.302601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.302725 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.302842 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.302948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.303063 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.303185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.303310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.303428 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.303544 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.303659 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.303782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.303899 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.304025 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.304143 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.304259 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.304384 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.304527 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.304646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.304778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.304897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.305012 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.305129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.305261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.305379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.305507 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.305627 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.305743 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.305860 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.305976 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.306091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.306283 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.306403 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.306553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.306672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.306789 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.306906 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.307030 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.307149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.307289 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.307413 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.307537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.307661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.307799 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.307799 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.308047 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.308166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.308284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.308400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.308564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.308564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.308796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.308916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.309016 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.309137 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.309261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.309261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.309492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.309608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.309725 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.309842 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.309958 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.310082 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.310200 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.310317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.310433 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.310549 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.310665 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.310792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.310910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.311027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.311143 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.311258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.311383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.311508 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.311633 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.311750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.311873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.311990 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.312107 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.312232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.312350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.312480 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.312598 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.312714 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.312830 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.312962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.313088 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.313206 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.313322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.313438 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.313563 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.313688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.313807 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.313807 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.314025 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.314141 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.314288 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.314934 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.315055 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] auth.external = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.315055 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.315289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.315289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.315509 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.315637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.315756 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.315873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] auth.external = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.316015 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] auth.password = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.316143 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.316298 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] auth.token = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.316298 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.316525 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.323525 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.323653 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.323732 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.323805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] auth.password = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.323878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.323951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] auth.token = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.324032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.324107 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.324497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.324578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.324651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.324723 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.324808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] credential.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.324892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.324966 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.325039 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.325111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.325183 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.325183 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.325328 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.325401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] credential.caching = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.325473 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.325544 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.325615 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.325694 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.325769 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.325841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.325912 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.325984 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.326055 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.326135 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.326208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.326281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.326352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.326527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.326605 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.326755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.326839 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.326914 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.326987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.327066 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.327139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.327219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.327293 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.327366 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.327438 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] federation.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.327510 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.327581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.327661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.327735 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.327806 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.327878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.327950 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] federation.caching = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.328022 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.328101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.328175 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.328247 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.328319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.328390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.328496 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.328574 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.328647 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.328720 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.328792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.328865 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.328945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.328945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.329077 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.329149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.329222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.329300 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.329385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.329468 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.329543 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.329615 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.329677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.329747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.329827 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] identity.caching = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.329901 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.329963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.330022 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.330081 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.330145 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.330214 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.330276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.330335 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.330393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.330519 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.330598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.330673 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.330737 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.330796 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.330855 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.330913 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.330971 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.331043 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.331194 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.331289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.331364 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.331437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.331437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.331576 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.331651 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.331723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.331795 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.331867 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.331938 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.332018 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.332092 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.332164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.332236 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.332307 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.332307 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.332498 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.332587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.332663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.332735 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.332807 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.332879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.332959 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.332959 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.333091 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.333163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.333235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.333306 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.333387 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.333462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.333534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.333534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.333534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.333534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.333534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.333534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.333534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.333534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.333534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.334087 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.334087 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.334087 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.334087 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.334342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.334585 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.334824 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.335061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.335318 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.335573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.335815 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.336056 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.336297 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.336559 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.336806 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.337070 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.337307 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.337560 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.337817 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.338067 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.338306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.338540 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.338779 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.339019 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.339258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.339338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.339493 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.339635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.339747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.339890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.339981 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.340156 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.340236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.340416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.340565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.340685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.340813 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.340933 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.341051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.341169 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.341287 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.341404 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.341529 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.341649 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.341766 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.341884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.342001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.342118 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.342244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.342363 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.342480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.342625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.342745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.342864 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.342991 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.343110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.343228 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.343353 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.343472 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.343591 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.343717 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.343837 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.343956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.344074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.344191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.344315 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.344460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.344661 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.345017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.345139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.345257 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.345373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.345530 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.345651 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.345769 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.345886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.user = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.346004 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] resource.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.346153 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.346284 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.346403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.346519 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.346636 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.346834 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.346955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.347117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.347238 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.347355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.347515 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.347636 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.347832 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.348031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.348153 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.348270 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.348394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] role.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.348533 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.348652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] role.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.348841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.348974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.349101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.349247 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.349368 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.349585 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.349716 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.349835 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.349951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.350068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.350311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.350562 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.351109 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.351109 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.351349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.351543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.351772 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.352022 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.352482 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.352735 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.352993 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.353251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.353508 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.353767 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.354007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.354270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.354528 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.354774 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.355012 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.355249 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.355487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.355744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.356005 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.356256 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.356762 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.356962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.356962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.357623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.357763 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.357900 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] token.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.358035 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.358184 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.358184 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.358539 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.358675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.358805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.358948 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.358948 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.359203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.359334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.359334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.359831 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.359961 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.360102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.360217 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.360217 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.360425 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.360579 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.360703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.360849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.360981 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.361718 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.361850 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.361983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.362176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.362327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.362458 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.362635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.362776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.connection = **** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.362969 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.363120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.363254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.363453 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.363589 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.363718 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.363902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.364046 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.364177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.364345 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.364513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.364638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.364800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.364937 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.365069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.365215 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.365346 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.365550 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.365685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.365816 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.366029 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.366180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.366311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.366441 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.366572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.366733 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.366865 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.367007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.367138 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:35:59.367267 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.367669 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] resource.caching = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.368019 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.368365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.368735 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.369084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.369437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.369769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.370113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.370448 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.370795 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.371129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] role.caching = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.371470 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] role.driver = sql {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.371796 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.372142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.372527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.373040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.373392 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.373738 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.374082 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.374424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.374768 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.375138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.375485 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.375831 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.376175 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.376570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.377107 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.378120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.378473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.378820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.379165 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.379512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.379852 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.380200 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.380585 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.380923 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.381258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.381587 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.381923 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.382267 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.382618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.382961 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.383293 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.383621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.383950 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.384281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] token.caching = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.384635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.384975 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.385308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.385663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.386014 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.386348 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.386684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.387023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.387365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.387699 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.388041 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.388372 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.388758 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.389103 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.389429 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.389767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.390169 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.390524 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.connection = **** {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.390921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.391277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.391609 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.391942 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.392273 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.392661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.393004 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.393334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.393673 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.394002 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.394340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.394668 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.395020 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.395352 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.395691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.396014 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.396347 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.396711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:59.396978 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86943) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:35:59.483181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.483366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.483538 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.493140 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.507083 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.507316 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.507544 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.515876 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.522294 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.522530 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.535100 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.535331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.578605 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.581038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.628386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.628640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.628818 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.629054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.694435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.694662 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.694755 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.694884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.694970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.695106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.695189 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.695321 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.695407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.695535 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.695619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.695771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.718886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.719121 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.719267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.719353 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.719505 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.719604 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.719734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.719818 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.719948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.720031 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.720159 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.720252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.720422 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.720655 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.731237 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.731554 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.744132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.744345 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.744460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.744541 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.744616 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.744764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.744849 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.744987 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.745070 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.745199 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.745283 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.745409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86943) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.745495 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.745632 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:59.762998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.763208 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 18:35:59.763546 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.763629 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.763748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 18:35:59.763831 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 18:35:59.764015 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.764131 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.764271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.764355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 18:35:59.764549 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.764633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.764802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.764896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.765124 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.765384 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.776111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.776386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.776678 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.776899 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.776983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.777181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.777454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.777735 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.785187 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86943) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.786077 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.788474 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86943) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.788754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.789032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.789310 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.789419 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.789591 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.789703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.789847 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.789987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.790108 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.790268 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.790393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.790551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.790634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.790812 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.790895 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.791083 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.791165 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.791357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.791627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.791899 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.792165 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.818009 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.819311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.819605 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86943) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.819884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.820966 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.821248 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.825139 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86943) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.825526 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.825811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.826574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.826972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.827263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.833682 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86943) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.833963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.835151 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.835438 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.838427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86943) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.838713 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.838989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.839266 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.839537 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.839808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.839956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.840074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.840247 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.840331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.840563 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.840846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.841123 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.841398 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.841670 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.841942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.858947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.859222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.861136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.861417 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.864063 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86943) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.866021 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.867714 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.868110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.869713 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.870114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.873155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86943) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.875161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.877344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86943) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.879401 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.881067 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.881365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.881648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.881928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.882202 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.882485 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.883091 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.883399 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.883686 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.883971 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.884251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.884560 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.902085 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86943) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.902367 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.902632 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.902890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.904224 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.904543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.904816 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.905082 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.910795 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.912517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.912800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.913041 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.914761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.915054 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.917178 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86943) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.917460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.917739 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.918025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.918296 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.919494 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.919784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.920065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.920364 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.920668 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.931562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86943) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.931840 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.932120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.932395 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.932790 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.933063 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.933343 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.934009 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.934291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.934584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.934866 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.935241 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.935574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.935890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.951794 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86943) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.954367 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.955655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86943) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.958208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.958973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.960739 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.961557 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.962381 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86943) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.962655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.962937 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.963285 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.964990 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.965279 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.965563 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.970251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.971892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86943) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.972981 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.974617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.975131 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.975419 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.975808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.976084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.977981 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.978202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.978595 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.978876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.985523 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86943) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.985839 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.986142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.988388 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.988698 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.988980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.993998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86943) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.994321 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.994553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.994820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.995096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.995483 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.995754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.996024 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.996299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.996590 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.996865 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.997007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:59.997119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.997291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.997401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.997572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.997685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86943) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.997856 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.998135 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.998516 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.998795 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.999071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.999351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.999623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:59.999893 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:36:00.000171 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:36:00.000450 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:36:00.000722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:36:00.036243 dv-cinder-813229-10-smb devstack@keystone.service[86943]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ea0a0779c0 pid: 86943 (default app) Jun 16 18:36:00.039483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ea0a0779c0 pid: 86942 (default app) Jun 16 18:36:00.039712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a2b44-d423-41c4-8772-86ac6bf71e23 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:00.040017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a2b44-d423-41c4-8772-86ac6bf71e23 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:00.040298 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a2b44-d423-41c4-8772-86ac6bf71e23 None None] PATH_INFO: `/v3` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:00.044483 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1/1] 10.222.0.93 () {50 vars in 791 bytes} [Thu Jun 16 18:36:00 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:09.111003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01220c06-c9ff-4189-99a2-cadc8c2563d4 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:09.111570 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01220c06-c9ff-4189-99a2-cadc8c2563d4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:09.111570 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01220c06-c9ff-4189-99a2-cadc8c2563d4 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:09.115837 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1/2] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:09.121135 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec6894-57b2-45a1-861f-a2e6850901fd None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:09.121569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec6894-57b2-45a1-861f-a2e6850901fd None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:09.121672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec6894-57b2-45a1-861f-a2e6850901fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:09.191735 dv-cinder-813229-10-smb devstack@keystone.service[86943]: INFO dbcounter [None req-0eec6894-57b2-45a1-861f-a2e6850901fd None None] Registered counter for database keystone Jun 16 18:36:09.212793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG oslo_db.sqlalchemy.engines [None req-0eec6894-57b2-45a1-861f-a2e6850901fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86943) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:36:09.219669 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writer thread running {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:36:09.398078 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG passlib.handlers.bcrypt [None req-0eec6894-57b2-45a1-861f-a2e6850901fd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86943) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 18:36:09.398436 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG passlib.handlers.bcrypt [None req-0eec6894-57b2-45a1-861f-a2e6850901fd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86943) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 18:36:09.454980 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-0eec6894-57b2-45a1-861f-a2e6850901fd None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:09.456659 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-0eec6894-57b2-45a1-861f-a2e6850901fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:09.578766 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 2/3] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 18:36:09.720596 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01220c06-c9ff-4189-99a2-cadc8c2563d4 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:09.791211 dv-cinder-813229-10-smb devstack@keystone.service[86942]: INFO dbcounter [None req-01220c06-c9ff-4189-99a2-cadc8c2563d4 None None] Registered counter for database keystone Jun 16 18:36:09.811235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG oslo_db.sqlalchemy.engines [None req-01220c06-c9ff-4189-99a2-cadc8c2563d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:36:09.817992 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writer thread running {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:36:09.936673 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01220c06-c9ff-4189-99a2-cadc8c2563d4 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:09.941463 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb0b8d-131d-4ac3-9bd6-384d4da56a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:09.942141 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb0b8d-131d-4ac3-9bd6-384d4da56a26 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:09.942432 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb0b8d-131d-4ac3-9bd6-384d4da56a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:09.942715 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb0b8d-131d-4ac3-9bd6-384d4da56a26 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:09.950831 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb0b8d-131d-4ac3-9bd6-384d4da56a26 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:10.003267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: WARNING keystone.common.rbac_enforcer.enforcer [None req-36eb0b8d-131d-4ac3-9bd6-384d4da56a26 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 18:36:10.003609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb0b8d-131d-4ac3-9bd6-384d4da56a26 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:10.013272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 2/4] 10.222.0.93 () {58 vars in 1324 bytes} [Thu Jun 16 18:36:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:36:10.019194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec6894-57b2-45a1-861f-a2e6850901fd None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:10.035730 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec6894-57b2-45a1-861f-a2e6850901fd None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:10.040126 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e623f7-568c-41ad-88f1-aec4fc8a294b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:10.041278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e623f7-568c-41ad-88f1-aec4fc8a294b admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:10.041569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e623f7-568c-41ad-88f1-aec4fc8a294b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:10.041848 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e623f7-568c-41ad-88f1-aec4fc8a294b admin admin] PATH_INFO: `/v3/projects/698d167bbea646fcaa71cda553a9912f` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:10.043353 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e623f7-568c-41ad-88f1-aec4fc8a294b admin admin] RBAC: Authorizing `identity:get_project(project_id=698d167bbea646fcaa71cda553a9912f)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:10.094771 dv-cinder-813229-10-smb devstack@keystone.service[86943]: WARNING keystone.common.rbac_enforcer.enforcer [None req-72e623f7-568c-41ad-88f1-aec4fc8a294b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 18:36:10.095118 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e623f7-568c-41ad-88f1-aec4fc8a294b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:10.099732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 3/5] 10.222.0.93 () {56 vars in 1207 bytes} [Thu Jun 16 18:36:10 2022] GET /identity/v3/projects/698d167bbea646fcaa71cda553a9912f => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:12.198207 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22a2fd-a3b1-4664-854a-11667d34ef4b None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:12.198801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22a2fd-a3b1-4664-854a-11667d34ef4b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:12.198801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22a2fd-a3b1-4664-854a-11667d34ef4b None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:12.203408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 3/6] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:12.209027 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2817d-435c-44a7-99b0-3a8cdf0c13e0 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:12.209449 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2817d-435c-44a7-99b0-3a8cdf0c13e0 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:12.209588 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2817d-435c-44a7-99b0-3a8cdf0c13e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:12.228692 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-b0c2817d-435c-44a7-99b0-3a8cdf0c13e0 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:12.230199 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b0c2817d-435c-44a7-99b0-3a8cdf0c13e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:12.238161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 4/7] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 16 18:36:12.260103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22a2fd-a3b1-4664-854a-11667d34ef4b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:12.272754 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22a2fd-a3b1-4664-854a-11667d34ef4b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:12.276988 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c7c6f-7749-4879-9641-da6f238b1b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:12.277628 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c7c6f-7749-4879-9641-da6f238b1b2d admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:12.277920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c7c6f-7749-4879-9641-da6f238b1b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:12.278204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c7c6f-7749-4879-9641-da6f238b1b2d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:12.286586 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c7c6f-7749-4879-9641-da6f238b1b2d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:12.288369 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c7c6f-7749-4879-9641-da6f238b1b2d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:12.297188 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 4/8] 10.222.0.93 () {58 vars in 1324 bytes} [Thu Jun 16 18:36:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:36:12.302679 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2817d-435c-44a7-99b0-3a8cdf0c13e0 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:12.311670 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2817d-435c-44a7-99b0-3a8cdf0c13e0 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:12.318075 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f923fb0-2599-40c7-93c6-7927a81f80da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:12.318075 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f923fb0-2599-40c7-93c6-7927a81f80da admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:12.318075 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f923fb0-2599-40c7-93c6-7927a81f80da admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:12.318075 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f923fb0-2599-40c7-93c6-7927a81f80da admin admin] PATH_INFO: `/v3/users/69ed26b6c8d84d67907abcc6c154b3a7` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:12.318759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f923fb0-2599-40c7-93c6-7927a81f80da admin admin] RBAC: Authorizing `identity:get_user(user_id=69ed26b6c8d84d67907abcc6c154b3a7)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:12.320596 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f923fb0-2599-40c7-93c6-7927a81f80da admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:12.322146 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 5/9] 10.222.0.93 () {56 vars in 1198 bytes} [Thu Jun 16 18:36:12 2022] GET /identity/v3/users/69ed26b6c8d84d67907abcc6c154b3a7 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:14.505127 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938c689-b49a-4f89-9aaa-547113e6de27 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.505657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938c689-b49a-4f89-9aaa-547113e6de27 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.505753 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938c689-b49a-4f89-9aaa-547113e6de27 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.507040 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 5/10] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:14.512359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5522a-defd-414e-9f76-42941a0b0593 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.512771 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5522a-defd-414e-9f76-42941a0b0593 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.512960 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5522a-defd-414e-9f76-42941a0b0593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.513646 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a90759-dc7f-4f40-8c83-a29a54f6e8cb None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.513936 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a90759-dc7f-4f40-8c83-a29a54f6e8cb None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.514215 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a90759-dc7f-4f40-8c83-a29a54f6e8cb None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.515537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 6/11] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:14.521383 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83a4e1-4e5e-47e0-8dd0-7e31dde1c529 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.521603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83a4e1-4e5e-47e0-8dd0-7e31dde1c529 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.521879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83a4e1-4e5e-47e0-8dd0-7e31dde1c529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.529546 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-56d5522a-defd-414e-9f76-42941a0b0593 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:14.530763 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-56d5522a-defd-414e-9f76-42941a0b0593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:14.567654 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG passlib.handlers.bcrypt [None req-ff83a4e1-4e5e-47e0-8dd0-7e31dde1c529 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86942) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 18:36:14.568073 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG passlib.handlers.bcrypt [None req-ff83a4e1-4e5e-47e0-8dd0-7e31dde1c529 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86942) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 18:36:14.612518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 6/12] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:14.617525 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-ff83a4e1-4e5e-47e0-8dd0-7e31dde1c529 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:14.619107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ff83a4e1-4e5e-47e0-8dd0-7e31dde1c529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:14.635568 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5522a-defd-414e-9f76-42941a0b0593 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:14.660036 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:14.719080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 7/13] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:14.741136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83a4e1-4e5e-47e0-8dd0-7e31dde1c529 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:14.742026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5522a-defd-414e-9f76-42941a0b0593 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:14.775333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894fbb9-fab5-4c8c-9554-d4112068f521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:14.776068 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894fbb9-fab5-4c8c-9554-d4112068f521 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.776359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894fbb9-fab5-4c8c-9554-d4112068f521 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.776695 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894fbb9-fab5-4c8c-9554-d4112068f521 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.788266 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894fbb9-fab5-4c8c-9554-d4112068f521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:14.800097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-1894fbb9-fab5-4c8c-9554-d4112068f521 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:14.800097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:14.800097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:14.800097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:14.800097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:14.800097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:14.800097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:14.800097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:14.800097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:14.800097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:14.800097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:14.800097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:14.800097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:14.800097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:14.800097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:14.800097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:14.801250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:14.801250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:14.801250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:14.801250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:14.801250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:14.801250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:14.801250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:14.801250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:14.801250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:14.801250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:14.801250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:14.801250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:14.801250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:14.801250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:14.801250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:14.801250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:14.802536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:14.802536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:14.802536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:14.802536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:14.802536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:14.802536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:14.802536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:14.802536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:14.802536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:14.802536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:14.802536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:14.802536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:14.802536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 7/14] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:36:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:14.807009 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894fbb9-fab5-4c8c-9554-d4112068f521 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:14.841116 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83a4e1-4e5e-47e0-8dd0-7e31dde1c529 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:14.843865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:14.878449 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985b3ca-1cf0-453f-af2a-f6543446cd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:14.879392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985b3ca-1cf0-453f-af2a-f6543446cd46 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.879876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985b3ca-1cf0-453f-af2a-f6543446cd46 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.880212 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985b3ca-1cf0-453f-af2a-f6543446cd46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.899578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:14.917996 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894fbb9-fab5-4c8c-9554-d4112068f521 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:14.948402 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985b3ca-1cf0-453f-af2a-f6543446cd46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:14.949960 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985b3ca-1cf0-453f-af2a-f6543446cd46 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:14.951803 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22409f54-7351-4313-8a47-30cdc907c81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:14.952508 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22409f54-7351-4313-8a47-30cdc907c81b None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.952802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22409f54-7351-4313-8a47-30cdc907c81b None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.953085 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22409f54-7351-4313-8a47-30cdc907c81b None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.953851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22409f54-7351-4313-8a47-30cdc907c81b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:14.954165 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22409f54-7351-4313-8a47-30cdc907c81b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:14.955550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22409f54-7351-4313-8a47-30cdc907c81b None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:14.967361 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 8/15] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:14.973344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22409f54-7351-4313-8a47-30cdc907c81b None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:15.046492 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 8/16] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 18:36:15.051958 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985b3ca-1cf0-453f-af2a-f6543446cd46 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:15.054976 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:15.073047 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22409f54-7351-4313-8a47-30cdc907c81b None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:15.106856 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9fafc-0f68-48e2-bdc4-c2ec9399fb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:15.107992 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9fafc-0f68-48e2-bdc4-c2ec9399fb7d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:15.108279 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9fafc-0f68-48e2-bdc4-c2ec9399fb7d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:15.108586 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9fafc-0f68-48e2-bdc4-c2ec9399fb7d None admin] PATH_INFO: `/v3/users/69ed26b6c8d84d67907abcc6c154b3a7` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:15.109835 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9fafc-0f68-48e2-bdc4-c2ec9399fb7d None admin] RBAC: Authorizing `identity:get_user(user_id=69ed26b6c8d84d67907abcc6c154b3a7)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:15.111309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9fafc-0f68-48e2-bdc4-c2ec9399fb7d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:15.112978 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 9/17] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:14 2022] GET /identity/v3/users/69ed26b6c8d84d67907abcc6c154b3a7 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:15.118470 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9fafc-0f68-48e2-bdc4-c2ec9399fb7d None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:15.132577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:15.154332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985b3ca-1cf0-453f-af2a-f6543446cd46 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:15.189080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd70632-8e7c-422c-bc8b-738563a12d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:15.189876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd70632-8e7c-422c-bc8b-738563a12d9a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:15.190162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd70632-8e7c-422c-bc8b-738563a12d9a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:15.190440 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd70632-8e7c-422c-bc8b-738563a12d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:15.208702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd70632-8e7c-422c-bc8b-738563a12d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:15.210181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd70632-8e7c-422c-bc8b-738563a12d9a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:15.215962 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9fafc-0f68-48e2-bdc4-c2ec9399fb7d None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:15.230745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-1dd70632-8e7c-422c-bc8b-738563a12d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:36:15.230745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:15.230745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:15.230745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:15.230745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:15.230745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:15.230745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:15.230745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:15.230745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:15.230745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:15.230745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:15.230745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:15.230745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:36:15.230745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:36:15.230745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:36:15.231581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:36:15.231581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:15.231581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:15.231581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:15.231581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:15.231581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:15.231581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:15.231581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:15.231581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:15.231581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:15.231581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:15.231581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:15.231581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:15.231581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:15.231581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:15.231581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:15.231581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:15.232690 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:36:15.232690 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:36:15.232690 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:36:15.232690 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:36:15.232690 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 9/18] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:15.237820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd70632-8e7c-422c-bc8b-738563a12d9a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:15.250798 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71228d2-509a-484d-80ff-6136637310a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:15.251610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71228d2-509a-484d-80ff-6136637310a9 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:15.251901 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71228d2-509a-484d-80ff-6136637310a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:15.252178 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71228d2-509a-484d-80ff-6136637310a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:15.253415 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71228d2-509a-484d-80ff-6136637310a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:15.254846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71228d2-509a-484d-80ff-6136637310a9 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:15.256457 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 10/19] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:15.262054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71228d2-509a-484d-80ff-6136637310a9 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:15.298502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:15.341445 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd70632-8e7c-422c-bc8b-738563a12d9a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:15.343276 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:15.362094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71228d2-509a-484d-80ff-6136637310a9 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:15.375936 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38284ab8-da56-4db5-841d-3e1c32536438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:15.376637 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38284ab8-da56-4db5-841d-3e1c32536438 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:15.376928 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38284ab8-da56-4db5-841d-3e1c32536438 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:15.377209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38284ab8-da56-4db5-841d-3e1c32536438 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:15.377944 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38284ab8-da56-4db5-841d-3e1c32536438 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:15.378256 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38284ab8-da56-4db5-841d-3e1c32536438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:15.379660 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38284ab8-da56-4db5-841d-3e1c32536438 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:15.395346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8c16f-fca2-4151-853d-61b8ffeedf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:15.396000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8c16f-fca2-4151-853d-61b8ffeedf34 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:15.396284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8c16f-fca2-4151-853d-61b8ffeedf34 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:15.396593 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8c16f-fca2-4151-853d-61b8ffeedf34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:15.397427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8c16f-fca2-4151-853d-61b8ffeedf34 None admin] RBAC: Adding query filter params (role.id=416a52031d5d49b6a3fa0e9baa814436, scope.domain.id=default, user.id=69ed26b6c8d84d67907abcc6c154b3a7) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:15.397693 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 10/20] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:15.397814 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8c16f-fca2-4151-853d-61b8ffeedf34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:15.399372 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8c16f-fca2-4151-853d-61b8ffeedf34 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:15.407247 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 11/21] 10.222.0.93 () {56 vars in 1322 bytes} [Thu Jun 16 18:36:15 2022] GET /identity/v3/role_assignments?user.id=69ed26b6c8d84d67907abcc6c154b3a7&scope.domain.id=default&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:17.937077 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3a43e-4a7f-47b2-a80e-15096204229a None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:17.938149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3a43e-4a7f-47b2-a80e-15096204229a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:17.938646 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3a43e-4a7f-47b2-a80e-15096204229a None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:17.940225 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 11/22] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:17.945902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67c292-b4b2-48c5-a160-9ff47a95f2dd None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:17.946358 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67c292-b4b2-48c5-a160-9ff47a95f2dd None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:17.946540 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67c292-b4b2-48c5-a160-9ff47a95f2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:17.969901 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-bf67c292-b4b2-48c5-a160-9ff47a95f2dd None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:17.971115 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-bf67c292-b4b2-48c5-a160-9ff47a95f2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:18.067179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 12/23] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:18.106185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3a43e-4a7f-47b2-a80e-15096204229a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:18.214091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6bb34-1fad-423d-8cc8-14a06113b4df None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:18.214720 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6bb34-1fad-423d-8cc8-14a06113b4df None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:18.215205 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6bb34-1fad-423d-8cc8-14a06113b4df None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:18.218257 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 13/24] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:18.222570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5afa3-5922-4caf-9160-5a2ac481e33c None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:18.223103 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5afa3-5922-4caf-9160-5a2ac481e33c None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:18.223596 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5afa3-5922-4caf-9160-5a2ac481e33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:18.264751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-c9e5afa3-5922-4caf-9160-5a2ac481e33c None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:18.268773 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c9e5afa3-5922-4caf-9160-5a2ac481e33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:18.283202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3a43e-4a7f-47b2-a80e-15096204229a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:18.311571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:18.349811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520251b7-2d68-40ed-87a5-2d05ae0c20e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:18.350648 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520251b7-2d68-40ed-87a5-2d05ae0c20e3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:18.350941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520251b7-2d68-40ed-87a5-2d05ae0c20e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:18.351239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520251b7-2d68-40ed-87a5-2d05ae0c20e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:18.371778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520251b7-2d68-40ed-87a5-2d05ae0c20e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:18.373909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520251b7-2d68-40ed-87a5-2d05ae0c20e3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:18.402671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-520251b7-2d68-40ed-87a5-2d05ae0c20e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:36:18.402671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:18.402671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:18.402671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:18.402671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:18.402671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:18.402671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:18.402671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:18.402671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:18.402671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:18.402671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:18.402671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:18.402671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:36:18.402671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:36:18.402671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:36:18.403744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:36:18.403744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:18.403744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:18.403744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:18.403744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:18.403744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:18.403744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:18.403744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:18.403744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:18.403744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:18.403744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:18.403744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:18.403744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:18.403744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:18.403744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:18.403744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:18.403744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:18.405340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:36:18.405340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:36:18.405340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:36:18.405340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:36:18.405340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 12/25] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:18.405656 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5dc9c-87e1-4b40-a26d-c87ab379c7d1 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:18.406392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5dc9c-87e1-4b40-a26d-c87ab379c7d1 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:18.406508 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 14/26] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:18.406593 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5dc9c-87e1-4b40-a26d-c87ab379c7d1 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:18.407663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64582e-142c-4502-b3c7-b8c8160b4142 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:18.407786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 13/27] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:18.408192 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64582e-142c-4502-b3c7-b8c8160b4142 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:18.408698 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64582e-142c-4502-b3c7-b8c8160b4142 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:18.410266 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 15/28] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:18.417811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f69d6-9216-40f7-abb1-b11599a2408d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:18.419138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780f653-5ca9-4ba2-b9b3-94897c83e890 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:18.419576 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780f653-5ca9-4ba2-b9b3-94897c83e890 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:18.419997 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f69d6-9216-40f7-abb1-b11599a2408d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:18.421031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780f653-5ca9-4ba2-b9b3-94897c83e890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:18.421463 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f69d6-9216-40f7-abb1-b11599a2408d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:18.436084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:18.446567 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-da5f69d6-9216-40f7-abb1-b11599a2408d None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:18.454026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-5780f653-5ca9-4ba2-b9b3-94897c83e890 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:18.454139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-da5f69d6-9216-40f7-abb1-b11599a2408d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:18.454240 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5780f653-5ca9-4ba2-b9b3-94897c83e890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:18.532189 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 14/29] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:18.532590 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 16/30] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:18.533488 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780f653-5ca9-4ba2-b9b3-94897c83e890 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:18.533779 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f69d6-9216-40f7-abb1-b11599a2408d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:18.640500 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:18.644061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f69d6-9216-40f7-abb1-b11599a2408d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:18.653938 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780f653-5ca9-4ba2-b9b3-94897c83e890 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:18.680946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc0c1b-8307-4f07-81e6-f1c8f43aaf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:18.681977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc0c1b-8307-4f07-81e6-f1c8f43aaf6f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:18.682516 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc0c1b-8307-4f07-81e6-f1c8f43aaf6f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:18.682962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc0c1b-8307-4f07-81e6-f1c8f43aaf6f None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:18.683863 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc0c1b-8307-4f07-81e6-f1c8f43aaf6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:18.684374 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc0c1b-8307-4f07-81e6-f1c8f43aaf6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:18.686613 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc0c1b-8307-4f07-81e6-f1c8f43aaf6f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:18.694946 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a5535-9d84-4b61-948f-60c4c201407d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:18.695642 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a5535-9d84-4b61-948f-60c4c201407d None admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:18.695932 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a5535-9d84-4b61-948f-60c4c201407d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:18.696217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a5535-9d84-4b61-948f-60c4c201407d None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:18.697548 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a5535-9d84-4b61-948f-60c4c201407d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:18.699231 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a5535-9d84-4b61-948f-60c4c201407d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:18.700720 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 15/31] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:18.701860 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:18.702633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc0c1b-8307-4f07-81e6-f1c8f43aaf6f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:18.815099 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc0c1b-8307-4f07-81e6-f1c8f43aaf6f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:18.851973 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee01eda-09a7-4a4b-8cd5-43462da28a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:18.852782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee01eda-09a7-4a4b-8cd5-43462da28a4e None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:18.853072 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee01eda-09a7-4a4b-8cd5-43462da28a4e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:18.853355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee01eda-09a7-4a4b-8cd5-43462da28a4e None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:18.854164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee01eda-09a7-4a4b-8cd5-43462da28a4e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:18.855591 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee01eda-09a7-4a4b-8cd5-43462da28a4e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:19.020542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 17/32] 10.222.0.93 () {60 vars in 1131 bytes} [Thu Jun 16 18:36:18 2022] POST /identity/v3/roles => generated 219 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:36:19.022451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a5535-9d84-4b61-948f-60c4c201407d None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:19.049909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 16/33] 10.222.0.93 () {60 vars in 1131 bytes} [Thu Jun 16 18:36:18 2022] POST /identity/v3/roles => generated 225 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:36:19.055784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee01eda-09a7-4a4b-8cd5-43462da28a4e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:19.096628 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:19.209876 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a5535-9d84-4b61-948f-60c4c201407d None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:19.274187 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04016bc8-4d04-4ec9-bb36-b72765b9e8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:19.275426 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04016bc8-4d04-4ec9-bb36-b72765b9e8a5 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.275964 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04016bc8-4d04-4ec9-bb36-b72765b9e8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.276501 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04016bc8-4d04-4ec9-bb36-b72765b9e8a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.291320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04016bc8-4d04-4ec9-bb36-b72765b9e8a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:19.301821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-04016bc8-4d04-4ec9-bb36-b72765b9e8a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:19.301821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:19.301821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:19.301821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:19.301821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:19.301821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:19.301821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:19.301821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:19.301821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:19.301821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:19.301821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:19.301821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:19.301821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:19.301821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:19.301821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:19.301821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:19.302788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:19.302788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:19.302788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:19.302788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:19.302788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:19.302788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:19.302788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:19.302788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:19.302788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:19.302788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:19.302788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:19.302788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:19.302788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:19.302788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:19.302788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:19.302788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:19.303560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:19.303560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:19.303560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:19.303560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:19.303560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:19.303560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:19.303560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:19.303560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:19.303560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:19.303560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:19.303560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:19.303560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:19.306399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 18/34] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:36:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:19.308298 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01ec0b-25dc-45fe-bf73-8c0b614009e7 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.308809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01ec0b-25dc-45fe-bf73-8c0b614009e7 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.309284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01ec0b-25dc-45fe-bf73-8c0b614009e7 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.310627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee01eda-09a7-4a4b-8cd5-43462da28a4e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:19.313052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 19/35] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:19.317148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe30602-b659-4fc1-9dc6-ad0fa05180c4 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.319039 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe30602-b659-4fc1-9dc6-ad0fa05180c4 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.319601 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe30602-b659-4fc1-9dc6-ad0fa05180c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.346719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-fbe30602-b659-4fc1-9dc6-ad0fa05180c4 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:19.349195 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-fbe30602-b659-4fc1-9dc6-ad0fa05180c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:19.386503 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451cee0-01a5-4ea3-936f-dac1fd291a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:19.387209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451cee0-01a5-4ea3-936f-dac1fd291a15 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.387490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451cee0-01a5-4ea3-936f-dac1fd291a15 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.387773 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451cee0-01a5-4ea3-936f-dac1fd291a15 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.388904 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451cee0-01a5-4ea3-936f-dac1fd291a15 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:19.390513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451cee0-01a5-4ea3-936f-dac1fd291a15 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:19.426762 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:19.445597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 20/36] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:19.446315 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe30602-b659-4fc1-9dc6-ad0fa05180c4 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:19.489254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 17/37] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Jun 16 18:36:19 2022] POST /identity/v3/projects => generated 301 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:36:19.490665 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451cee0-01a5-4ea3-936f-dac1fd291a15 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:19.580087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe30602-b659-4fc1-9dc6-ad0fa05180c4 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:19.612476 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:19.627910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a7df3-ffc3-4a03-967e-f358fb128eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:19.639481 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a7df3-ffc3-4a03-967e-f358fb128eab None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.639481 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a7df3-ffc3-4a03-967e-f358fb128eab None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.639481 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a7df3-ffc3-4a03-967e-f358fb128eab None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.639481 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a7df3-ffc3-4a03-967e-f358fb128eab None admin] RBAC: Adding query filter params (name=admin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:19.639481 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a7df3-ffc3-4a03-967e-f358fb128eab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:19.639481 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a7df3-ffc3-4a03-967e-f358fb128eab None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:19.647873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 21/38] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:19.647873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5be84-8218-4b40-bd2e-3e66c26839a9 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.647873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5be84-8218-4b40-bd2e-3e66c26839a9 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.647873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5be84-8218-4b40-bd2e-3e66c26839a9 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.647873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 22/39] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:19.651917 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5be84-8218-4b40-bd2e-3e66c26839a9 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:19.652658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451cee0-01a5-4ea3-936f-dac1fd291a15 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:19.700156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b5f72-d84c-4255-bff6-d6eadbf26203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:19.700156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b5f72-d84c-4255-bff6-d6eadbf26203 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.700156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b5f72-d84c-4255-bff6-d6eadbf26203 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.700156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b5f72-d84c-4255-bff6-d6eadbf26203 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.700593 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b5f72-d84c-4255-bff6-d6eadbf26203 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:19.701680 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b5f72-d84c-4255-bff6-d6eadbf26203 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:19.724916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:19.770583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 18/40] 10.222.0.93 () {60 vars in 1131 bytes} [Thu Jun 16 18:36:19 2022] POST /identity/v3/roles => generated 223 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:36:19.772015 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830637c-16a3-4d4e-8926-5218441b1ee5 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.772319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830637c-16a3-4d4e-8926-5218441b1ee5 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.772795 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830637c-16a3-4d4e-8926-5218441b1ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.784313 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5be84-8218-4b40-bd2e-3e66c26839a9 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:19.826852 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17209102-bbfc-4b04-b1e1-72b8e6e7dc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:19.827802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17209102-bbfc-4b04-b1e1-72b8e6e7dc75 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.828118 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17209102-bbfc-4b04-b1e1-72b8e6e7dc75 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.828395 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17209102-bbfc-4b04-b1e1-72b8e6e7dc75 None admin] PATH_INFO: `/v3/users/69ed26b6c8d84d67907abcc6c154b3a7` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.829863 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17209102-bbfc-4b04-b1e1-72b8e6e7dc75 None admin] RBAC: Authorizing `identity:get_user(user_id=69ed26b6c8d84d67907abcc6c154b3a7)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:19.831438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17209102-bbfc-4b04-b1e1-72b8e6e7dc75 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:19.833589 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 23/41] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:19 2022] GET /identity/v3/users/69ed26b6c8d84d67907abcc6c154b3a7 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:19.839375 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17209102-bbfc-4b04-b1e1-72b8e6e7dc75 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:19.901419 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a830637c-16a3-4d4e-8926-5218441b1ee5 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:19.902932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a830637c-16a3-4d4e-8926-5218441b1ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:19.960723 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17209102-bbfc-4b04-b1e1-72b8e6e7dc75 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:19.976372 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:19.980835 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 19/42] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:19.997491 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ed32f-97f0-4f14-9d48-fe96657c3a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:19.998809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ed32f-97f0-4f14-9d48-fe96657c3a7d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.999095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ed32f-97f0-4f14-9d48-fe96657c3a7d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.999373 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ed32f-97f0-4f14-9d48-fe96657c3a7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:20.000602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ed32f-97f0-4f14-9d48-fe96657c3a7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:20.002157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ed32f-97f0-4f14-9d48-fe96657c3a7d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:20.003791 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 24/43] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:20.005040 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830637c-16a3-4d4e-8926-5218441b1ee5 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:20.010312 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ed32f-97f0-4f14-9d48-fe96657c3a7d None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:20.074027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:20.113743 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ed32f-97f0-4f14-9d48-fe96657c3a7d None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:20.114222 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830637c-16a3-4d4e-8926-5218441b1ee5 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:20.147214 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645e28b-9638-4585-b3b4-3b036d2b185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:20.147507 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8648e-ecf5-4646-84b2-a60ff442d9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:20.148077 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e28b-9638-4585-b3b4-3b036d2b185f None admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:20.148305 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8648e-ecf5-4646-84b2-a60ff442d9b2 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:20.148393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e28b-9638-4585-b3b4-3b036d2b185f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:20.148637 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8648e-ecf5-4646-84b2-a60ff442d9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:20.148769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e28b-9638-4585-b3b4-3b036d2b185f None admin] PATH_INFO: `/v3/domains/default/users/69ed26b6c8d84d67907abcc6c154b3a7/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:20.148922 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8648e-ecf5-4646-84b2-a60ff442d9b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:20.150105 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8648e-ecf5-4646-84b2-a60ff442d9b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:20.150644 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645e28b-9638-4585-b3b4-3b036d2b185f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=69ed26b6c8d84d67907abcc6c154b3a7, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:20.151612 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8648e-ecf5-4646-84b2-a60ff442d9b2 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:20.152093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645e28b-9638-4585-b3b4-3b036d2b185f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:20.153442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 20/44] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:20.159648 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8648e-ecf5-4646-84b2-a60ff442d9b2 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:20.231141 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 25/45] 10.222.0.93 () {58 vars in 1361 bytes} [Thu Jun 16 18:36:20 2022] PUT /identity/v3/domains/default/users/69ed26b6c8d84d67907abcc6c154b3a7/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:36:20.260079 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8648e-ecf5-4646-84b2-a60ff442d9b2 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:20.290643 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:20.299605 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207d959-f622-4add-b557-f5e58740ab37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:20.300297 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207d959-f622-4add-b557-f5e58740ab37 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:20.300622 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207d959-f622-4add-b557-f5e58740ab37 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:20.300906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207d959-f622-4add-b557-f5e58740ab37 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:20.301644 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207d959-f622-4add-b557-f5e58740ab37 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:20.303143 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207d959-f622-4add-b557-f5e58740ab37 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:20.377004 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 21/46] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Jun 16 18:36:20 2022] POST /identity/v3/projects => generated 312 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:36:22.344207 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd440409-3104-4d47-b146-f46622b08262 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:22.344767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd440409-3104-4d47-b146-f46622b08262 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:22.344853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd440409-3104-4d47-b146-f46622b08262 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:22.346186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 26/47] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:22.351490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d3b6f-65c3-48ec-931e-e19dc49461f2 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:22.351909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d3b6f-65c3-48ec-931e-e19dc49461f2 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:22.352127 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d3b6f-65c3-48ec-931e-e19dc49461f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:22.369308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-407d3b6f-65c3-48ec-931e-e19dc49461f2 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:22.370489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-407d3b6f-65c3-48ec-931e-e19dc49461f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:22.440032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 22/48] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:22.464309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd440409-3104-4d47-b146-f46622b08262 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:22.488296 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c01275-001e-429e-a1ca-b35c7814bfc6 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:22.488633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c01275-001e-429e-a1ca-b35c7814bfc6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:22.488920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c01275-001e-429e-a1ca-b35c7814bfc6 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:22.490423 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 23/49] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:22.495189 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090141fe-ed6b-4cbb-8879-e08158f6d2b8 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:22.495597 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090141fe-ed6b-4cbb-8879-e08158f6d2b8 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:22.495882 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090141fe-ed6b-4cbb-8879-e08158f6d2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:22.509408 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:22.512423 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-090141fe-ed6b-4cbb-8879-e08158f6d2b8 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:22.514197 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-090141fe-ed6b-4cbb-8879-e08158f6d2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:22.566116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd440409-3104-4d47-b146-f46622b08262 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:22.580412 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 24/50] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:22.599942 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e11cdc-703c-40eb-99d5-af5571b495e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:22.600770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e11cdc-703c-40eb-99d5-af5571b495e8 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:22.601063 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e11cdc-703c-40eb-99d5-af5571b495e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:22.601346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e11cdc-703c-40eb-99d5-af5571b495e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:22.603436 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090141fe-ed6b-4cbb-8879-e08158f6d2b8 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:22.612598 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e11cdc-703c-40eb-99d5-af5571b495e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:22.620212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-c0e11cdc-703c-40eb-99d5-af5571b495e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:22.620212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:22.620212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:22.620212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:22.620212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:22.620212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:22.620212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:22.620212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:22.620212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:22.620212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:22.620212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:22.620212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:22.620212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:22.620212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:22.620212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:22.620212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:22.621132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:22.621132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:22.621132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:22.621132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:22.621132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:22.621132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:22.621132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:22.621132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:22.621132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:22.621132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:22.621132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:22.621132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:22.621132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:22.621132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:22.621132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:22.621132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:22.621891 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:22.621891 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:22.621891 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:22.621891 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:22.621891 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:22.621891 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:22.621891 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:22.621891 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:22.621891 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:22.621891 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:22.621891 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:22.621891 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:22.621891 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 27/51] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:36:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:22.627567 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e11cdc-703c-40eb-99d5-af5571b495e8 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:22.646778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:22.702779 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090141fe-ed6b-4cbb-8879-e08158f6d2b8 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:22.724906 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e11cdc-703c-40eb-99d5-af5571b495e8 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:22.726470 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:22.736604 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb8deb-eb68-46de-9bbb-f24dc9086513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:22.737408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb8deb-eb68-46de-9bbb-f24dc9086513 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:22.737692 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb8deb-eb68-46de-9bbb-f24dc9086513 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:22.737970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb8deb-eb68-46de-9bbb-f24dc9086513 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:22.739148 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb8deb-eb68-46de-9bbb-f24dc9086513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:22.740625 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb8deb-eb68-46de-9bbb-f24dc9086513 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:22.742403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 25/52] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:22.748428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb8deb-eb68-46de-9bbb-f24dc9086513 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:22.760251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8449fc8-9ae4-4659-a47a-f4ca539afb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:22.760958 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8449fc8-9ae4-4659-a47a-f4ca539afb40 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:22.761249 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8449fc8-9ae4-4659-a47a-f4ca539afb40 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:22.761533 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8449fc8-9ae4-4659-a47a-f4ca539afb40 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:22.762294 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8449fc8-9ae4-4659-a47a-f4ca539afb40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:22.762606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8449fc8-9ae4-4659-a47a-f4ca539afb40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:22.764026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8449fc8-9ae4-4659-a47a-f4ca539afb40 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:22.772458 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 28/53] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:22.777812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8449fc8-9ae4-4659-a47a-f4ca539afb40 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:22.845223 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb8deb-eb68-46de-9bbb-f24dc9086513 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:22.853932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:22.875956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8449fc8-9ae4-4659-a47a-f4ca539afb40 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:22.878757 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a17c7-acb1-4e2c-83dc-fdda945a8502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:22.878757 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a17c7-acb1-4e2c-83dc-fdda945a8502 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:22.879055 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a17c7-acb1-4e2c-83dc-fdda945a8502 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:22.879333 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a17c7-acb1-4e2c-83dc-fdda945a8502 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:22.880035 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a17c7-acb1-4e2c-83dc-fdda945a8502 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:22.881505 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a17c7-acb1-4e2c-83dc-fdda945a8502 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:22.909286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291fdd5-7394-4671-8788-13452dc8311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:22.910171 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291fdd5-7394-4671-8788-13452dc8311b None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:22.910448 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291fdd5-7394-4671-8788-13452dc8311b None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:22.910729 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291fdd5-7394-4671-8788-13452dc8311b None admin] PATH_INFO: `/v3/users/69ed26b6c8d84d67907abcc6c154b3a7` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:22.911950 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291fdd5-7394-4671-8788-13452dc8311b None admin] RBAC: Authorizing `identity:get_user(user_id=69ed26b6c8d84d67907abcc6c154b3a7)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:22.913446 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291fdd5-7394-4671-8788-13452dc8311b None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:22.915070 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 29/54] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:22 2022] GET /identity/v3/users/69ed26b6c8d84d67907abcc6c154b3a7 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:22.920867 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291fdd5-7394-4671-8788-13452dc8311b None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:22.950147 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:22.957796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 26/55] 10.222.0.93 () {60 vars in 1140 bytes} [Thu Jun 16 18:36:22 2022] POST /identity/v3/projects => generated 298 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:36:23.025099 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291fdd5-7394-4671-8788-13452dc8311b None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:23.062260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129e2ec-82cc-479f-a0db-a59099316682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:23.063090 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129e2ec-82cc-479f-a0db-a59099316682 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:23.063381 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129e2ec-82cc-479f-a0db-a59099316682 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:23.063666 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129e2ec-82cc-479f-a0db-a59099316682 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:23.064938 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129e2ec-82cc-479f-a0db-a59099316682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:23.066443 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129e2ec-82cc-479f-a0db-a59099316682 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:23.068130 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 30/56] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:23.074116 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a17c7-acb1-4e2c-83dc-fdda945a8502 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:23.177285 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a17c7-acb1-4e2c-83dc-fdda945a8502 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:23.209789 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36934b25-6a15-453c-989b-bb54a3b11938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:23.210486 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36934b25-6a15-453c-989b-bb54a3b11938 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:23.210772 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36934b25-6a15-453c-989b-bb54a3b11938 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:23.211051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36934b25-6a15-453c-989b-bb54a3b11938 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:23.211894 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36934b25-6a15-453c-989b-bb54a3b11938 None admin] RBAC: Adding query filter params (role.id=416a52031d5d49b6a3fa0e9baa814436, scope.domain.id=default, user.id=69ed26b6c8d84d67907abcc6c154b3a7) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:23.212210 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36934b25-6a15-453c-989b-bb54a3b11938 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:23.213700 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36934b25-6a15-453c-989b-bb54a3b11938 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:23.223573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 27/57] 10.222.0.93 () {56 vars in 1322 bytes} [Thu Jun 16 18:36:23 2022] GET /identity/v3/role_assignments?user.id=69ed26b6c8d84d67907abcc6c154b3a7&scope.domain.id=default&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:25.089615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260647b3-e68f-4340-83f7-16beff7e40d7 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:25.090141 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260647b3-e68f-4340-83f7-16beff7e40d7 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:25.090224 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260647b3-e68f-4340-83f7-16beff7e40d7 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:25.092081 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 31/58] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:25.097242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660dec1-d143-405e-a936-d2d0350b5c41 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:25.097638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660dec1-d143-405e-a936-d2d0350b5c41 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:25.097815 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660dec1-d143-405e-a936-d2d0350b5c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:25.114324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4660dec1-d143-405e-a936-d2d0350b5c41 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:25.115518 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4660dec1-d143-405e-a936-d2d0350b5c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:25.132238 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:25.180484 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 28/59] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:25.205301 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260647b3-e68f-4340-83f7-16beff7e40d7 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:25.298923 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:25.302635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260647b3-e68f-4340-83f7-16beff7e40d7 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:25.335869 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664374f-38dc-42fd-90b4-2587c5b68b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:25.336688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664374f-38dc-42fd-90b4-2587c5b68b80 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:25.336972 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664374f-38dc-42fd-90b4-2587c5b68b80 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:25.337249 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664374f-38dc-42fd-90b4-2587c5b68b80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:25.338406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664374f-38dc-42fd-90b4-2587c5b68b80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:25.339894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664374f-38dc-42fd-90b4-2587c5b68b80 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:25.341535 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 32/60] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:25.347031 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660dec1-d143-405e-a936-d2d0350b5c41 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:25.442591 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660dec1-d143-405e-a936-d2d0350b5c41 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:25.476007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3cf1c-da3a-4d5b-a7c4-81b72cad8456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:25.476715 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3cf1c-da3a-4d5b-a7c4-81b72cad8456 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:25.477007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3cf1c-da3a-4d5b-a7c4-81b72cad8456 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:25.477291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3cf1c-da3a-4d5b-a7c4-81b72cad8456 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:25.478009 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3cf1c-da3a-4d5b-a7c4-81b72cad8456 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:25.479480 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3cf1c-da3a-4d5b-a7c4-81b72cad8456 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:25.573609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 29/61] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Jun 16 18:36:25 2022] POST /identity/v3/users => generated 275 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:36:28.743892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af320041-17de-426c-a8a5-411d6b4091a3 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:28.744745 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af320041-17de-426c-a8a5-411d6b4091a3 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:28.745180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af320041-17de-426c-a8a5-411d6b4091a3 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:28.747358 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 33/62] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:28.752631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764bc9c-76ae-4bc7-9a1f-efde0030e61e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:28.753438 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764bc9c-76ae-4bc7-9a1f-efde0030e61e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:28.753867 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764bc9c-76ae-4bc7-9a1f-efde0030e61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:28.781480 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4764bc9c-76ae-4bc7-9a1f-efde0030e61e None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:28.782959 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4764bc9c-76ae-4bc7-9a1f-efde0030e61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:28.786177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:28.875393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 30/63] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:28.912840 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af320041-17de-426c-a8a5-411d6b4091a3 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:29.056389 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c361e-dc01-4599-be54-ee0fc43033b4 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.056793 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c361e-dc01-4599-be54-ee0fc43033b4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.056984 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c361e-dc01-4599-be54-ee0fc43033b4 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.058355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 31/64] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:29.060225 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5da099-98a1-4f95-8c97-0a3219d58f9f None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.060757 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5da099-98a1-4f95-8c97-0a3219d58f9f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.061238 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5da099-98a1-4f95-8c97-0a3219d58f9f None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.062946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 32/65] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:29.066831 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af320041-17de-426c-a8a5-411d6b4091a3 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:29.069771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a28cc-8356-46f1-9ef8-aa7915c791c0 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.070285 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a28cc-8356-46f1-9ef8-aa7915c791c0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.070769 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a28cc-8356-46f1-9ef8-aa7915c791c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.089215 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-412a28cc-8356-46f1-9ef8-aa7915c791c0 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:29.090731 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-412a28cc-8356-46f1-9ef8-aa7915c791c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:29.103781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0f9d7-0795-4587-80fd-6e70541080b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:29.104634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0f9d7-0795-4587-80fd-6e70541080b6 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.105193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0f9d7-0795-4587-80fd-6e70541080b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.105482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0f9d7-0795-4587-80fd-6e70541080b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.119236 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0f9d7-0795-4587-80fd-6e70541080b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:29.128919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-26b0f9d7-0795-4587-80fd-6e70541080b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:29.128919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:29.128919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:29.128919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:29.128919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:29.128919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:29.128919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:29.128919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:29.128919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:29.128919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:29.128919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:29.128919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:29.128919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:29.128919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:29.128919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:29.128919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:29.129898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:29.129898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:29.129898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:29.129898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:29.129898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:29.129898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:29.129898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:29.129898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:29.129898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:29.129898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:29.129898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:29.129898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:29.129898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:29.129898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:29.129898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:29.129898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:29.130685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:29.130685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:29.130685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:29.130685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:29.130685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:29.130685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:29.130685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:29.130685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:29.130685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:29.130685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:29.130685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:29.130685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:29.133225 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 34/66] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:29.134511 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da701ec6-ed6a-41ef-9db5-f9e69b398e1c None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.134802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da701ec6-ed6a-41ef-9db5-f9e69b398e1c None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.135082 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da701ec6-ed6a-41ef-9db5-f9e69b398e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.152334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-da701ec6-ed6a-41ef-9db5-f9e69b398e1c None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:29.153573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-da701ec6-ed6a-41ef-9db5-f9e69b398e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:29.171534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 33/67] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:29.180459 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a28cc-8356-46f1-9ef8-aa7915c791c0 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:29.180603 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:29.229308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 35/68] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:29.230934 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da701ec6-ed6a-41ef-9db5-f9e69b398e1c None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:29.303106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:29.337184 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a28cc-8356-46f1-9ef8-aa7915c791c0 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:29.367038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da701ec6-ed6a-41ef-9db5-f9e69b398e1c None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:29.372382 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9cbbb-9a04-42a4-9f93-b192dfeb9680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:29.373099 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9cbbb-9a04-42a4-9f93-b192dfeb9680 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.373390 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9cbbb-9a04-42a4-9f93-b192dfeb9680 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.373674 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9cbbb-9a04-42a4-9f93-b192dfeb9680 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.374441 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9cbbb-9a04-42a4-9f93-b192dfeb9680 None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:29.374758 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9cbbb-9a04-42a4-9f93-b192dfeb9680 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:29.376169 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9cbbb-9a04-42a4-9f93-b192dfeb9680 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:29.388842 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 34/69] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:29.389888 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9cbbb-9a04-42a4-9f93-b192dfeb9680 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:29.409034 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d47c9c-06f1-40f4-9500-35fd1d842de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:29.409855 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d47c9c-06f1-40f4-9500-35fd1d842de3 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.410179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d47c9c-06f1-40f4-9500-35fd1d842de3 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.410431 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d47c9c-06f1-40f4-9500-35fd1d842de3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.421416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d47c9c-06f1-40f4-9500-35fd1d842de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:29.429136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-13d47c9c-06f1-40f4-9500-35fd1d842de3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:29.429136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:29.429136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:29.429136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:29.429136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:29.429136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:29.429136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:29.429136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:29.429136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:29.429136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:29.429136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:29.429136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:29.429136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:29.429136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:29.429136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:29.429136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:29.429990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:29.429990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:29.429990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:29.429990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:29.429990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:29.429990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:29.429990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:29.429990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:29.429990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:29.429990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:29.429990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:29.429990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:29.429990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:29.429990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:29.429990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:29.429990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:29.430776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:29.430776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:29.430776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:29.430776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:29.430776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:29.430776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:29.430776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:29.430776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:29.430776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:29.430776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:29.430776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:29.430776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:29.430776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 36/70] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:36:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:29.431784 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249c42d-9f8f-4807-afbd-3bf37bf0ab08 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.432232 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249c42d-9f8f-4807-afbd-3bf37bf0ab08 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.432550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249c42d-9f8f-4807-afbd-3bf37bf0ab08 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.434535 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 37/71] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:29.435148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249c42d-9f8f-4807-afbd-3bf37bf0ab08 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:29.465053 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:29.513698 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9cbbb-9a04-42a4-9f93-b192dfeb9680 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:29.543275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:29.547992 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8334f-18f7-40c3-b6fd-bb2e6b83e490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:29.548839 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8334f-18f7-40c3-b6fd-bb2e6b83e490 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.549183 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8334f-18f7-40c3-b6fd-bb2e6b83e490 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.549468 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8334f-18f7-40c3-b6fd-bb2e6b83e490 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.553776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249c42d-9f8f-4807-afbd-3bf37bf0ab08 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:29.561240 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8334f-18f7-40c3-b6fd-bb2e6b83e490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:29.570251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-c2a8334f-18f7-40c3-b6fd-bb2e6b83e490 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:29.570251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:29.570251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:29.570251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:29.570251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:29.570251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:29.570251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:29.570251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:29.570251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:29.570251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:29.570251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:29.570251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:29.570251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:29.570251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:29.570251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:29.570251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:29.571101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:29.571101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:29.571101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:29.571101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:29.571101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:29.571101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:29.571101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:29.571101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:29.571101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:29.571101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:29.571101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:29.571101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:29.571101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:29.571101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:29.571101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:29.571101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:29.571911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:29.571911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:29.571911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:29.571911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:29.571911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:29.571911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:29.571911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:29.571911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:29.571911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:29.571911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:29.571911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:29.571911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:36:29.571911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 35/72] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:36:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:29.572731 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8334f-18f7-40c3-b6fd-bb2e6b83e490 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:29.590507 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69892f-5176-43c2-a7c2-59626adacf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:29.591340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69892f-5176-43c2-a7c2-59626adacf5d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.591628 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69892f-5176-43c2-a7c2-59626adacf5d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.591905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69892f-5176-43c2-a7c2-59626adacf5d None admin] PATH_INFO: `/v3/users/59620a79bdb14f1e91544e1d0944daf9` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.605362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69892f-5176-43c2-a7c2-59626adacf5d None admin] RBAC: Authorizing `identity:get_user(user_id=59620a79bdb14f1e91544e1d0944daf9)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:29.606875 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69892f-5176-43c2-a7c2-59626adacf5d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:29.608535 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 38/73] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:29 2022] GET /identity/v3/users/59620a79bdb14f1e91544e1d0944daf9 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:29.609691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96078dde-6824-42a6-88f2-a92324245dce None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.609984 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96078dde-6824-42a6-88f2-a92324245dce None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.610265 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96078dde-6824-42a6-88f2-a92324245dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.625532 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-96078dde-6824-42a6-88f2-a92324245dce None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:29.626718 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-96078dde-6824-42a6-88f2-a92324245dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:29.675676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8334f-18f7-40c3-b6fd-bb2e6b83e490 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:29.700974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 39/74] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:29.700974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43028d-01d4-4d6e-bf13-8d451da5e0a3 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.700974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43028d-01d4-4d6e-bf13-8d451da5e0a3 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.700974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43028d-01d4-4d6e-bf13-8d451da5e0a3 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.700974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 40/75] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:29.700974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43028d-01d4-4d6e-bf13-8d451da5e0a3 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:29.708783 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:29.715791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b4b6c-694f-43c6-98b6-b81239f41b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:29.716673 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b4b6c-694f-43c6-98b6-b81239f41b6c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.716923 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b4b6c-694f-43c6-98b6-b81239f41b6c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.722597 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b4b6c-694f-43c6-98b6-b81239f41b6c None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.722597 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b4b6c-694f-43c6-98b6-b81239f41b6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:29.722597 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b4b6c-694f-43c6-98b6-b81239f41b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:29.722597 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b4b6c-694f-43c6-98b6-b81239f41b6c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:29.728255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 36/76] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:29.729079 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b4b6c-694f-43c6-98b6-b81239f41b6c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:29.791851 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:29.800107 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43028d-01d4-4d6e-bf13-8d451da5e0a3 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:29.833790 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b0bbf-f493-46ae-8aef-f5e994654e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:29.834461 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b0bbf-f493-46ae-8aef-f5e994654e00 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.834703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b4b6c-694f-43c6-98b6-b81239f41b6c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:29.834820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b0bbf-f493-46ae-8aef-f5e994654e00 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.835012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b0bbf-f493-46ae-8aef-f5e994654e00 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.835836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b0bbf-f493-46ae-8aef-f5e994654e00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:29.836149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b0bbf-f493-46ae-8aef-f5e994654e00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:29.837580 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b0bbf-f493-46ae-8aef-f5e994654e00 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:29.845571 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 41/77] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:36:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:29.848009 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744def3-4e90-4950-9ddc-469401dc9719 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.848312 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744def3-4e90-4950-9ddc-469401dc9719 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.848640 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744def3-4e90-4950-9ddc-469401dc9719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.864569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-8744def3-4e90-4950-9ddc-469401dc9719 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:29.865754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-8744def3-4e90-4950-9ddc-469401dc9719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:29.868945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7928d56-8cca-46ef-af12-205b4f6b7929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:29.869607 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928d56-8cca-46ef-af12-205b4f6b7929 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.869896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928d56-8cca-46ef-af12-205b4f6b7929 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.870176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7928d56-8cca-46ef-af12-205b4f6b7929 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.926661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:29.931664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 42/78] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:29.932674 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744def3-4e90-4950-9ddc-469401dc9719 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:29.940741 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7928d56-8cca-46ef-af12-205b4f6b7929 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:29.942400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7928d56-8cca-46ef-af12-205b4f6b7929 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:29.996906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:30.032404 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744def3-4e90-4950-9ddc-469401dc9719 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:30.041329 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 37/79] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:30.042526 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7928d56-8cca-46ef-af12-205b4f6b7929 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:30.066732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5ce9b-c960-49a6-9cdb-873f8ad1e9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:30.067535 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5ce9b-c960-49a6-9cdb-873f8ad1e9a2 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:30.067831 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5ce9b-c960-49a6-9cdb-873f8ad1e9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:30.068111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5ce9b-c960-49a6-9cdb-873f8ad1e9a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:30.069304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5ce9b-c960-49a6-9cdb-873f8ad1e9a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:30.070746 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5ce9b-c960-49a6-9cdb-873f8ad1e9a2 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:30.072352 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 43/80] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:30.073135 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5ce9b-c960-49a6-9cdb-873f8ad1e9a2 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:30.138671 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:30.168393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7928d56-8cca-46ef-af12-205b4f6b7929 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:30.177726 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5ce9b-c960-49a6-9cdb-873f8ad1e9a2 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:30.201429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe3a86-5899-4efd-987b-dcfc93ffc3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:30.202298 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe3a86-5899-4efd-987b-dcfc93ffc3c9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:30.202582 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe3a86-5899-4efd-987b-dcfc93ffc3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:30.202860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe3a86-5899-4efd-987b-dcfc93ffc3c9 None admin] PATH_INFO: `/v3/users/69ed26b6c8d84d67907abcc6c154b3a7` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:30.204261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe3a86-5899-4efd-987b-dcfc93ffc3c9 None admin] RBAC: Authorizing `identity:get_user(user_id=69ed26b6c8d84d67907abcc6c154b3a7)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:30.205791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe3a86-5899-4efd-987b-dcfc93ffc3c9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:30.207426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 38/81] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:30 2022] GET /identity/v3/users/69ed26b6c8d84d67907abcc6c154b3a7 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:30.208205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe3a86-5899-4efd-987b-dcfc93ffc3c9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:30.211852 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aa98a-cc38-4852-9ee7-36a508952874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:30.212810 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aa98a-cc38-4852-9ee7-36a508952874 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:30.213102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aa98a-cc38-4852-9ee7-36a508952874 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:30.213383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aa98a-cc38-4852-9ee7-36a508952874 None admin] PATH_INFO: `/v3/users/59620a79bdb14f1e91544e1d0944daf9` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:30.214594 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aa98a-cc38-4852-9ee7-36a508952874 None admin] RBAC: Authorizing `identity:get_user(user_id=59620a79bdb14f1e91544e1d0944daf9)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:30.216667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aa98a-cc38-4852-9ee7-36a508952874 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:30.218322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 44/82] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:30 2022] GET /identity/v3/users/59620a79bdb14f1e91544e1d0944daf9 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:30.219185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aa98a-cc38-4852-9ee7-36a508952874 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:30.232451 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:30.307846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe3a86-5899-4efd-987b-dcfc93ffc3c9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:30.319946 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aa98a-cc38-4852-9ee7-36a508952874 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:30.341275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896312b3-af0a-451e-bb8f-0e931ee12589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:30.342073 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896312b3-af0a-451e-bb8f-0e931ee12589 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:30.342359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896312b3-af0a-451e-bb8f-0e931ee12589 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:30.342634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896312b3-af0a-451e-bb8f-0e931ee12589 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:30.352514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896312b3-af0a-451e-bb8f-0e931ee12589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:30.352997 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f701fd-24b2-45c4-a137-62317d833fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:30.353858 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f701fd-24b2-45c4-a137-62317d833fc8 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:30.354145 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f701fd-24b2-45c4-a137-62317d833fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:30.354424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f701fd-24b2-45c4-a137-62317d833fc8 None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:30.355911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f701fd-24b2-45c4-a137-62317d833fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=ef31df6af6414934be49044ddb61049d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:30.357413 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f701fd-24b2-45c4-a137-62317d833fc8 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:30.359100 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 45/83] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:30 2022] GET /identity/v3/projects/ef31df6af6414934be49044ddb61049d => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:30.359836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f701fd-24b2-45c4-a137-62317d833fc8 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:30.360608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-896312b3-af0a-451e-bb8f-0e931ee12589 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:30.360608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:30.360608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:30.360608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:30.360608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:30.360608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:30.360608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:30.360608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:30.360608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:30.360608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:30.360608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:30.360608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:30.360608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:30.360608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:30.360608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:30.360608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:30.361506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:30.361506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:30.361506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:30.361506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:30.361506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:30.361506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:30.361506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:30.361506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:30.361506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:30.361506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:30.361506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:30.361506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:30.361506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:30.361506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:30.361506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:30.361506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:30.362578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:30.362578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:30.362578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:30.362578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:30.362578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:30.362578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:30.362578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:30.362578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:30.362578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:30.362578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:30.362578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:30.362578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:36:30.362578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 39/84] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:30.362578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896312b3-af0a-451e-bb8f-0e931ee12589 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:30.369940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:30.451197 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:30.469790 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896312b3-af0a-451e-bb8f-0e931ee12589 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:30.474759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f701fd-24b2-45c4-a137-62317d833fc8 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:30.503490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3bba0-556e-4b76-82b4-2dda7721a1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:30.504140 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3bba0-556e-4b76-82b4-2dda7721a1bc None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:30.504422 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3bba0-556e-4b76-82b4-2dda7721a1bc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:30.504728 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3bba0-556e-4b76-82b4-2dda7721a1bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:30.507789 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc880e8-6ad7-450e-b843-33cd759326cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:30.508490 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc880e8-6ad7-450e-b843-33cd759326cb None admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:30.508784 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc880e8-6ad7-450e-b843-33cd759326cb None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:30.509067 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc880e8-6ad7-450e-b843-33cd759326cb None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:30.509794 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc880e8-6ad7-450e-b843-33cd759326cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:30.511254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc880e8-6ad7-450e-b843-33cd759326cb None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:30.569294 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3bba0-556e-4b76-82b4-2dda7721a1bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:30.570759 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3bba0-556e-4b76-82b4-2dda7721a1bc None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:30.648149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:30.652767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 46/85] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Jun 16 18:36:30 2022] POST /identity/v3/users => generated 289 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:36:30.653604 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc880e8-6ad7-450e-b843-33cd759326cb None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:30.666985 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 40/86] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:30.667875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3bba0-556e-4b76-82b4-2dda7721a1bc None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:30.735875 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:30.784415 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc880e8-6ad7-450e-b843-33cd759326cb None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:30.786943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3bba0-556e-4b76-82b4-2dda7721a1bc None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:30.825156 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703049f8-6dd8-4c8c-a4ee-5fcbae703fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:30.825830 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703049f8-6dd8-4c8c-a4ee-5fcbae703fa7 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:30.826121 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703049f8-6dd8-4c8c-a4ee-5fcbae703fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:30.826405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703049f8-6dd8-4c8c-a4ee-5fcbae703fa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:30.829774 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff97d6-5ecf-4ef7-bca3-3fd4b3e29c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:30.830445 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff97d6-5ecf-4ef7-bca3-3fd4b3e29c6c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:30.830737 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff97d6-5ecf-4ef7-bca3-3fd4b3e29c6c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:30.831021 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff97d6-5ecf-4ef7-bca3-3fd4b3e29c6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:30.831880 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff97d6-5ecf-4ef7-bca3-3fd4b3e29c6c None admin] RBAC: Adding query filter params (role.id=34f07ea559bb44a6b3d81c7c1ff19bbc, scope.project.id=ef31df6af6414934be49044ddb61049d, user.id=59620a79bdb14f1e91544e1d0944daf9) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:30.832200 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff97d6-5ecf-4ef7-bca3-3fd4b3e29c6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:30.833716 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff97d6-5ecf-4ef7-bca3-3fd4b3e29c6c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:30.840405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 41/87] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:30 2022] GET /identity/v3/role_assignments?user.id=59620a79bdb14f1e91544e1d0944daf9&scope.project.id=ef31df6af6414934be49044ddb61049d&role.id=34f07ea559bb44a6b3d81c7c1ff19bbc => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:30.841079 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff97d6-5ecf-4ef7-bca3-3fd4b3e29c6c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:30.904395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:30.926611 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703049f8-6dd8-4c8c-a4ee-5fcbae703fa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:30.928569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703049f8-6dd8-4c8c-a4ee-5fcbae703fa7 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:30.974069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff97d6-5ecf-4ef7-bca3-3fd4b3e29c6c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:30.995438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:31.020032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c59135-7934-42d6-9acb-efa1ea0e4323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:31.020762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c59135-7934-42d6-9acb-efa1ea0e4323 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:31.021057 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c59135-7934-42d6-9acb-efa1ea0e4323 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:31.021340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c59135-7934-42d6-9acb-efa1ea0e4323 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:31.022128 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c59135-7934-42d6-9acb-efa1ea0e4323 None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:31.022418 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c59135-7934-42d6-9acb-efa1ea0e4323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:31.023821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c59135-7934-42d6-9acb-efa1ea0e4323 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:31.037035 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 42/88] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:31.037804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c59135-7934-42d6-9acb-efa1ea0e4323 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:31.055192 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 47/89] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:31.055885 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703049f8-6dd8-4c8c-a4ee-5fcbae703fa7 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:31.160870 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c59135-7934-42d6-9acb-efa1ea0e4323 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:31.171181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:31.194684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703049f8-6dd8-4c8c-a4ee-5fcbae703fa7 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:31.198144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f1530-97d5-44a2-b2d8-1d1dbe347909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:31.198598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f1530-97d5-44a2-b2d8-1d1dbe347909 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:31.199555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f1530-97d5-44a2-b2d8-1d1dbe347909 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:31.199985 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f1530-97d5-44a2-b2d8-1d1dbe347909 None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:31.201620 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f1530-97d5-44a2-b2d8-1d1dbe347909 None admin] RBAC: Authorizing `identity:get_project(project_id=ef31df6af6414934be49044ddb61049d)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:31.203196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f1530-97d5-44a2-b2d8-1d1dbe347909 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:31.205442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 43/90] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:31 2022] GET /identity/v3/projects/ef31df6af6414934be49044ddb61049d => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:31.206331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f1530-97d5-44a2-b2d8-1d1dbe347909 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:31.244178 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1bdd5-3b61-4504-8845-0a7771ce3a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:31.249048 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1bdd5-3b61-4504-8845-0a7771ce3a5f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:31.249340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1bdd5-3b61-4504-8845-0a7771ce3a5f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:31.249623 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1bdd5-3b61-4504-8845-0a7771ce3a5f None admin] PATH_INFO: `/v3/users/59620a79bdb14f1e91544e1d0944daf9` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:31.250930 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1bdd5-3b61-4504-8845-0a7771ce3a5f None admin] RBAC: Authorizing `identity:get_user(user_id=59620a79bdb14f1e91544e1d0944daf9)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:31.253289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1bdd5-3b61-4504-8845-0a7771ce3a5f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:31.255119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 48/91] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:31 2022] GET /identity/v3/users/59620a79bdb14f1e91544e1d0944daf9 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:31.255709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1bdd5-3b61-4504-8845-0a7771ce3a5f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:31.292777 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:31.325619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f1530-97d5-44a2-b2d8-1d1dbe347909 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:31.372157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1bdd5-3b61-4504-8845-0a7771ce3a5f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:31.386179 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db1099-37b4-4aa7-9919-95dec2a61a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:31.387610 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db1099-37b4-4aa7-9919-95dec2a61a17 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:31.387891 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db1099-37b4-4aa7-9919-95dec2a61a17 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:31.388171 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db1099-37b4-4aa7-9919-95dec2a61a17 None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:31.402503 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db1099-37b4-4aa7-9919-95dec2a61a17 None admin] RBAC: Authorizing `identity:get_project(project_id=ef31df6af6414934be49044ddb61049d)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:31.403995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db1099-37b4-4aa7-9919-95dec2a61a17 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:31.405810 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 44/92] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:31 2022] GET /identity/v3/projects/ef31df6af6414934be49044ddb61049d => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:31.406625 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db1099-37b4-4aa7-9919-95dec2a61a17 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:31.445725 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bb196-e23f-4ff9-af1b-77c1cee147e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:31.446401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bb196-e23f-4ff9-af1b-77c1cee147e7 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:31.446687 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bb196-e23f-4ff9-af1b-77c1cee147e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:31.446963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bb196-e23f-4ff9-af1b-77c1cee147e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:31.447809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bb196-e23f-4ff9-af1b-77c1cee147e7 None admin] RBAC: Adding query filter params (role.id=416a52031d5d49b6a3fa0e9baa814436, scope.project.id=ef31df6af6414934be49044ddb61049d, user.id=69ed26b6c8d84d67907abcc6c154b3a7) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:31.448124 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bb196-e23f-4ff9-af1b-77c1cee147e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:31.450188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bb196-e23f-4ff9-af1b-77c1cee147e7 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:31.456365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 49/93] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:31 2022] GET /identity/v3/role_assignments?user.id=69ed26b6c8d84d67907abcc6c154b3a7&scope.project.id=ef31df6af6414934be49044ddb61049d&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:31.461409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bb196-e23f-4ff9-af1b-77c1cee147e7 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:31.505546 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:31.611071 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bb196-e23f-4ff9-af1b-77c1cee147e7 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:31.613918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:31.621192 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db1099-37b4-4aa7-9919-95dec2a61a17 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:31.667270 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937b8ee-1e88-4eee-95ac-d0b29560ab00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:31.668781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937b8ee-1e88-4eee-95ac-d0b29560ab00 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:31.669069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937b8ee-1e88-4eee-95ac-d0b29560ab00 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:31.669350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937b8ee-1e88-4eee-95ac-d0b29560ab00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:31.670204 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937b8ee-1e88-4eee-95ac-d0b29560ab00 None admin] RBAC: Adding query filter params (role.id=cfd7c6febb2246d4a48765a0aa8563bf, scope.project.id=ef31df6af6414934be49044ddb61049d, user.id=59620a79bdb14f1e91544e1d0944daf9) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:31.670519 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937b8ee-1e88-4eee-95ac-d0b29560ab00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:31.671998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937b8ee-1e88-4eee-95ac-d0b29560ab00 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:31.690597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 50/94] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:31 2022] GET /identity/v3/role_assignments?user.id=59620a79bdb14f1e91544e1d0944daf9&scope.project.id=ef31df6af6414934be49044ddb61049d&role.id=cfd7c6febb2246d4a48765a0aa8563bf => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:31.708311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4cac0-f7c3-4c84-8c74-9743cf95a066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:31.709032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4cac0-f7c3-4c84-8c74-9743cf95a066 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:31.710280 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4cac0-f7c3-4c84-8c74-9743cf95a066 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:31.710280 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4cac0-f7c3-4c84-8c74-9743cf95a066 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:31.854702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4cac0-f7c3-4c84-8c74-9743cf95a066 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:31.857867 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4cac0-f7c3-4c84-8c74-9743cf95a066 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:31.952852 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:32.040466 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 45/95] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:32.050010 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937b8ee-1e88-4eee-95ac-d0b29560ab00 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:32.231890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937b8ee-1e88-4eee-95ac-d0b29560ab00 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:32.306509 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb915f-c429-42bd-8a18-f09828f77e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:32.307396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb915f-c429-42bd-8a18-f09828f77e43 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:32.307679 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb915f-c429-42bd-8a18-f09828f77e43 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:32.307956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb915f-c429-42bd-8a18-f09828f77e43 None admin] PATH_INFO: `/v3/projects/7c092babdfbe4b6bbddbafd3a38c187b` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:32.313337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb915f-c429-42bd-8a18-f09828f77e43 None admin] RBAC: Authorizing `identity:get_project(project_id=7c092babdfbe4b6bbddbafd3a38c187b)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:32.316017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb915f-c429-42bd-8a18-f09828f77e43 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:32.316602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 51/96] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:32 2022] GET /identity/v3/projects/7c092babdfbe4b6bbddbafd3a38c187b => generated 312 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:32.323032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4cac0-f7c3-4c84-8c74-9743cf95a066 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:32.469197 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4cac0-f7c3-4c84-8c74-9743cf95a066 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:32.514550 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c919c0e-58e1-4756-a4f8-5b4dcdc8557a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:32.515228 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c919c0e-58e1-4756-a4f8-5b4dcdc8557a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:32.515515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c919c0e-58e1-4756-a4f8-5b4dcdc8557a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:32.515793 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c919c0e-58e1-4756-a4f8-5b4dcdc8557a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:32.516670 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c919c0e-58e1-4756-a4f8-5b4dcdc8557a None admin] RBAC: Adding query filter params (role.id=34f07ea559bb44a6b3d81c7c1ff19bbc, scope.project.id=7c092babdfbe4b6bbddbafd3a38c187b, user.id=59620a79bdb14f1e91544e1d0944daf9) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:32.516987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c919c0e-58e1-4756-a4f8-5b4dcdc8557a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:32.518449 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c919c0e-58e1-4756-a4f8-5b4dcdc8557a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:32.528877 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 46/97] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:32 2022] GET /identity/v3/role_assignments?user.id=59620a79bdb14f1e91544e1d0944daf9&scope.project.id=7c092babdfbe4b6bbddbafd3a38c187b&role.id=34f07ea559bb44a6b3d81c7c1ff19bbc => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:33.832956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e0b0d-b3dc-4f3c-959f-f59681c64b38 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:33.833949 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e0b0d-b3dc-4f3c-959f-f59681c64b38 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:33.834408 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e0b0d-b3dc-4f3c-959f-f59681c64b38 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:33.835996 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 52/98] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:33.841905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec6d93-e86c-4dfc-a323-7f80aac52bde None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:33.842797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec6d93-e86c-4dfc-a323-7f80aac52bde None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:33.843244 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec6d93-e86c-4dfc-a323-7f80aac52bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:33.865681 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bacc8-716b-4169-9905-8a9709cf085a None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:33.866233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bacc8-716b-4169-9905-8a9709cf085a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:33.866676 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bacc8-716b-4169-9905-8a9709cf085a None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:33.868592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 53/99] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:33.869780 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f4ec6d93-e86c-4dfc-a323-7f80aac52bde None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:33.871746 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f4ec6d93-e86c-4dfc-a323-7f80aac52bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:33.874135 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:33.884780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1254a-0d88-4c57-a9a0-7929a6fe2d2b None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:33.885075 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1254a-0d88-4c57-a9a0-7929a6fe2d2b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:33.885361 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1254a-0d88-4c57-a9a0-7929a6fe2d2b None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:33.886840 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 54/100] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:33.890007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345da612-7739-4e91-b4ec-a6744bb9a4d1 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:33.893045 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345da612-7739-4e91-b4ec-a6744bb9a4d1 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:33.893045 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345da612-7739-4e91-b4ec-a6744bb9a4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:33.920106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-345da612-7739-4e91-b4ec-a6744bb9a4d1 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:33.921322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-345da612-7739-4e91-b4ec-a6744bb9a4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:33.956784 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:33.990872 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 47/101] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:33.998245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed1b75-2580-41e6-8e44-54000cd77c22 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:33.998562 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed1b75-2580-41e6-8e44-54000cd77c22 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:33.998855 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed1b75-2580-41e6-8e44-54000cd77c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:34.030370 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-e9ed1b75-2580-41e6-8e44-54000cd77c22 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:34.031553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e9ed1b75-2580-41e6-8e44-54000cd77c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:34.061359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 55/102] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:34.062228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345da612-7739-4e91-b4ec-a6744bb9a4d1 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:34.125375 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 48/103] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:34.125951 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed1b75-2580-41e6-8e44-54000cd77c22 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:34.222473 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:34.255971 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345da612-7739-4e91-b4ec-a6744bb9a4d1 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:34.299965 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed1b75-2580-41e6-8e44-54000cd77c22 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:34.305557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427318b-bdf7-431b-8c37-c69f5dbd109f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:34.306575 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427318b-bdf7-431b-8c37-c69f5dbd109f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:34.307019 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427318b-bdf7-431b-8c37-c69f5dbd109f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:34.307442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427318b-bdf7-431b-8c37-c69f5dbd109f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:34.328863 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427318b-bdf7-431b-8c37-c69f5dbd109f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:34.341551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-e427318b-bdf7-431b-8c37-c69f5dbd109f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:34.341551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:34.341551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:34.341551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:34.341551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:34.341551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:34.341551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:34.341551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:34.341551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:34.341551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:34.341551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:34.341551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:34.341551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:34.341551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:34.341551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:34.341551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:34.342667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:34.342667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:34.342667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:34.342667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:34.342667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:34.342667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:34.342667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:34.342667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:34.342667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:34.342667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:34.342667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:34.342667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:34.342667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:34.342667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:34.342667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:34.342667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:34.343479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:34.343479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:34.343479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:34.343479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:34.343479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:34.343479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:34.343479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:34.343479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:34.343479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:34.343479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:34.343479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:34.343479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:34.344103 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 56/104] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:34.345340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427318b-bdf7-431b-8c37-c69f5dbd109f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:34.354668 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec083b-8f8e-47b8-b689-655e71f58e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:34.355751 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec083b-8f8e-47b8-b689-655e71f58e16 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:34.356229 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec083b-8f8e-47b8-b689-655e71f58e16 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:34.356723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec083b-8f8e-47b8-b689-655e71f58e16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:34.358291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec083b-8f8e-47b8-b689-655e71f58e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:34.359953 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec083b-8f8e-47b8-b689-655e71f58e16 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:34.361797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 49/105] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:34.362735 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec083b-8f8e-47b8-b689-655e71f58e16 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:34.400489 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:34.521780 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec083b-8f8e-47b8-b689-655e71f58e16 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:34.564105 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5024559-5118-49ce-a8ec-9c057c175801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:34.565061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5024559-5118-49ce-a8ec-9c057c175801 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:34.565590 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5024559-5118-49ce-a8ec-9c057c175801 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:34.566012 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5024559-5118-49ce-a8ec-9c057c175801 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:34.566920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5024559-5118-49ce-a8ec-9c057c175801 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:34.567365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5024559-5118-49ce-a8ec-9c057c175801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:34.568936 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5024559-5118-49ce-a8ec-9c057c175801 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:34.574738 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:34.577988 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 50/106] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:34.579767 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5024559-5118-49ce-a8ec-9c057c175801 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:34.618600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427318b-bdf7-431b-8c37-c69f5dbd109f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:34.685627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5024559-5118-49ce-a8ec-9c057c175801 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:34.720392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8688e-5d83-495e-b44d-0f1ee6e2c645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:34.721441 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8688e-5d83-495e-b44d-0f1ee6e2c645 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:34.721917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8688e-5d83-495e-b44d-0f1ee6e2c645 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:34.722427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8688e-5d83-495e-b44d-0f1ee6e2c645 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:34.723338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8688e-5d83-495e-b44d-0f1ee6e2c645 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:34.725024 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8688e-5d83-495e-b44d-0f1ee6e2c645 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:34.725139 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31be89-4326-418b-b0ee-939356378186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:34.725943 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31be89-4326-418b-b0ee-939356378186 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:34.726231 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31be89-4326-418b-b0ee-939356378186 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:34.726509 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31be89-4326-418b-b0ee-939356378186 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:34.750744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31be89-4326-418b-b0ee-939356378186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:34.759250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-ff31be89-4326-418b-b0ee-939356378186 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:34.759250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:34.759250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:34.759250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:34.759250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:34.759250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:34.759250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:34.759250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:34.759250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:34.759250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:34.759250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:34.759250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:34.759250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:34.759250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:34.759250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:34.759250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:34.760094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:34.760094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:34.760094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:34.760094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:34.760094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:34.760094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:34.760094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:34.760094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:34.760094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:34.760094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:34.760094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:34.760094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:34.760094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:34.760094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:34.760094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:34.760094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:34.761001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:34.761001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:34.761001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:34.761001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:34.761001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:34.761001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:34.761001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:34.761001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:34.761001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:34.761001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:34.761001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:34.761001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:34.763164 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 57/107] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:34.764092 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31be89-4326-418b-b0ee-939356378186 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:34.842804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 51/108] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Jun 16 18:36:34 2022] POST /identity/v3/projects => generated 302 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:36:34.844305 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8688e-5d83-495e-b44d-0f1ee6e2c645 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:34.860987 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:34.942676 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31be89-4326-418b-b0ee-939356378186 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:34.968090 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:35.034267 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ee3ad-1058-4de6-8b61-75ac1cbb1f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:35.035464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ee3ad-1058-4de6-8b61-75ac1cbb1f74 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:35.035935 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ee3ad-1058-4de6-8b61-75ac1cbb1f74 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:35.036353 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ee3ad-1058-4de6-8b61-75ac1cbb1f74 None admin] PATH_INFO: `/v3/users/70ec64e2215c42beb09dc8e6f7576c6a` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:35.070159 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ee3ad-1058-4de6-8b61-75ac1cbb1f74 None admin] RBAC: Authorizing `identity:get_user(user_id=70ec64e2215c42beb09dc8e6f7576c6a)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:35.071981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ee3ad-1058-4de6-8b61-75ac1cbb1f74 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:35.074065 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 58/109] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:34 2022] GET /identity/v3/users/70ec64e2215c42beb09dc8e6f7576c6a => generated 289 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:35.078799 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8688e-5d83-495e-b44d-0f1ee6e2c645 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:35.080253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ee3ad-1058-4de6-8b61-75ac1cbb1f74 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:35.165822 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68aad5a-1033-4c58-873a-4deb1008bdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:35.167398 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68aad5a-1033-4c58-873a-4deb1008bdb4 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:35.168132 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68aad5a-1033-4c58-873a-4deb1008bdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:35.168394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68aad5a-1033-4c58-873a-4deb1008bdb4 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:35.169591 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68aad5a-1033-4c58-873a-4deb1008bdb4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:35.169913 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68aad5a-1033-4c58-873a-4deb1008bdb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:35.172115 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68aad5a-1033-4c58-873a-4deb1008bdb4 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:35.183561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 52/110] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:35.185208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d3c44-845b-42c5-b1e4-e45cba954de3 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:35.185671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d3c44-845b-42c5-b1e4-e45cba954de3 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:35.185961 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d3c44-845b-42c5-b1e4-e45cba954de3 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:35.187579 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 53/111] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:35.188871 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7fbf2-5d6a-4a95-97bb-ca2d246dc3fc None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:35.189164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7fbf2-5d6a-4a95-97bb-ca2d246dc3fc None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:35.189452 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7fbf2-5d6a-4a95-97bb-ca2d246dc3fc None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:35.190824 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 54/112] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:35.191368 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7fbf2-5d6a-4a95-97bb-ca2d246dc3fc None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:35.239521 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ee3ad-1058-4de6-8b61-75ac1cbb1f74 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:35.283075 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:35.295495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124905fc-6318-41d2-8c30-03adca7298e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:35.296502 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124905fc-6318-41d2-8c30-03adca7298e2 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:35.297574 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124905fc-6318-41d2-8c30-03adca7298e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:35.297574 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124905fc-6318-41d2-8c30-03adca7298e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:35.331963 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7fbf2-5d6a-4a95-97bb-ca2d246dc3fc None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:35.346482 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:35.367880 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c6fe9-ffb3-40f9-aa8c-7962b17e4d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:35.368795 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c6fe9-ffb3-40f9-aa8c-7962b17e4d77 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:35.369151 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c6fe9-ffb3-40f9-aa8c-7962b17e4d77 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:35.369442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c6fe9-ffb3-40f9-aa8c-7962b17e4d77 None admin] PATH_INFO: `/v3/users/59620a79bdb14f1e91544e1d0944daf9` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:35.370680 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c6fe9-ffb3-40f9-aa8c-7962b17e4d77 None admin] RBAC: Authorizing `identity:get_user(user_id=59620a79bdb14f1e91544e1d0944daf9)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:35.372161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c6fe9-ffb3-40f9-aa8c-7962b17e4d77 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:35.373333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124905fc-6318-41d2-8c30-03adca7298e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:35.378467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 55/113] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:35 2022] GET /identity/v3/users/59620a79bdb14f1e91544e1d0944daf9 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:35.378597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124905fc-6318-41d2-8c30-03adca7298e2 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:35.378670 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe6abb-181b-4812-9bd7-d9fc8a330935 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:35.378670 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe6abb-181b-4812-9bd7-d9fc8a330935 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:35.378670 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe6abb-181b-4812-9bd7-d9fc8a330935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:35.393101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-90fe6abb-181b-4812-9bd7-d9fc8a330935 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:35.394305 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-90fe6abb-181b-4812-9bd7-d9fc8a330935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:35.463017 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 56/114] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:35.465331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84f6e3-a3ea-407c-9d4f-12d1bd38a699 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:35.465331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84f6e3-a3ea-407c-9d4f-12d1bd38a699 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:35.465331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84f6e3-a3ea-407c-9d4f-12d1bd38a699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:35.485113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 59/115] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 18:36:35.487068 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633acfc-c937-4dfd-a01a-4ba9a28f59e3 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:35.487564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633acfc-c937-4dfd-a01a-4ba9a28f59e3 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:35.488078 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633acfc-c937-4dfd-a01a-4ba9a28f59e3 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:35.489708 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 60/116] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:35.490241 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-2a84f6e3-a3ea-407c-9d4f-12d1bd38a699 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:35.490822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633acfc-c937-4dfd-a01a-4ba9a28f59e3 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:35.491528 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2a84f6e3-a3ea-407c-9d4f-12d1bd38a699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:35.524646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:35.569407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 57/117] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:35.569407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84f6e3-a3ea-407c-9d4f-12d1bd38a699 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:35.615559 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:35.620657 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633acfc-c937-4dfd-a01a-4ba9a28f59e3 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:35.656674 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c5d5a-0511-458f-82b4-e4875bb51e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:35.657550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c5d5a-0511-458f-82b4-e4875bb51e6f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:35.657850 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c5d5a-0511-458f-82b4-e4875bb51e6f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:35.658128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c5d5a-0511-458f-82b4-e4875bb51e6f None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:35.659327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c5d5a-0511-458f-82b4-e4875bb51e6f None admin] RBAC: Authorizing `identity:get_project(project_id=ef31df6af6414934be49044ddb61049d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:35.660859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c5d5a-0511-458f-82b4-e4875bb51e6f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:35.662571 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 61/118] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:35 2022] GET /identity/v3/projects/ef31df6af6414934be49044ddb61049d => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:35.663339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c5d5a-0511-458f-82b4-e4875bb51e6f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:35.700280 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84f6e3-a3ea-407c-9d4f-12d1bd38a699 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:35.737027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585654e-0b1a-4b5f-a4ed-cb4247db1a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:35.737834 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585654e-0b1a-4b5f-a4ed-cb4247db1a40 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:35.738133 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585654e-0b1a-4b5f-a4ed-cb4247db1a40 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:35.738409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585654e-0b1a-4b5f-a4ed-cb4247db1a40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:35.749348 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585654e-0b1a-4b5f-a4ed-cb4247db1a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:35.757071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-0585654e-0b1a-4b5f-a4ed-cb4247db1a40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:35.757071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:35.757071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:35.757071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:35.757071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:35.757071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:35.757071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:35.757071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:35.757071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:35.757071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:35.757071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:35.757071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:35.757071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:35.757071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:35.757071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:35.757071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:35.758147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:35.758147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:35.758147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:35.758147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:35.758147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:35.758147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:35.758147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:35.758147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:35.758147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:35.758147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:35.758147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:35.758147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:35.758147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:35.758147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:35.758147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:35.758147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:35.759048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:35.759048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:35.759048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:35.759048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:35.759048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:35.759048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:35.759048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:35.759048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:35.759048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:35.759048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:35.759048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:35.759048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:36:35.759640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 58/119] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:36:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:35.761977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cbbbf-3a34-451c-907e-389c4ea6ff01 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:35.762963 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cbbbf-3a34-451c-907e-389c4ea6ff01 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:35.763452 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cbbbf-3a34-451c-907e-389c4ea6ff01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:35.778930 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:35.782782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-566cbbbf-3a34-451c-907e-389c4ea6ff01 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:35.782900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c5d5a-0511-458f-82b4-e4875bb51e6f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:35.783996 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-566cbbbf-3a34-451c-907e-389c4ea6ff01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:35.817932 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b004d1-533e-4e98-ba7a-be527942fa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:35.819102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b004d1-533e-4e98-ba7a-be527942fa48 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:35.819568 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b004d1-533e-4e98-ba7a-be527942fa48 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:35.820058 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b004d1-533e-4e98-ba7a-be527942fa48 None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:35.821451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b004d1-533e-4e98-ba7a-be527942fa48 None admin] RBAC: Authorizing `identity:get_project(project_id=ef31df6af6414934be49044ddb61049d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:35.822953 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b004d1-533e-4e98-ba7a-be527942fa48 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:35.829562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 62/120] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:35 2022] GET /identity/v3/projects/ef31df6af6414934be49044ddb61049d => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:35.829562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b004d1-533e-4e98-ba7a-be527942fa48 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:35.862342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 59/121] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:35.863806 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cbbbf-3a34-451c-907e-389c4ea6ff01 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:35.905509 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:35.946993 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b004d1-533e-4e98-ba7a-be527942fa48 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:35.983981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc707789-ab65-4444-ab02-d3f1e3f47aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:35.984826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc707789-ab65-4444-ab02-d3f1e3f47aff None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:35.985113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc707789-ab65-4444-ab02-d3f1e3f47aff None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:35.985390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc707789-ab65-4444-ab02-d3f1e3f47aff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:35.986361 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cbbbf-3a34-451c-907e-389c4ea6ff01 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:35.995766 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc707789-ab65-4444-ab02-d3f1e3f47aff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:36.003905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-dc707789-ab65-4444-ab02-d3f1e3f47aff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:36.003905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:36.003905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:36.003905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:36.003905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:36.003905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:36.003905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:36.003905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:36.003905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:36.003905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:36.003905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:36.003905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:36.003905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:36.003905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:36.003905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:36.003905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:36.004782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:36.004782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:36.004782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:36.004782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:36.004782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:36.004782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:36.004782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:36.004782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:36.004782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:36.004782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:36.004782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:36.004782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:36.004782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:36.004782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:36.004782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:36.004782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:36.005592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:36.005592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:36.005592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:36.005592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:36.005592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:36.005592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:36.005592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:36.005592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:36.005592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:36.005592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:36.005592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:36.005592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:36.005592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 63/122] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:36:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:36.006226 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc707789-ab65-4444-ab02-d3f1e3f47aff None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:36.024687 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf82068-bc7a-4efd-a5f9-b3c26365582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:36.025594 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf82068-bc7a-4efd-a5f9-b3c26365582b None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:36.025884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf82068-bc7a-4efd-a5f9-b3c26365582b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:36.026700 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf82068-bc7a-4efd-a5f9-b3c26365582b None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d/users/59620a79bdb14f1e91544e1d0944daf9/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:36.028735 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf82068-bc7a-4efd-a5f9-b3c26365582b None admin] RBAC: Authorizing `identity:create_grant(project_id=ef31df6af6414934be49044ddb61049d, user_id=59620a79bdb14f1e91544e1d0944daf9, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:36.030208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf82068-bc7a-4efd-a5f9-b3c26365582b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:36.035300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:36.103431 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 60/123] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:36:35 2022] PUT /identity/v3/projects/ef31df6af6414934be49044ddb61049d/users/59620a79bdb14f1e91544e1d0944daf9/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:36:36.104877 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf82068-bc7a-4efd-a5f9-b3c26365582b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:36.115459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc707789-ab65-4444-ab02-d3f1e3f47aff None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:36.167563 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b851ae8-697c-436e-8ff2-e2c7cc6cd8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:36.168646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b851ae8-697c-436e-8ff2-e2c7cc6cd8e1 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:36.169993 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b851ae8-697c-436e-8ff2-e2c7cc6cd8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:36.170455 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b851ae8-697c-436e-8ff2-e2c7cc6cd8e1 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:36.171771 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b851ae8-697c-436e-8ff2-e2c7cc6cd8e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:36.172266 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b851ae8-697c-436e-8ff2-e2c7cc6cd8e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:36.174834 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b851ae8-697c-436e-8ff2-e2c7cc6cd8e1 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:36.188014 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 64/124] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:36.189170 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b851ae8-697c-436e-8ff2-e2c7cc6cd8e1 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:36.221398 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:36.232473 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf82068-bc7a-4efd-a5f9-b3c26365582b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:36.282737 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6862a-844d-4788-815c-681a9a3a6bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:36.283773 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6862a-844d-4788-815c-681a9a3a6bf9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:36.284382 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6862a-844d-4788-815c-681a9a3a6bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:36.285823 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6862a-844d-4788-815c-681a9a3a6bf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:36.287128 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6862a-844d-4788-815c-681a9a3a6bf9 None admin] RBAC: Adding query filter params (role.id=1a958ec71abb4047bc9427c58b382a2c, scope.project.id=ef31df6af6414934be49044ddb61049d, user.id=70ec64e2215c42beb09dc8e6f7576c6a) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:36.287458 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6862a-844d-4788-815c-681a9a3a6bf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:36.289153 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6862a-844d-4788-815c-681a9a3a6bf9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:36.296786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 61/125] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:36 2022] GET /identity/v3/role_assignments?user.id=70ec64e2215c42beb09dc8e6f7576c6a&scope.project.id=ef31df6af6414934be49044ddb61049d&role.id=1a958ec71abb4047bc9427c58b382a2c => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:36.297636 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6862a-844d-4788-815c-681a9a3a6bf9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:36.326233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:36.346896 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b851ae8-697c-436e-8ff2-e2c7cc6cd8e1 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:36.395634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4b432-34fc-46c0-8849-3ec4264cf0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:36.398827 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4b432-34fc-46c0-8849-3ec4264cf0b0 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:36.399330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4b432-34fc-46c0-8849-3ec4264cf0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:36.401846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4b432-34fc-46c0-8849-3ec4264cf0b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:36.416647 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4b432-34fc-46c0-8849-3ec4264cf0b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:36.426251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-c7d4b432-34fc-46c0-8849-3ec4264cf0b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:36.426251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:36.426251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:36.426251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:36.426251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:36.426251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:36.426251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:36.426251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:36.426251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:36.426251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:36.426251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:36.426251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:36.426251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:36.426251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:36.426251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:36.426251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:36.427252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:36.427252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:36.427252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:36.427252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:36.427252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:36.427252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:36.427252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:36.427252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:36.427252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:36.427252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:36.427252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:36.427252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:36.427252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:36.427252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:36.427252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:36.427252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:36.428044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:36.428044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:36.428044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:36.428044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:36.428044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:36.428044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:36.428044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:36.428044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:36.428044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:36.428044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:36.428044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:36.428044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:36.436874 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 65/126] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:36.436874 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4b432-34fc-46c0-8849-3ec4264cf0b0 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:36.504594 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6862a-844d-4788-815c-681a9a3a6bf9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:36.542658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a5f21-7cd7-4bc2-b41a-e14771201fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:36.543263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a5f21-7cd7-4bc2-b41a-e14771201fd5 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:36.543554 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a5f21-7cd7-4bc2-b41a-e14771201fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:36.543837 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a5f21-7cd7-4bc2-b41a-e14771201fd5 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:36.544640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a5f21-7cd7-4bc2-b41a-e14771201fd5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:36.545011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a5f21-7cd7-4bc2-b41a-e14771201fd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:36.546483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a5f21-7cd7-4bc2-b41a-e14771201fd5 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:36.555067 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 62/127] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:36:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:36.555865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a5f21-7cd7-4bc2-b41a-e14771201fd5 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:36.564426 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4b432-34fc-46c0-8849-3ec4264cf0b0 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:36.579485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:36.608458 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1339c9-5b76-4481-b421-7a1cb838ec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:36.608458 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1339c9-5b76-4481-b421-7a1cb838ec0f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:36.608458 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1339c9-5b76-4481-b421-7a1cb838ec0f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:36.608458 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1339c9-5b76-4481-b421-7a1cb838ec0f None admin] PATH_INFO: `/v3/users/69ed26b6c8d84d67907abcc6c154b3a7` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:36.608861 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1339c9-5b76-4481-b421-7a1cb838ec0f None admin] RBAC: Authorizing `identity:get_user(user_id=69ed26b6c8d84d67907abcc6c154b3a7)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:36.608861 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1339c9-5b76-4481-b421-7a1cb838ec0f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:36.610274 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 66/128] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:36 2022] GET /identity/v3/users/69ed26b6c8d84d67907abcc6c154b3a7 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:36.611420 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1339c9-5b76-4481-b421-7a1cb838ec0f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:36.632464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:36.723045 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a5f21-7cd7-4bc2-b41a-e14771201fd5 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:36.769077 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65347d4e-76c9-4de4-aef8-1db2f2d55fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:36.770587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65347d4e-76c9-4de4-aef8-1db2f2d55fb6 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:36.772740 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65347d4e-76c9-4de4-aef8-1db2f2d55fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:36.773296 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65347d4e-76c9-4de4-aef8-1db2f2d55fb6 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:36.775113 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65347d4e-76c9-4de4-aef8-1db2f2d55fb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:36.775710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65347d4e-76c9-4de4-aef8-1db2f2d55fb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:36.778346 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65347d4e-76c9-4de4-aef8-1db2f2d55fb6 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:36.798987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 63/129] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:36.800285 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65347d4e-76c9-4de4-aef8-1db2f2d55fb6 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:36.816722 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1339c9-5b76-4481-b421-7a1cb838ec0f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:36.870875 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cde626-fd28-44a8-9f06-3bc408c08537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:36.873322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cde626-fd28-44a8-9f06-3bc408c08537 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:36.874967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cde626-fd28-44a8-9f06-3bc408c08537 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:36.875469 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cde626-fd28-44a8-9f06-3bc408c08537 None admin] PATH_INFO: `/v3/users/59620a79bdb14f1e91544e1d0944daf9` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:36.878014 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cde626-fd28-44a8-9f06-3bc408c08537 None admin] RBAC: Authorizing `identity:get_user(user_id=59620a79bdb14f1e91544e1d0944daf9)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:36.880816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cde626-fd28-44a8-9f06-3bc408c08537 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:36.884773 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 67/130] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:36 2022] GET /identity/v3/users/59620a79bdb14f1e91544e1d0944daf9 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:36.887562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cde626-fd28-44a8-9f06-3bc408c08537 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:36.971619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:36.997186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65347d4e-76c9-4de4-aef8-1db2f2d55fb6 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:37.052806 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf86ef5-4947-4296-aa18-23d43fef97bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:37.054457 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf86ef5-4947-4296-aa18-23d43fef97bb None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.056862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf86ef5-4947-4296-aa18-23d43fef97bb None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.057413 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf86ef5-4947-4296-aa18-23d43fef97bb None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:37.059726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf86ef5-4947-4296-aa18-23d43fef97bb None admin] RBAC: Authorizing `identity:get_project(project_id=ef31df6af6414934be49044ddb61049d)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:37.064312 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf86ef5-4947-4296-aa18-23d43fef97bb None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:37.066385 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 64/131] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:36 2022] GET /identity/v3/projects/ef31df6af6414934be49044ddb61049d => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:37.069775 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf86ef5-4947-4296-aa18-23d43fef97bb None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:37.091527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:37.111229 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cde626-fd28-44a8-9f06-3bc408c08537 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:37.158061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed589038-78d9-47f7-81bb-d006e791d6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:37.159315 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed589038-78d9-47f7-81bb-d006e791d6ad None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.159877 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed589038-78d9-47f7-81bb-d006e791d6ad None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.160361 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed589038-78d9-47f7-81bb-d006e791d6ad None admin] PATH_INFO: `/v3/users/59620a79bdb14f1e91544e1d0944daf9` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:37.161991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed589038-78d9-47f7-81bb-d006e791d6ad None admin] RBAC: Authorizing `identity:get_user(user_id=59620a79bdb14f1e91544e1d0944daf9)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:37.165913 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed589038-78d9-47f7-81bb-d006e791d6ad None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:37.170780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 68/132] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:36 2022] GET /identity/v3/users/59620a79bdb14f1e91544e1d0944daf9 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:37.173573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed589038-78d9-47f7-81bb-d006e791d6ad None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:37.282003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf86ef5-4947-4296-aa18-23d43fef97bb None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:37.328313 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed589038-78d9-47f7-81bb-d006e791d6ad None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:37.332107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b17ec-5724-4dbb-9071-362323fc9c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:37.338392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b17ec-5724-4dbb-9071-362323fc9c8d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.338392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b17ec-5724-4dbb-9071-362323fc9c8d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.338392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b17ec-5724-4dbb-9071-362323fc9c8d None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:37.338392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b17ec-5724-4dbb-9071-362323fc9c8d None admin] RBAC: Authorizing `identity:get_project(project_id=ef31df6af6414934be49044ddb61049d)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:37.338392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b17ec-5724-4dbb-9071-362323fc9c8d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:37.340240 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 65/133] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:37 2022] GET /identity/v3/projects/ef31df6af6414934be49044ddb61049d => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:37.341533 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b17ec-5724-4dbb-9071-362323fc9c8d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:37.363502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:37.366407 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3baece2-2e96-4240-a223-f1832439e8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:37.367302 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baece2-2e96-4240-a223-f1832439e8fd None admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.367711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baece2-2e96-4240-a223-f1832439e8fd None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.367997 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baece2-2e96-4240-a223-f1832439e8fd None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d/users/69ed26b6c8d84d67907abcc6c154b3a7/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:37.370856 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baece2-2e96-4240-a223-f1832439e8fd None admin] RBAC: Authorizing `identity:create_grant(project_id=ef31df6af6414934be49044ddb61049d, user_id=69ed26b6c8d84d67907abcc6c154b3a7, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:37.372763 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baece2-2e96-4240-a223-f1832439e8fd None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:37.456562 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b17ec-5724-4dbb-9071-362323fc9c8d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:37.483353 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 69/134] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:36:37 2022] PUT /identity/v3/projects/ef31df6af6414934be49044ddb61049d/users/69ed26b6c8d84d67907abcc6c154b3a7/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:36:37.485826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b7613-ae2c-49b2-b085-99319843597a None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.486405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b7613-ae2c-49b2-b085-99319843597a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.486968 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b7613-ae2c-49b2-b085-99319843597a None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:37.488727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 70/135] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:37.490002 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b7613-ae2c-49b2-b085-99319843597a None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:37.499306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a6c15-8fda-45b9-90a6-2ff04df627c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:37.500184 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a6c15-8fda-45b9-90a6-2ff04df627c1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.500496 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a6c15-8fda-45b9-90a6-2ff04df627c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.500785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a6c15-8fda-45b9-90a6-2ff04df627c1 None admin] PATH_INFO: `/v3/projects/7c092babdfbe4b6bbddbafd3a38c187b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:37.502395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a6c15-8fda-45b9-90a6-2ff04df627c1 None admin] RBAC: Authorizing `identity:get_project(project_id=7c092babdfbe4b6bbddbafd3a38c187b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:37.508911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:37.510014 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a6c15-8fda-45b9-90a6-2ff04df627c1 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:37.512762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 66/136] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:37 2022] GET /identity/v3/projects/7c092babdfbe4b6bbddbafd3a38c187b => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:37.514110 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4aeeb-a864-4897-9b31-6f94961fc79a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.514410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4aeeb-a864-4897-9b31-6f94961fc79a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.514699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4aeeb-a864-4897-9b31-6f94961fc79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:37.546047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-97d4aeeb-a864-4897-9b31-6f94961fc79a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:37.547255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-97d4aeeb-a864-4897-9b31-6f94961fc79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:37.632619 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b7613-ae2c-49b2-b085-99319843597a None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:37.675775 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edb8cf-1e39-4a42-949e-2c2509a4bc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:37.677111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edb8cf-1e39-4a42-949e-2c2509a4bc3d None admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.677595 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edb8cf-1e39-4a42-949e-2c2509a4bc3d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.678108 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edb8cf-1e39-4a42-949e-2c2509a4bc3d None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d/users/59620a79bdb14f1e91544e1d0944daf9/roles/cfd7c6febb2246d4a48765a0aa8563bf` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:37.680815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edb8cf-1e39-4a42-949e-2c2509a4bc3d None admin] RBAC: Authorizing `identity:create_grant(project_id=ef31df6af6414934be49044ddb61049d, user_id=59620a79bdb14f1e91544e1d0944daf9, role_id=cfd7c6febb2246d4a48765a0aa8563bf)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:37.682799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edb8cf-1e39-4a42-949e-2c2509a4bc3d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:37.702778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 67/137] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:37.704067 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4aeeb-a864-4897-9b31-6f94961fc79a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:37.724750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:37.763571 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 71/138] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:36:37 2022] PUT /identity/v3/projects/ef31df6af6414934be49044ddb61049d/users/59620a79bdb14f1e91544e1d0944daf9/roles/cfd7c6febb2246d4a48765a0aa8563bf => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:36:37.765167 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edb8cf-1e39-4a42-949e-2c2509a4bc3d None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:37.840243 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4aeeb-a864-4897-9b31-6f94961fc79a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:37.884068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bb069-5e60-483b-b45d-c676a903cf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:37.885453 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bb069-5e60-483b-b45d-c676a903cf72 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.886272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bb069-5e60-483b-b45d-c676a903cf72 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.886886 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bb069-5e60-483b-b45d-c676a903cf72 None admin] PATH_INFO: `/v3/projects/7c092babdfbe4b6bbddbafd3a38c187b/users/59620a79bdb14f1e91544e1d0944daf9/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:37.889626 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bb069-5e60-483b-b45d-c676a903cf72 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c092babdfbe4b6bbddbafd3a38c187b, user_id=59620a79bdb14f1e91544e1d0944daf9, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:37.889899 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:37.892668 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bb069-5e60-483b-b45d-c676a903cf72 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:37.930772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edb8cf-1e39-4a42-949e-2c2509a4bc3d None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:37.979636 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 68/139] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:36:37 2022] PUT /identity/v3/projects/7c092babdfbe4b6bbddbafd3a38c187b/users/59620a79bdb14f1e91544e1d0944daf9/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:36:37.989888 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86004673-2126-4047-9061-cc7a921e5a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:37.990813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86004673-2126-4047-9061-cc7a921e5a8f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.991109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86004673-2126-4047-9061-cc7a921e5a8f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.991393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86004673-2126-4047-9061-cc7a921e5a8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:37.992754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86004673-2126-4047-9061-cc7a921e5a8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:37.994307 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86004673-2126-4047-9061-cc7a921e5a8f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:37.996859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 72/140] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:38.002769 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bb069-5e60-483b-b45d-c676a903cf72 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:38.109359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:38.143918 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bb069-5e60-483b-b45d-c676a903cf72 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:38.187079 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32eeb94-6901-4f67-95ca-461ba84f8661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:38.187989 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eeb94-6901-4f67-95ca-461ba84f8661 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:38.188744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eeb94-6901-4f67-95ca-461ba84f8661 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:38.189075 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eeb94-6901-4f67-95ca-461ba84f8661 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:38.189906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32eeb94-6901-4f67-95ca-461ba84f8661 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:38.191468 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32eeb94-6901-4f67-95ca-461ba84f8661 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:38.304427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 69/141] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Jun 16 18:36:38 2022] POST /identity/v3/users => generated 283 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:36:38.758961 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485f183-f197-423f-8df0-a8bdd8946891 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:38.759467 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485f183-f197-423f-8df0-a8bdd8946891 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:38.759538 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485f183-f197-423f-8df0-a8bdd8946891 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:38.761807 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 73/142] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:38.767294 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f3989-07f5-49ed-81d2-f536d63646d0 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:38.767633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f3989-07f5-49ed-81d2-f536d63646d0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:38.767966 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f3989-07f5-49ed-81d2-f536d63646d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:38.789815 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-fd3f3989-07f5-49ed-81d2-f536d63646d0 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:38.791065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fd3f3989-07f5-49ed-81d2-f536d63646d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:38.874442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 70/143] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:38.899129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485f183-f197-423f-8df0-a8bdd8946891 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:39.026102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485f183-f197-423f-8df0-a8bdd8946891 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:39.068839 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014cc65-5740-4dd1-9e8d-cab3d165aa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:39.069668 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014cc65-5740-4dd1-9e8d-cab3d165aa9f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:39.069974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014cc65-5740-4dd1-9e8d-cab3d165aa9f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:39.070259 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014cc65-5740-4dd1-9e8d-cab3d165aa9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:39.087948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014cc65-5740-4dd1-9e8d-cab3d165aa9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:39.093879 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:39.099318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-5014cc65-5740-4dd1-9e8d-cab3d165aa9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:39.099318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:39.099318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:39.099318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:39.099318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:39.099318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:39.099318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:39.099318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:39.099318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:39.099318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:39.099318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:39.099318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:39.099318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:39.099318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:39.099318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:39.099318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:39.100186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:39.100186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:39.100186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:39.100186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:39.100186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:39.100186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:39.100186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:39.100186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:39.100186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:39.100186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:39.100186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:39.100186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:39.100186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:39.100186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:39.100186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:39.100186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:39.100991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:39.100991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:39.100991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:39.100991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:39.100991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:39.100991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:39.100991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:39.100991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:39.100991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:39.100991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:39.100991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:39.100991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:39.100991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 74/144] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:39.106769 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f3989-07f5-49ed-81d2-f536d63646d0 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:39.130991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ffeee-b9f4-450d-9145-003dc1621b29 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:39.131306 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ffeee-b9f4-450d-9145-003dc1621b29 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:39.131561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ffeee-b9f4-450d-9145-003dc1621b29 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:39.133279 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 75/145] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:39.151387 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da606a-1a55-4413-9c24-9b8addb21e17 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:39.151696 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da606a-1a55-4413-9c24-9b8addb21e17 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:39.151958 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da606a-1a55-4413-9c24-9b8addb21e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:39.185527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-d1da606a-1a55-4413-9c24-9b8addb21e17 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:39.186749 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-d1da606a-1a55-4413-9c24-9b8addb21e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:39.218579 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:39.265588 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f3989-07f5-49ed-81d2-f536d63646d0 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:39.292117 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 76/146] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:39.320528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da606a-1a55-4413-9c24-9b8addb21e17 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:39.324154 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3305a8-ca97-474e-8c0b-e40c75e0d62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:39.326129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3305a8-ca97-474e-8c0b-e40c75e0d62a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:39.326568 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3305a8-ca97-474e-8c0b-e40c75e0d62a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:39.327016 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3305a8-ca97-474e-8c0b-e40c75e0d62a None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:39.329613 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3305a8-ca97-474e-8c0b-e40c75e0d62a None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:39.330296 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3305a8-ca97-474e-8c0b-e40c75e0d62a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:39.332579 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3305a8-ca97-474e-8c0b-e40c75e0d62a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:39.357137 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 71/147] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:39.365475 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3305a8-ca97-474e-8c0b-e40c75e0d62a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:39.470121 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da606a-1a55-4413-9c24-9b8addb21e17 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:39.505301 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:39.509059 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bfcf9-ccdf-4af7-91e2-e2b59b0ec157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:39.510112 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bfcf9-ccdf-4af7-91e2-e2b59b0ec157 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:39.510628 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bfcf9-ccdf-4af7-91e2-e2b59b0ec157 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:39.511113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bfcf9-ccdf-4af7-91e2-e2b59b0ec157 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:39.525919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bfcf9-ccdf-4af7-91e2-e2b59b0ec157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:39.532234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3305a8-ca97-474e-8c0b-e40c75e0d62a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:39.538516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-a99bfcf9-ccdf-4af7-91e2-e2b59b0ec157 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:39.538516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:39.538516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:39.538516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:39.538516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:39.538516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:39.538516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:39.538516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:39.538516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:39.538516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:39.538516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:39.538516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:39.538516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:39.538516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:39.538516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:39.538516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:39.539385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:39.539385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:39.539385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:39.539385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:39.539385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:39.539385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:39.539385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:39.539385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:39.539385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:39.539385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:39.539385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:39.539385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:39.539385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:39.539385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:39.539385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:39.539385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:39.540142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:39.540142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:39.540142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:39.540142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:39.540142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:39.540142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:39.540142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:39.540142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:39.540142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:39.540142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:39.540142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:39.540142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:39.554135 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 77/148] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:39.565696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:39.568146 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bfcf9-ccdf-4af7-91e2-e2b59b0ec157 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:39.609665 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d424687-f2f1-4fa6-bd5e-f7b121eb0243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:39.610896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d424687-f2f1-4fa6-bd5e-f7b121eb0243 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:39.611378 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d424687-f2f1-4fa6-bd5e-f7b121eb0243 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:39.611884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d424687-f2f1-4fa6-bd5e-f7b121eb0243 None admin] PATH_INFO: `/v3/users/59620a79bdb14f1e91544e1d0944daf9` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:39.614708 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d424687-f2f1-4fa6-bd5e-f7b121eb0243 None admin] RBAC: Authorizing `identity:get_user(user_id=59620a79bdb14f1e91544e1d0944daf9)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:39.617540 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d424687-f2f1-4fa6-bd5e-f7b121eb0243 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:39.619609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 72/149] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:39 2022] GET /identity/v3/users/59620a79bdb14f1e91544e1d0944daf9 => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:39.626676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d424687-f2f1-4fa6-bd5e-f7b121eb0243 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:39.755098 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bfcf9-ccdf-4af7-91e2-e2b59b0ec157 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:39.765877 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d424687-f2f1-4fa6-bd5e-f7b121eb0243 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:39.806417 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b111d4a-772a-4e96-850b-474623951693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:39.807083 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b111d4a-772a-4e96-850b-474623951693 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:39.807359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b111d4a-772a-4e96-850b-474623951693 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:39.807636 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b111d4a-772a-4e96-850b-474623951693 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:39.808402 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b111d4a-772a-4e96-850b-474623951693 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:39.808738 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b111d4a-772a-4e96-850b-474623951693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:39.810146 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b111d4a-772a-4e96-850b-474623951693 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:39.825125 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 78/150] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:39.829855 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3be4b-a402-4177-b269-3cdce3f761ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:39.830583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3be4b-a402-4177-b269-3cdce3f761ca None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:39.830875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3be4b-a402-4177-b269-3cdce3f761ca None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:39.831158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3be4b-a402-4177-b269-3cdce3f761ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:39.832653 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b111d4a-772a-4e96-850b-474623951693 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:39.930067 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:39.936396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:39.950045 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3be4b-a402-4177-b269-3cdce3f761ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:39.952153 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3be4b-a402-4177-b269-3cdce3f761ca None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:39.994107 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b111d4a-772a-4e96-850b-474623951693 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:40.031788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537a8f9-d2ba-4423-8317-5f03ef018751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:40.032825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537a8f9-d2ba-4423-8317-5f03ef018751 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:40.033119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537a8f9-d2ba-4423-8317-5f03ef018751 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:40.033398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537a8f9-d2ba-4423-8317-5f03ef018751 None admin] PATH_INFO: `/v3/users/70ec64e2215c42beb09dc8e6f7576c6a` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:40.034655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537a8f9-d2ba-4423-8317-5f03ef018751 None admin] RBAC: Authorizing `identity:get_user(user_id=70ec64e2215c42beb09dc8e6f7576c6a)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:40.036134 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537a8f9-d2ba-4423-8317-5f03ef018751 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:40.038250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 79/151] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:39 2022] GET /identity/v3/users/70ec64e2215c42beb09dc8e6f7576c6a => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:40.044219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537a8f9-d2ba-4423-8317-5f03ef018751 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:40.155340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 73/152] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:40.160788 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3be4b-a402-4177-b269-3cdce3f761ca None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:40.200010 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537a8f9-d2ba-4423-8317-5f03ef018751 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:40.252867 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:40.257111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88bb5e2-e940-47c0-a49e-d714e449450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:40.258028 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bb5e2-e940-47c0-a49e-d714e449450f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:40.258318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bb5e2-e940-47c0-a49e-d714e449450f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:40.258601 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bb5e2-e940-47c0-a49e-d714e449450f None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:40.261337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88bb5e2-e940-47c0-a49e-d714e449450f None admin] RBAC: Authorizing `identity:get_project(project_id=ef31df6af6414934be49044ddb61049d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:40.262819 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88bb5e2-e940-47c0-a49e-d714e449450f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:40.277692 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 80/153] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:40 2022] GET /identity/v3/projects/ef31df6af6414934be49044ddb61049d => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:40.279922 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88bb5e2-e940-47c0-a49e-d714e449450f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:40.301459 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:40.314647 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3be4b-a402-4177-b269-3cdce3f761ca None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:40.381181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2be9b-a194-4ba2-94ec-209f692a2f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:40.382072 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2be9b-a194-4ba2-94ec-209f692a2f23 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:40.382362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2be9b-a194-4ba2-94ec-209f692a2f23 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:40.382641 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2be9b-a194-4ba2-94ec-209f692a2f23 None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:40.389242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2be9b-a194-4ba2-94ec-209f692a2f23 None admin] RBAC: Authorizing `identity:get_project(project_id=ef31df6af6414934be49044ddb61049d)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:40.390740 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2be9b-a194-4ba2-94ec-209f692a2f23 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:40.392762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 74/154] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:40 2022] GET /identity/v3/projects/ef31df6af6414934be49044ddb61049d => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:40.401386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2be9b-a194-4ba2-94ec-209f692a2f23 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:40.443441 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88bb5e2-e940-47c0-a49e-d714e449450f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:40.505273 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e610d04-0859-4c5d-a530-e01a6ae9ad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:40.506297 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e610d04-0859-4c5d-a530-e01a6ae9ad2d None admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:40.506589 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e610d04-0859-4c5d-a530-e01a6ae9ad2d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:40.506877 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e610d04-0859-4c5d-a530-e01a6ae9ad2d None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d/users/70ec64e2215c42beb09dc8e6f7576c6a/roles/1a958ec71abb4047bc9427c58b382a2c` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:40.513264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e610d04-0859-4c5d-a530-e01a6ae9ad2d None admin] RBAC: Authorizing `identity:create_grant(project_id=ef31df6af6414934be49044ddb61049d, user_id=70ec64e2215c42beb09dc8e6f7576c6a, role_id=1a958ec71abb4047bc9427c58b382a2c)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:40.514765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e610d04-0859-4c5d-a530-e01a6ae9ad2d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:40.586964 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 81/155] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:36:40 2022] PUT /identity/v3/projects/ef31df6af6414934be49044ddb61049d/users/70ec64e2215c42beb09dc8e6f7576c6a/roles/1a958ec71abb4047bc9427c58b382a2c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:36:40.609172 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2be9b-a194-4ba2-94ec-209f692a2f23 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:40.654445 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f726aa-7c85-487a-aa56-40970a57bc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:40.655139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f726aa-7c85-487a-aa56-40970a57bc81 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:40.655427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f726aa-7c85-487a-aa56-40970a57bc81 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:40.655706 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f726aa-7c85-487a-aa56-40970a57bc81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:40.656653 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f726aa-7c85-487a-aa56-40970a57bc81 None admin] RBAC: Adding query filter params (role.id=34f07ea559bb44a6b3d81c7c1ff19bbc, scope.project.id=ef31df6af6414934be49044ddb61049d, user.id=59620a79bdb14f1e91544e1d0944daf9) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:40.656970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f726aa-7c85-487a-aa56-40970a57bc81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:40.658461 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f726aa-7c85-487a-aa56-40970a57bc81 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:40.670366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 75/156] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:40 2022] GET /identity/v3/role_assignments?user.id=59620a79bdb14f1e91544e1d0944daf9&scope.project.id=ef31df6af6414934be49044ddb61049d&role.id=34f07ea559bb44a6b3d81c7c1ff19bbc => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:41.107323 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67582cc7-6c32-4e5f-880c-008461e184da None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:41.107884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67582cc7-6c32-4e5f-880c-008461e184da None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:41.107884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67582cc7-6c32-4e5f-880c-008461e184da None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:41.109350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 82/157] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:41.115257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968ed92-72aa-4567-997b-2cd0677c2a3f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:41.115541 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968ed92-72aa-4567-997b-2cd0677c2a3f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:41.115827 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968ed92-72aa-4567-997b-2cd0677c2a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:41.139348 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4968ed92-72aa-4567-997b-2cd0677c2a3f None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:41.140713 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4968ed92-72aa-4567-997b-2cd0677c2a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:41.157471 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:41.211861 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 76/158] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:41.237250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67582cc7-6c32-4e5f-880c-008461e184da None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:41.282856 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f6b31-68e6-4325-9dd1-2d98d4a35674 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:41.283149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f6b31-68e6-4325-9dd1-2d98d4a35674 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:41.283433 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f6b31-68e6-4325-9dd1-2d98d4a35674 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:41.284991 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 77/159] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:41.290104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ca2cc-8416-4360-b725-4bd1ee0ab246 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:41.290402 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ca2cc-8416-4360-b725-4bd1ee0ab246 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:41.291398 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ca2cc-8416-4360-b725-4bd1ee0ab246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:41.320892 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-444ca2cc-8416-4360-b725-4bd1ee0ab246 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:41.322629 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-444ca2cc-8416-4360-b725-4bd1ee0ab246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:41.339839 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:41.444508 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67582cc7-6c32-4e5f-880c-008461e184da None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:41.462252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 78/160] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:41.487828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38f4ba-6912-4067-8a07-909c0a7e1434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:41.488716 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38f4ba-6912-4067-8a07-909c0a7e1434 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:41.489005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38f4ba-6912-4067-8a07-909c0a7e1434 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:41.489289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38f4ba-6912-4067-8a07-909c0a7e1434 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:41.489897 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ca2cc-8416-4360-b725-4bd1ee0ab246 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:41.510063 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38f4ba-6912-4067-8a07-909c0a7e1434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:41.520492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-1d38f4ba-6912-4067-8a07-909c0a7e1434 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:41.520492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:41.520492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:41.520492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:41.520492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:41.520492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:41.520492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:41.520492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:41.520492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:41.520492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:41.520492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:41.520492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:41.520492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:41.520492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:41.520492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:41.520492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:41.521459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:41.521459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:41.521459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:41.521459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:41.521459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:41.521459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:41.521459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:41.521459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:41.521459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:41.521459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:41.521459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:41.521459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:41.521459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:41.521459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:41.521459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:41.521459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:41.522220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:41.522220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:41.522220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:41.522220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:41.522220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:41.522220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:41.522220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:41.522220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:41.522220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:41.522220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:41.522220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:41.522220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:41.522220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 83/161] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:36:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:41.529636 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38f4ba-6912-4067-8a07-909c0a7e1434 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:41.640792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:41.684320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38f4ba-6912-4067-8a07-909c0a7e1434 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:41.698738 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:41.698896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ca2cc-8416-4360-b725-4bd1ee0ab246 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:41.733000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e12d8-7040-4765-9945-9d1d28c86f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:41.733834 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e12d8-7040-4765-9945-9d1d28c86f86 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:41.734129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e12d8-7040-4765-9945-9d1d28c86f86 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:41.734406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e12d8-7040-4765-9945-9d1d28c86f86 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:41.735175 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e12d8-7040-4765-9945-9d1d28c86f86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:41.735486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e12d8-7040-4765-9945-9d1d28c86f86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:41.736958 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e12d8-7040-4765-9945-9d1d28c86f86 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:41.747985 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 84/162] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:41.753971 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e12d8-7040-4765-9945-9d1d28c86f86 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:41.779853 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae30b1-fc22-4b91-854e-96018b37f0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:41.780719 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae30b1-fc22-4b91-854e-96018b37f0a9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:41.781008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae30b1-fc22-4b91-854e-96018b37f0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:41.781291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae30b1-fc22-4b91-854e-96018b37f0a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:41.813407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae30b1-fc22-4b91-854e-96018b37f0a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:41.825889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-b2ae30b1-fc22-4b91-854e-96018b37f0a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:41.825889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:41.825889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:41.825889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:41.825889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:41.825889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:41.825889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:41.825889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:41.825889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:41.825889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:41.825889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:41.825889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:41.825889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:41.825889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:41.825889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:41.825889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:41.826826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:41.826826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:41.826826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:41.826826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:41.826826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:41.826826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:41.826826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:41.826826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:41.826826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:41.826826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:41.826826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:41.826826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:41.826826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:41.826826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:41.826826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:41.826826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:41.827587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:41.827587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:41.827587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:41.827587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:41.827587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:41.827587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:41.827587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:41.827587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:41.827587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:41.827587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:41.827587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:41.827587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:36:41.827587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 79/163] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:36:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:41.834433 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae30b1-fc22-4b91-854e-96018b37f0a9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:41.886445 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e12d8-7040-4765-9945-9d1d28c86f86 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:41.954819 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3dc57-56ea-4f65-9316-31b28d299469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:41.957418 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3dc57-56ea-4f65-9316-31b28d299469 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:41.957711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3dc57-56ea-4f65-9316-31b28d299469 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:41.957995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3dc57-56ea-4f65-9316-31b28d299469 None admin] PATH_INFO: `/v3/users/69ed26b6c8d84d67907abcc6c154b3a7` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:41.961493 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3dc57-56ea-4f65-9316-31b28d299469 None admin] RBAC: Authorizing `identity:get_user(user_id=69ed26b6c8d84d67907abcc6c154b3a7)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:41.963056 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3dc57-56ea-4f65-9316-31b28d299469 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:41.969342 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 85/164] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:41 2022] GET /identity/v3/users/69ed26b6c8d84d67907abcc6c154b3a7 => generated 247 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:41.998268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3dc57-56ea-4f65-9316-31b28d299469 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:42.034273 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae30b1-fc22-4b91-854e-96018b37f0a9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:42.073761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:42.106037 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e3dd6-892e-459a-b1c1-c792fb3c14bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:42.106736 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e3dd6-892e-459a-b1c1-c792fb3c14bf None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:42.107025 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e3dd6-892e-459a-b1c1-c792fb3c14bf None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:42.107309 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e3dd6-892e-459a-b1c1-c792fb3c14bf None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:42.108369 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e3dd6-892e-459a-b1c1-c792fb3c14bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:42.108712 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e3dd6-892e-459a-b1c1-c792fb3c14bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:42.110589 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e3dd6-892e-459a-b1c1-c792fb3c14bf None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:42.131481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 80/165] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:36:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:42.142599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e3dd6-892e-459a-b1c1-c792fb3c14bf None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:42.146228 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:42.191284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3dc57-56ea-4f65-9316-31b28d299469 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:42.273170 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeefec8-6176-40e5-a704-25e9055ba1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:42.274088 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeefec8-6176-40e5-a704-25e9055ba1b6 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:42.274417 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeefec8-6176-40e5-a704-25e9055ba1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:42.274725 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeefec8-6176-40e5-a704-25e9055ba1b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:42.338852 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e3dd6-892e-459a-b1c1-c792fb3c14bf None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:42.407540 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef548b51-8446-4f46-9a60-21885fdeec5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:42.408428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef548b51-8446-4f46-9a60-21885fdeec5f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:42.408778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef548b51-8446-4f46-9a60-21885fdeec5f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:42.409009 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef548b51-8446-4f46-9a60-21885fdeec5f None admin] PATH_INFO: `/v3/users/59620a79bdb14f1e91544e1d0944daf9` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:42.410274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef548b51-8446-4f46-9a60-21885fdeec5f None admin] RBAC: Authorizing `identity:get_user(user_id=59620a79bdb14f1e91544e1d0944daf9)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:42.411749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef548b51-8446-4f46-9a60-21885fdeec5f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:42.421812 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 81/166] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:42 2022] GET /identity/v3/users/59620a79bdb14f1e91544e1d0944daf9 => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:42.423065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bd578-765e-4273-89d2-b69d22df38bb None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:42.423392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bd578-765e-4273-89d2-b69d22df38bb None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:42.423624 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bd578-765e-4273-89d2-b69d22df38bb None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:42.425162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 82/167] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:42.427237 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeefec8-6176-40e5-a704-25e9055ba1b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:42.428739 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeefec8-6176-40e5-a704-25e9055ba1b6 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:42.431059 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ce258-b677-47e7-8cf6-3fcc746bfcbd None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:42.431354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ce258-b677-47e7-8cf6-3fcc746bfcbd None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:42.431638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ce258-b677-47e7-8cf6-3fcc746bfcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:42.457515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6a3ce258-b677-47e7-8cf6-3fcc746bfcbd None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:42.458729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6a3ce258-b677-47e7-8cf6-3fcc746bfcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:42.501480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:42.537765 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:42.545861 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 83/168] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:42.558988 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ce258-b677-47e7-8cf6-3fcc746bfcbd None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:42.605953 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 86/169] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 18:36:42.606820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeefec8-6176-40e5-a704-25e9055ba1b6 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:42.782631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ce258-b677-47e7-8cf6-3fcc746bfcbd None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:42.812425 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeefec8-6176-40e5-a704-25e9055ba1b6 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:42.862144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc74f69-161a-4d59-ac95-bbbd96ff0842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:42.862817 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc74f69-161a-4d59-ac95-bbbd96ff0842 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:42.863103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc74f69-161a-4d59-ac95-bbbd96ff0842 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:42.863384 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc74f69-161a-4d59-ac95-bbbd96ff0842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:42.891151 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe00b5d-ba54-498c-9171-e6cbfdb0d992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:42.892427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe00b5d-ba54-498c-9171-e6cbfdb0d992 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:42.892987 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe00b5d-ba54-498c-9171-e6cbfdb0d992 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:42.893467 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe00b5d-ba54-498c-9171-e6cbfdb0d992 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:42.906797 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:42.911920 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe00b5d-ba54-498c-9171-e6cbfdb0d992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:42.921210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-3fe00b5d-ba54-498c-9171-e6cbfdb0d992 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:42.921210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:42.921210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:42.921210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:42.921210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:42.921210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:42.921210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:42.921210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:42.921210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:42.921210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:42.921210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:42.921210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:42.921210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:42.921210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:42.921210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:42.921210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:42.922210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:42.922210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:42.922210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:42.922210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:42.922210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:42.922210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:42.922210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:42.922210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:42.922210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:42.922210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:42.922210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:42.922210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:42.922210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:42.922210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:42.922210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:42.922210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:42.923017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:42.923017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:42.923017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:42.923017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:42.923017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:42.923017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:42.923017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:42.923017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:42.923017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:42.923017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:42.923017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:42.923017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:42.925780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 87/170] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:42.926916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe00b5d-ba54-498c-9171-e6cbfdb0d992 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:43.037691 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:43.041352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc74f69-161a-4d59-ac95-bbbd96ff0842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:43.042157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc74f69-161a-4d59-ac95-bbbd96ff0842 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:43.109080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe00b5d-ba54-498c-9171-e6cbfdb0d992 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:43.171507 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bdf9c-e8c3-4ff5-821d-fdca96bd5343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:43.172860 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bdf9c-e8c3-4ff5-821d-fdca96bd5343 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:43.173396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bdf9c-e8c3-4ff5-821d-fdca96bd5343 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:43.173968 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bdf9c-e8c3-4ff5-821d-fdca96bd5343 None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:43.181709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9bdf9c-e8c3-4ff5-821d-fdca96bd5343 None admin] RBAC: Authorizing `identity:get_project(project_id=ef31df6af6414934be49044ddb61049d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:43.183593 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9bdf9c-e8c3-4ff5-821d-fdca96bd5343 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:43.185839 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 88/171] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:42 2022] GET /identity/v3/projects/ef31df6af6414934be49044ddb61049d => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:43.186893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bdf9c-e8c3-4ff5-821d-fdca96bd5343 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:43.258359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 84/172] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:43.263217 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc74f69-161a-4d59-ac95-bbbd96ff0842 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:43.319657 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:43.358370 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bdf9c-e8c3-4ff5-821d-fdca96bd5343 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:43.467925 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c926b5-128a-4cec-8237-c5abe0d9a4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:43.468563 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c926b5-128a-4cec-8237-c5abe0d9a4cd None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:43.468748 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:43.469179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c926b5-128a-4cec-8237-c5abe0d9a4cd None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:43.469179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c926b5-128a-4cec-8237-c5abe0d9a4cd None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:43.469865 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c926b5-128a-4cec-8237-c5abe0d9a4cd None admin] RBAC: Adding query filter params (name=member) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:43.470179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c926b5-128a-4cec-8237-c5abe0d9a4cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:43.471579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c926b5-128a-4cec-8237-c5abe0d9a4cd None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:43.471923 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc74f69-161a-4d59-ac95-bbbd96ff0842 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:43.481438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 89/173] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:43.485813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a502b-482f-4b7f-b014-b866c818d3ac None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:43.485813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a502b-482f-4b7f-b014-b866c818d3ac None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:43.485813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a502b-482f-4b7f-b014-b866c818d3ac None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:43.485813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 90/174] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:43.485813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a502b-482f-4b7f-b014-b866c818d3ac None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:43.517891 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c991cf-6308-4d7d-9563-effe36f7f9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:43.518988 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c991cf-6308-4d7d-9563-effe36f7f9c7 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:43.519278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c991cf-6308-4d7d-9563-effe36f7f9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:43.519560 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c991cf-6308-4d7d-9563-effe36f7f9c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:43.520694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c991cf-6308-4d7d-9563-effe36f7f9c7 None admin] RBAC: Adding query filter params (role.id=416a52031d5d49b6a3fa0e9baa814436, scope.project.id=ef31df6af6414934be49044ddb61049d, user.id=69ed26b6c8d84d67907abcc6c154b3a7) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:43.521014 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c991cf-6308-4d7d-9563-effe36f7f9c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:43.522460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c991cf-6308-4d7d-9563-effe36f7f9c7 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:43.530944 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 85/175] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:43 2022] GET /identity/v3/role_assignments?user.id=69ed26b6c8d84d67907abcc6c154b3a7&scope.project.id=ef31df6af6414934be49044ddb61049d&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:43.532363 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c0d8e-9622-4d23-a552-85d8f3369cf4 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:43.532680 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c0d8e-9622-4d23-a552-85d8f3369cf4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:43.533013 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c0d8e-9622-4d23-a552-85d8f3369cf4 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:43.534553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 86/176] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:43.535286 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c0d8e-9622-4d23-a552-85d8f3369cf4 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:43.670417 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a502b-482f-4b7f-b014-b866c818d3ac None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:43.701581 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:43.709884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59faf4d6-e8d7-4748-bcec-13585cb5b330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:43.710996 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faf4d6-e8d7-4748-bcec-13585cb5b330 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:43.711442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faf4d6-e8d7-4748-bcec-13585cb5b330 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:43.711726 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faf4d6-e8d7-4748-bcec-13585cb5b330 None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:43.714980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c0d8e-9622-4d23-a552-85d8f3369cf4 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:43.715081 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59faf4d6-e8d7-4748-bcec-13585cb5b330 None admin] RBAC: Authorizing `identity:get_project(project_id=ef31df6af6414934be49044ddb61049d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:43.715081 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59faf4d6-e8d7-4748-bcec-13585cb5b330 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:43.716938 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 91/177] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:43 2022] GET /identity/v3/projects/ef31df6af6414934be49044ddb61049d => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:43.717918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739e150-475e-4371-ac43-3770115648d9 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:43.718261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739e150-475e-4371-ac43-3770115648d9 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:43.718489 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739e150-475e-4371-ac43-3770115648d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:43.734999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-b739e150-475e-4371-ac43-3770115648d9 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:43.736398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b739e150-475e-4371-ac43-3770115648d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:43.752991 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f87311-9ccf-4af4-8d27-ca15a51fb798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:43.753890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f87311-9ccf-4af4-8d27-ca15a51fb798 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:43.754180 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f87311-9ccf-4af4-8d27-ca15a51fb798 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:43.754459 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f87311-9ccf-4af4-8d27-ca15a51fb798 None admin] PATH_INFO: `/v3/users/59620a79bdb14f1e91544e1d0944daf9` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:43.755688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f87311-9ccf-4af4-8d27-ca15a51fb798 None admin] RBAC: Authorizing `identity:get_user(user_id=59620a79bdb14f1e91544e1d0944daf9)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:43.757183 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f87311-9ccf-4af4-8d27-ca15a51fb798 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:43.759388 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 87/178] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:43 2022] GET /identity/v3/users/59620a79bdb14f1e91544e1d0944daf9 => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:43.760609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32c8e6-3203-4da3-8cdb-a0102df000dd None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:43.760899 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32c8e6-3203-4da3-8cdb-a0102df000dd None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:43.761181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32c8e6-3203-4da3-8cdb-a0102df000dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:43.783340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-3c32c8e6-3203-4da3-8cdb-a0102df000dd None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:43.784974 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3c32c8e6-3203-4da3-8cdb-a0102df000dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:43.822866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 92/179] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:43.826040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c83fc2-8652-41f1-b06a-30849f93f2a1 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:43.826338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c83fc2-8652-41f1-b06a-30849f93f2a1 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:43.826628 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c83fc2-8652-41f1-b06a-30849f93f2a1 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:43.828068 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 93/180] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:43.830967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:43.831959 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c83fc2-8652-41f1-b06a-30849f93f2a1 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:43.881233 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 88/181] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:43.888536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32c8e6-3203-4da3-8cdb-a0102df000dd None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:43.954924 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c83fc2-8652-41f1-b06a-30849f93f2a1 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:43.984730 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:43.995887 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686263c8-442d-4be6-bdca-fbd1648c2da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:43.996378 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32c8e6-3203-4da3-8cdb-a0102df000dd None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:43.996615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686263c8-442d-4be6-bdca-fbd1648c2da0 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:43.996975 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686263c8-442d-4be6-bdca-fbd1648c2da0 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:43.997324 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686263c8-442d-4be6-bdca-fbd1648c2da0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:43.998369 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686263c8-442d-4be6-bdca-fbd1648c2da0 None admin] RBAC: Adding query filter params (role.id=cfd7c6febb2246d4a48765a0aa8563bf, scope.project.id=ef31df6af6414934be49044ddb61049d, user.id=59620a79bdb14f1e91544e1d0944daf9) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:43.998709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686263c8-442d-4be6-bdca-fbd1648c2da0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:44.000396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686263c8-442d-4be6-bdca-fbd1648c2da0 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:44.016465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 94/182] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:43 2022] GET /identity/v3/role_assignments?user.id=59620a79bdb14f1e91544e1d0944daf9&scope.project.id=ef31df6af6414934be49044ddb61049d&role.id=cfd7c6febb2246d4a48765a0aa8563bf => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:44.016465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7345f-4f92-461e-b6dd-bc55530cf4e6 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.016465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7345f-4f92-461e-b6dd-bc55530cf4e6 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.016465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7345f-4f92-461e-b6dd-bc55530cf4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.045547 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-49d7345f-4f92-461e-b6dd-bc55530cf4e6 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:44.046782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-49d7345f-4f92-461e-b6dd-bc55530cf4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:44.054438 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493beee-faa9-48bb-a656-0b37ab6249e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:44.055232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493beee-faa9-48bb-a656-0b37ab6249e9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.056117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493beee-faa9-48bb-a656-0b37ab6249e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.056406 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493beee-faa9-48bb-a656-0b37ab6249e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.092455 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:44.122509 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 95/183] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:44.123721 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7345f-4f92-461e-b6dd-bc55530cf4e6 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:44.148679 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493beee-faa9-48bb-a656-0b37ab6249e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:44.150340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493beee-faa9-48bb-a656-0b37ab6249e9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:44.261765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7345f-4f92-461e-b6dd-bc55530cf4e6 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:44.266188 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 89/184] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:44.266438 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493beee-faa9-48bb-a656-0b37ab6249e9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:44.282984 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:44.297031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b190e6-f692-4130-960e-be53f305b896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:44.297840 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b190e6-f692-4130-960e-be53f305b896 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.301347 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b190e6-f692-4130-960e-be53f305b896 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.301347 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b190e6-f692-4130-960e-be53f305b896 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.312761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b190e6-f692-4130-960e-be53f305b896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:44.321263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-f6b190e6-f692-4130-960e-be53f305b896 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:44.321263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:44.321263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:44.321263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:44.321263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:44.321263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:44.321263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:44.321263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:44.321263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:44.321263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:44.321263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:44.321263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:44.321263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:44.321263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:44.321263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:44.321263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:44.328915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:44.328915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:44.328915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:44.328915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:44.328915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:44.328915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:44.328915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:44.328915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:44.328915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:44.328915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:44.328915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:44.328915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:44.328915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:44.328915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:44.328915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:44.328915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:44.329734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:44.329734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:44.329734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:44.329734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:44.329734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:44.329734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:44.329734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:44.329734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:44.329734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:44.329734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:44.329734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:44.329734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:44.329734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 96/185] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:36:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:44.329734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815f1ff-b7f8-41b4-a8ea-7a9fb1b0c1c6 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.330451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815f1ff-b7f8-41b4-a8ea-7a9fb1b0c1c6 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.330451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815f1ff-b7f8-41b4-a8ea-7a9fb1b0c1c6 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.330451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 97/186] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:44.330451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815f1ff-b7f8-41b4-a8ea-7a9fb1b0c1c6 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:44.333162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:44.371997 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493beee-faa9-48bb-a656-0b37ab6249e9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:44.405305 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac820e87-07f9-461f-8a03-ec0febbb0640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:44.406099 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac820e87-07f9-461f-8a03-ec0febbb0640 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.406386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac820e87-07f9-461f-8a03-ec0febbb0640 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.406665 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac820e87-07f9-461f-8a03-ec0febbb0640 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.407825 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac820e87-07f9-461f-8a03-ec0febbb0640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:44.409303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac820e87-07f9-461f-8a03-ec0febbb0640 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:44.410966 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 90/187] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:44.411723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac820e87-07f9-461f-8a03-ec0febbb0640 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:44.432826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815f1ff-b7f8-41b4-a8ea-7a9fb1b0c1c6 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:44.466239 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840aa467-0a5d-4bac-b57b-0005dd386415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:44.467055 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840aa467-0a5d-4bac-b57b-0005dd386415 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.467342 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840aa467-0a5d-4bac-b57b-0005dd386415 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.467624 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840aa467-0a5d-4bac-b57b-0005dd386415 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.478293 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840aa467-0a5d-4bac-b57b-0005dd386415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:44.486579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-840aa467-0a5d-4bac-b57b-0005dd386415 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:44.486579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:44.486579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:44.486579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:44.486579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:44.486579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:44.486579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:44.486579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:44.486579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:44.486579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:44.486579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:44.486579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:44.486579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:44.486579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:44.486579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:44.486579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:44.487613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:44.487613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:44.487613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:44.487613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:44.487613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:44.487613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:44.487613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:44.487613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:44.487613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:44.487613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:44.487613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:44.487613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:44.487613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:44.487613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:44.487613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:44.487613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:44.488545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:44.488545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:44.488545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:44.488545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:44.488545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:44.488545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:44.488545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:44.488545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:44.488545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:44.488545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:44.488545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:44.488545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:44.488545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 98/188] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:36:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:44.489453 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840aa467-0a5d-4bac-b57b-0005dd386415 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:44.516972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac820e87-07f9-461f-8a03-ec0febbb0640 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:44.530135 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:44.545165 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:44.550679 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0788ed-d0c4-4896-87c0-2a8a5ba984ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:44.551543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0788ed-d0c4-4896-87c0-2a8a5ba984ca None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.551830 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0788ed-d0c4-4896-87c0-2a8a5ba984ca None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.552145 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0788ed-d0c4-4896-87c0-2a8a5ba984ca None admin] PATH_INFO: `/v3/projects/7c092babdfbe4b6bbddbafd3a38c187b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.553357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0788ed-d0c4-4896-87c0-2a8a5ba984ca None admin] RBAC: Authorizing `identity:get_project(project_id=7c092babdfbe4b6bbddbafd3a38c187b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:44.554796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0788ed-d0c4-4896-87c0-2a8a5ba984ca None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:44.556545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 91/189] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:44 2022] GET /identity/v3/projects/7c092babdfbe4b6bbddbafd3a38c187b => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:44.557676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d173ce7-3222-49a2-8d26-82c328f537d3 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.557960 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d173ce7-3222-49a2-8d26-82c328f537d3 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.558241 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d173ce7-3222-49a2-8d26-82c328f537d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.575525 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5d173ce7-3222-49a2-8d26-82c328f537d3 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:44.578429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5d173ce7-3222-49a2-8d26-82c328f537d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:44.592823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840aa467-0a5d-4bac-b57b-0005dd386415 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:44.626173 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c0a87-46cd-453b-91ec-52fe88ff6ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:44.626842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c0a87-46cd-453b-91ec-52fe88ff6ec6 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.627122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c0a87-46cd-453b-91ec-52fe88ff6ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.627396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c0a87-46cd-453b-91ec-52fe88ff6ec6 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.628142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c0a87-46cd-453b-91ec-52fe88ff6ec6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:44.628470 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c0a87-46cd-453b-91ec-52fe88ff6ec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:44.629856 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c0a87-46cd-453b-91ec-52fe88ff6ec6 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:44.638303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 99/190] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:44.639063 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c0a87-46cd-453b-91ec-52fe88ff6ec6 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:44.655326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 92/191] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:44.661074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d173ce7-3222-49a2-8d26-82c328f537d3 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:44.743794 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c0a87-46cd-453b-91ec-52fe88ff6ec6 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:44.745437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:44.763994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d173ce7-3222-49a2-8d26-82c328f537d3 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:44.777611 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02daa775-18d0-44d9-aad5-a4c5566ba640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:44.778224 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daa775-18d0-44d9-aad5-a4c5566ba640 None admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.778506 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daa775-18d0-44d9-aad5-a4c5566ba640 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.778782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daa775-18d0-44d9-aad5-a4c5566ba640 None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.779494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02daa775-18d0-44d9-aad5-a4c5566ba640 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:44.780992 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02daa775-18d0-44d9-aad5-a4c5566ba640 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:44.789981 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:44.797410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2367de-40b7-4a32-975e-e6f7385109ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:44.798078 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2367de-40b7-4a32-975e-e6f7385109ed None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.798365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2367de-40b7-4a32-975e-e6f7385109ed None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.798643 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2367de-40b7-4a32-975e-e6f7385109ed None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.799394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2367de-40b7-4a32-975e-e6f7385109ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:44.799691 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2367de-40b7-4a32-975e-e6f7385109ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:44.801119 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2367de-40b7-4a32-975e-e6f7385109ed None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:44.809409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 93/192] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:36:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:44.810187 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2367de-40b7-4a32-975e-e6f7385109ed None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:44.872938 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 100/193] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Jun 16 18:36:44 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:36:44.873946 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02daa775-18d0-44d9-aad5-a4c5566ba640 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:44.920752 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2367de-40b7-4a32-975e-e6f7385109ed None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:44.959726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f0cf5-3888-4267-8b6f-bdc0dd390624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:44.960413 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f0cf5-3888-4267-8b6f-bdc0dd390624 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.960729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f0cf5-3888-4267-8b6f-bdc0dd390624 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.961008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f0cf5-3888-4267-8b6f-bdc0dd390624 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.961980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f0cf5-3888-4267-8b6f-bdc0dd390624 None admin] RBAC: Adding query filter params (role.id=34f07ea559bb44a6b3d81c7c1ff19bbc, scope.project.id=7c092babdfbe4b6bbddbafd3a38c187b, user.id=59620a79bdb14f1e91544e1d0944daf9) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:44.962302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f0cf5-3888-4267-8b6f-bdc0dd390624 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:44.963795 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f0cf5-3888-4267-8b6f-bdc0dd390624 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:44.971589 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 94/194] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:44 2022] GET /identity/v3/role_assignments?user.id=59620a79bdb14f1e91544e1d0944daf9&scope.project.id=7c092babdfbe4b6bbddbafd3a38c187b&role.id=34f07ea559bb44a6b3d81c7c1ff19bbc => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:44.971589 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f0cf5-3888-4267-8b6f-bdc0dd390624 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:45.005232 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02daa775-18d0-44d9-aad5-a4c5566ba640 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:45.047066 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32471a2f-6a6a-4ee0-b06d-5603fd505869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:45.047895 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32471a2f-6a6a-4ee0-b06d-5603fd505869 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:45.048514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32471a2f-6a6a-4ee0-b06d-5603fd505869 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:45.048514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32471a2f-6a6a-4ee0-b06d-5603fd505869 None admin] PATH_INFO: `/v3/users/4da9b5c624af4027a3f24e6f759d6d67` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:45.063266 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:45.066575 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32471a2f-6a6a-4ee0-b06d-5603fd505869 None admin] RBAC: Authorizing `identity:get_user(user_id=4da9b5c624af4027a3f24e6f759d6d67)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:45.068225 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32471a2f-6a6a-4ee0-b06d-5603fd505869 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:45.070181 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 101/195] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:44 2022] GET /identity/v3/users/4da9b5c624af4027a3f24e6f759d6d67 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:45.071154 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32471a2f-6a6a-4ee0-b06d-5603fd505869 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:45.092973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:45.134627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f0cf5-3888-4267-8b6f-bdc0dd390624 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:45.184967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2222a99-9211-496e-a3c4-babed061ef8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:45.185783 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2222a99-9211-496e-a3c4-babed061ef8c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:45.186067 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2222a99-9211-496e-a3c4-babed061ef8c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:45.186349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2222a99-9211-496e-a3c4-babed061ef8c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:45.204208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2222a99-9211-496e-a3c4-babed061ef8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:45.209116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32471a2f-6a6a-4ee0-b06d-5603fd505869 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:45.212166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-d2222a99-9211-496e-a3c4-babed061ef8c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:45.212166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:45.212166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:45.212166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:45.212166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:45.212166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:45.212166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:45.212166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:45.212166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:45.212166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:45.212166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:45.212166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:45.212166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:45.212166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:45.212166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:45.212166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:45.213107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:45.213107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:45.213107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:45.213107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:45.213107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:45.213107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:45.213107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:45.213107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:45.213107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:45.213107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:45.213107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:45.213107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:45.213107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:45.213107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:45.213107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:45.213107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:45.213921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:45.213921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:45.213921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:45.213921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:45.213921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:45.213921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:45.213921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:45.213921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:45.213921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:45.213921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:45.213921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:45.213921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:36:45.215369 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 95/196] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:45.221283 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2222a99-9211-496e-a3c4-babed061ef8c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:45.257613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8cc4ab-423d-4159-81d3-d1287d2247b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:45.258899 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cc4ab-423d-4159-81d3-d1287d2247b9 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:45.259387 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cc4ab-423d-4159-81d3-d1287d2247b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:45.259975 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cc4ab-423d-4159-81d3-d1287d2247b9 None admin] PATH_INFO: `/v3/users/4da9b5c624af4027a3f24e6f759d6d67` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:45.261611 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8cc4ab-423d-4159-81d3-d1287d2247b9 None admin] RBAC: Authorizing `identity:get_user(user_id=4da9b5c624af4027a3f24e6f759d6d67)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:45.263359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8cc4ab-423d-4159-81d3-d1287d2247b9 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:45.265312 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 102/197] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:45 2022] GET /identity/v3/users/4da9b5c624af4027a3f24e6f759d6d67 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:45.266272 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8cc4ab-423d-4159-81d3-d1287d2247b9 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:45.373339 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2222a99-9211-496e-a3c4-babed061ef8c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:45.416086 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:45.420353 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:45.436622 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cb6cf-98ec-4591-a7ef-f41d7329b807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:45.437291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cb6cf-98ec-4591-a7ef-f41d7329b807 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:45.437578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cb6cf-98ec-4591-a7ef-f41d7329b807 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:45.437858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cb6cf-98ec-4591-a7ef-f41d7329b807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:45.439000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8cc4ab-423d-4159-81d3-d1287d2247b9 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:45.479937 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963baa67-3691-46db-8f68-6850feaaab9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:45.481097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963baa67-3691-46db-8f68-6850feaaab9d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:45.481396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963baa67-3691-46db-8f68-6850feaaab9d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:45.481682 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963baa67-3691-46db-8f68-6850feaaab9d None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:45.482464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963baa67-3691-46db-8f68-6850feaaab9d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:45.482784 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963baa67-3691-46db-8f68-6850feaaab9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:45.484606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963baa67-3691-46db-8f68-6850feaaab9d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:45.495113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 103/198] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:45.496023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963baa67-3691-46db-8f68-6850feaaab9d None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:45.515692 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cb6cf-98ec-4591-a7ef-f41d7329b807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:45.518118 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cb6cf-98ec-4591-a7ef-f41d7329b807 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:45.615962 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963baa67-3691-46db-8f68-6850feaaab9d None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:45.643694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 96/199] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:45.644562 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cb6cf-98ec-4591-a7ef-f41d7329b807 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:45.652749 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8a872-a118-4429-864c-9284287964a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:45.653413 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8a872-a118-4429-864c-9284287964a3 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:45.653697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8a872-a118-4429-864c-9284287964a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:45.653975 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8a872-a118-4429-864c-9284287964a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:45.659704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:45.671366 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:45.749817 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8a872-a118-4429-864c-9284287964a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:45.751615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8a872-a118-4429-864c-9284287964a3 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:45.755720 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cb6cf-98ec-4591-a7ef-f41d7329b807 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:45.791610 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed4d33-ae23-43b0-b46e-6a938f1ca9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:45.792520 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed4d33-ae23-43b0-b46e-6a938f1ca9ce None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:45.792810 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed4d33-ae23-43b0-b46e-6a938f1ca9ce None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:45.793089 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed4d33-ae23-43b0-b46e-6a938f1ca9ce None admin] PATH_INFO: `/v3/users/70ec64e2215c42beb09dc8e6f7576c6a` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:45.794319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed4d33-ae23-43b0-b46e-6a938f1ca9ce None admin] RBAC: Authorizing `identity:get_user(user_id=70ec64e2215c42beb09dc8e6f7576c6a)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:45.795782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed4d33-ae23-43b0-b46e-6a938f1ca9ce None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:45.797836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 97/200] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:45 2022] GET /identity/v3/users/70ec64e2215c42beb09dc8e6f7576c6a => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:45.798618 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed4d33-ae23-43b0-b46e-6a938f1ca9ce None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:45.861405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 104/201] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:45.862573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8a872-a118-4429-864c-9284287964a3 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:45.888418 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:45.908077 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed4d33-ae23-43b0-b46e-6a938f1ca9ce None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:45.913172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:45.942907 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6ece8-85cf-4581-9954-416c7309dc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:45.943705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6ece8-85cf-4581-9954-416c7309dc50 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:45.944046 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6ece8-85cf-4581-9954-416c7309dc50 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:45.944335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6ece8-85cf-4581-9954-416c7309dc50 None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:45.945596 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6ece8-85cf-4581-9954-416c7309dc50 None admin] RBAC: Authorizing `identity:get_project(project_id=470cf0437a844f7484bc6b78d5b0de15)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:45.947697 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6ece8-85cf-4581-9954-416c7309dc50 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:45.951219 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 98/202] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:45 2022] GET /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:45.951219 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6ece8-85cf-4581-9954-416c7309dc50 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:45.969654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8a872-a118-4429-864c-9284287964a3 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:46.004830 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b594b68-4100-4bab-9228-b363b124e556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:46.005960 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b594b68-4100-4bab-9228-b363b124e556 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:46.006418 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b594b68-4100-4bab-9228-b363b124e556 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:46.006904 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b594b68-4100-4bab-9228-b363b124e556 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:46.063413 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6ece8-85cf-4581-9954-416c7309dc50 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:46.082032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b594b68-4100-4bab-9228-b363b124e556 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:46.083751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b594b68-4100-4bab-9228-b363b124e556 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:46.099126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63606b7b-5887-4fac-b307-9648667e33f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:46.100129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63606b7b-5887-4fac-b307-9648667e33f5 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:46.100417 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63606b7b-5887-4fac-b307-9648667e33f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:46.100734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63606b7b-5887-4fac-b307-9648667e33f5 None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:46.102260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63606b7b-5887-4fac-b307-9648667e33f5 None admin] RBAC: Authorizing `identity:get_project(project_id=470cf0437a844f7484bc6b78d5b0de15)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:46.103908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63606b7b-5887-4fac-b307-9648667e33f5 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:46.105774 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 99/203] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:45 2022] GET /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:46.106537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63606b7b-5887-4fac-b307-9648667e33f5 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:46.130006 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:46.135013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:46.189259 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 105/204] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:46.190392 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b594b68-4100-4bab-9228-b363b124e556 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:46.213307 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63606b7b-5887-4fac-b307-9648667e33f5 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:46.253418 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0b328-acd6-4d4f-a2ea-df5ea19a3ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:46.254092 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0b328-acd6-4d4f-a2ea-df5ea19a3ee8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:46.254443 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0b328-acd6-4d4f-a2ea-df5ea19a3ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:46.254733 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0b328-acd6-4d4f-a2ea-df5ea19a3ee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:46.255577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0b328-acd6-4d4f-a2ea-df5ea19a3ee8 None admin] RBAC: Adding query filter params (role.id=416a52031d5d49b6a3fa0e9baa814436, scope.project.id=470cf0437a844f7484bc6b78d5b0de15, user.id=4da9b5c624af4027a3f24e6f759d6d67) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:46.255893 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0b328-acd6-4d4f-a2ea-df5ea19a3ee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:46.257373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0b328-acd6-4d4f-a2ea-df5ea19a3ee8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:46.266426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 100/205] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:46 2022] GET /identity/v3/role_assignments?user.id=4da9b5c624af4027a3f24e6f759d6d67&scope.project.id=470cf0437a844f7484bc6b78d5b0de15&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:46.266426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0b328-acd6-4d4f-a2ea-df5ea19a3ee8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:46.311274 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b594b68-4100-4bab-9228-b363b124e556 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:46.354986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa520c-0dc4-42f2-aab7-fae1c5874692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:46.356042 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa520c-0dc4-42f2-aab7-fae1c5874692 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:46.356554 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa520c-0dc4-42f2-aab7-fae1c5874692 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:46.357028 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa520c-0dc4-42f2-aab7-fae1c5874692 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:46.358094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa520c-0dc4-42f2-aab7-fae1c5874692 None admin] RBAC: Adding query filter params (role.id=cfd7c6febb2246d4a48765a0aa8563bf, scope.project.id=470cf0437a844f7484bc6b78d5b0de15, user.id=4da9b5c624af4027a3f24e6f759d6d67) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:46.358598 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa520c-0dc4-42f2-aab7-fae1c5874692 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:46.369251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa520c-0dc4-42f2-aab7-fae1c5874692 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:46.369251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 106/206] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:46 2022] GET /identity/v3/role_assignments?user.id=4da9b5c624af4027a3f24e6f759d6d67&scope.project.id=470cf0437a844f7484bc6b78d5b0de15&role.id=cfd7c6febb2246d4a48765a0aa8563bf => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:46.420809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:46.457047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0b328-acd6-4d4f-a2ea-df5ea19a3ee8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:46.514105 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304b68b-d299-4eb3-9386-350f5c29ff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:46.514999 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304b68b-d299-4eb3-9386-350f5c29ff97 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:46.515285 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304b68b-d299-4eb3-9386-350f5c29ff97 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:46.515563 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304b68b-d299-4eb3-9386-350f5c29ff97 None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:46.521426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304b68b-d299-4eb3-9386-350f5c29ff97 None admin] RBAC: Authorizing `identity:get_project(project_id=ef31df6af6414934be49044ddb61049d)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:46.522934 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304b68b-d299-4eb3-9386-350f5c29ff97 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:46.524856 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 101/207] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:46 2022] GET /identity/v3/projects/ef31df6af6414934be49044ddb61049d => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:46.531011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa520c-0dc4-42f2-aab7-fae1c5874692 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:46.555841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:46.650988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa520c-0dc4-42f2-aab7-fae1c5874692 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:46.685832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ef843-8c58-4aa9-bff2-c27803b50b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:46.686497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ef843-8c58-4aa9-bff2-c27803b50b63 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:46.686832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ef843-8c58-4aa9-bff2-c27803b50b63 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:46.687105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ef843-8c58-4aa9-bff2-c27803b50b63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:46.688044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ef843-8c58-4aa9-bff2-c27803b50b63 None admin] RBAC: Adding query filter params (role.id=1a958ec71abb4047bc9427c58b382a2c, scope.project.id=ef31df6af6414934be49044ddb61049d, user.id=70ec64e2215c42beb09dc8e6f7576c6a) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:46.688362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ef843-8c58-4aa9-bff2-c27803b50b63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:46.689844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ef843-8c58-4aa9-bff2-c27803b50b63 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:46.695820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 107/208] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:46 2022] GET /identity/v3/role_assignments?user.id=70ec64e2215c42beb09dc8e6f7576c6a&scope.project.id=ef31df6af6414934be49044ddb61049d&role.id=1a958ec71abb4047bc9427c58b382a2c => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:47.354029 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdc07a-0969-4de4-a3b0-e52ae3ff48e8 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:47.354388 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdc07a-0969-4de4-a3b0-e52ae3ff48e8 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:47.354594 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdc07a-0969-4de4-a3b0-e52ae3ff48e8 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:47.356321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 102/209] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:47.361956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af8b6a-35be-414f-ad6a-d775edc09ecb None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:47.362253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af8b6a-35be-414f-ad6a-d775edc09ecb None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:47.362539 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af8b6a-35be-414f-ad6a-d775edc09ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:47.381313 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-47af8b6a-35be-414f-ad6a-d775edc09ecb None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:47.382503 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-47af8b6a-35be-414f-ad6a-d775edc09ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:47.402829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a79a2e-a6dc-4f4e-a8cc-b2101693caee None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:47.403134 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a79a2e-a6dc-4f4e-a8cc-b2101693caee None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:47.403387 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a79a2e-a6dc-4f4e-a8cc-b2101693caee None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:47.404790 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 103/210] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:47.413371 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee7825-70b6-4c5a-85ad-7b97fbbe702d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:47.413371 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee7825-70b6-4c5a-85ad-7b97fbbe702d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:47.413371 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee7825-70b6-4c5a-85ad-7b97fbbe702d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:47.432762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-8cee7825-70b6-4c5a-85ad-7b97fbbe702d None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:47.434298 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8cee7825-70b6-4c5a-85ad-7b97fbbe702d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:47.481372 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 108/211] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:47.505625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af8b6a-35be-414f-ad6a-d775edc09ecb None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:47.508654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:47.511341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 104/212] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:47.540283 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee7825-70b6-4c5a-85ad-7b97fbbe702d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:47.612326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af8b6a-35be-414f-ad6a-d775edc09ecb None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:47.625167 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:47.644720 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee7825-70b6-4c5a-85ad-7b97fbbe702d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:47.649425 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86065aef-276e-4c7b-843b-d4094a4c219b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:47.649752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86065aef-276e-4c7b-843b-d4094a4c219b None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:47.649976 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86065aef-276e-4c7b-843b-d4094a4c219b None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:47.650279 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86065aef-276e-4c7b-843b-d4094a4c219b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:47.651516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86065aef-276e-4c7b-843b-d4094a4c219b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:47.653094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86065aef-276e-4c7b-843b-d4094a4c219b None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:47.654819 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 109/213] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:47.660672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86065aef-276e-4c7b-843b-d4094a4c219b None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:47.687987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf2b40-4da4-4e21-a4b5-ddb22a8a13b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:47.689234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf2b40-4da4-4e21-a4b5-ddb22a8a13b5 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:47.689735 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf2b40-4da4-4e21-a4b5-ddb22a8a13b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:47.690216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf2b40-4da4-4e21-a4b5-ddb22a8a13b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:47.702639 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf2b40-4da4-4e21-a4b5-ddb22a8a13b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:47.710876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-6cdf2b40-4da4-4e21-a4b5-ddb22a8a13b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:47.710876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:47.710876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:47.710876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:47.710876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:47.710876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:47.710876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:47.710876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:47.710876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:47.710876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:47.710876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:47.710876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:47.710876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:47.710876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:47.710876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:47.710876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:47.712270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:47.712270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:47.712270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:47.712270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:47.712270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:47.712270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:47.712270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:47.712270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:47.712270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:47.712270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:47.712270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:47.712270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:47.712270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:47.712270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:47.712270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:47.712270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:47.713103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:47.713103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:47.713103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:47.713103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:47.713103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:47.713103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:47.713103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:47.713103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:47.713103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:47.713103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:47.713103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:47.713103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:36:47.715782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 105/214] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:47.722587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf2b40-4da4-4e21-a4b5-ddb22a8a13b5 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:47.746226 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:47.790248 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86065aef-276e-4c7b-843b-d4094a4c219b None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:47.835344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071a5d4-aa92-40af-83d6-4a303301b196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:47.835947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071a5d4-aa92-40af-83d6-4a303301b196 None admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:47.837088 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071a5d4-aa92-40af-83d6-4a303301b196 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:47.837374 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071a5d4-aa92-40af-83d6-4a303301b196 None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:47.838379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071a5d4-aa92-40af-83d6-4a303301b196 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:47.840305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071a5d4-aa92-40af-83d6-4a303301b196 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:47.845982 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf2b40-4da4-4e21-a4b5-ddb22a8a13b5 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:47.881661 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea4051-0424-40be-a00c-0d688c312765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:47.882339 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea4051-0424-40be-a00c-0d688c312765 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:47.882640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea4051-0424-40be-a00c-0d688c312765 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:47.882947 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea4051-0424-40be-a00c-0d688c312765 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:47.883700 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea4051-0424-40be-a00c-0d688c312765 None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:47.884014 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea4051-0424-40be-a00c-0d688c312765 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:47.885440 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea4051-0424-40be-a00c-0d688c312765 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:47.894962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 106/215] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:47.900603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea4051-0424-40be-a00c-0d688c312765 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:47.903277 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:47.922216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 110/216] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Jun 16 18:36:47 2022] POST /identity/v3/users => generated 297 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:36:48.016094 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea4051-0424-40be-a00c-0d688c312765 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:48.058859 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe65189-5d21-466f-85db-580853940249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:48.060157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe65189-5d21-466f-85db-580853940249 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:48.060680 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe65189-5d21-466f-85db-580853940249 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:48.061150 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe65189-5d21-466f-85db-580853940249 None admin] PATH_INFO: `/v3/users/17ce749fa1594f08939a19df72337822` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:48.079752 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe65189-5d21-466f-85db-580853940249 None admin] RBAC: Authorizing `identity:get_user(user_id=17ce749fa1594f08939a19df72337822)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:48.081534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe65189-5d21-466f-85db-580853940249 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:48.083539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 107/217] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:47 2022] GET /identity/v3/users/17ce749fa1594f08939a19df72337822 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:48.089877 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071a5d4-aa92-40af-83d6-4a303301b196 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:48.202767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071a5d4-aa92-40af-83d6-4a303301b196 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:48.231765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:48.240349 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d962b9-7dbb-4154-a491-a931ff526e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:48.249612 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d962b9-7dbb-4154-a491-a931ff526e42 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:48.249612 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d962b9-7dbb-4154-a491-a931ff526e42 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:48.249612 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d962b9-7dbb-4154-a491-a931ff526e42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:48.324406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d962b9-7dbb-4154-a491-a931ff526e42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:48.326163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d962b9-7dbb-4154-a491-a931ff526e42 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:48.444033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 111/218] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:48.449921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe65189-5d21-466f-85db-580853940249 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:48.552041 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:48.614397 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe65189-5d21-466f-85db-580853940249 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:48.665679 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5626ba-4d51-4526-90df-07d3147d5f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:48.666620 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5626ba-4d51-4526-90df-07d3147d5f7e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:48.666954 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5626ba-4d51-4526-90df-07d3147d5f7e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:48.667241 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5626ba-4d51-4526-90df-07d3147d5f7e None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:48.668497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5626ba-4d51-4526-90df-07d3147d5f7e None admin] RBAC: Authorizing `identity:get_project(project_id=470cf0437a844f7484bc6b78d5b0de15)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:48.669967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5626ba-4d51-4526-90df-07d3147d5f7e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:48.671751 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 108/219] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:48 2022] GET /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:48.677886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d962b9-7dbb-4154-a491-a931ff526e42 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:48.735085 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:48.752348 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dea874-1f2b-4c1c-a716-d0a6eb484a9a None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:48.752738 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dea874-1f2b-4c1c-a716-d0a6eb484a9a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:48.753029 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dea874-1f2b-4c1c-a716-d0a6eb484a9a None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:48.754426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 109/220] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:48.760307 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecb9bf-64d8-4222-9713-e4361338ce43 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:48.760648 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecb9bf-64d8-4222-9713-e4361338ce43 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:48.760906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecb9bf-64d8-4222-9713-e4361338ce43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:48.793121 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-16ecb9bf-64d8-4222-9713-e4361338ce43 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:48.794350 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-16ecb9bf-64d8-4222-9713-e4361338ce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:48.858608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d962b9-7dbb-4154-a491-a931ff526e42 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:48.897476 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a6091-df1c-4830-b1f9-7a8c1c7cef74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:48.898159 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a6091-df1c-4830-b1f9-7a8c1c7cef74 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:48.898486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a6091-df1c-4830-b1f9-7a8c1c7cef74 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:48.898765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a6091-df1c-4830-b1f9-7a8c1c7cef74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:48.899603 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a6091-df1c-4830-b1f9-7a8c1c7cef74 None admin] RBAC: Adding query filter params (role.id=34f07ea559bb44a6b3d81c7c1ff19bbc, scope.project.id=470cf0437a844f7484bc6b78d5b0de15, user.id=17ce749fa1594f08939a19df72337822) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:48.899949 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a6091-df1c-4830-b1f9-7a8c1c7cef74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:48.901701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a6091-df1c-4830-b1f9-7a8c1c7cef74 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:48.907066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 110/221] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:48.908174 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 112/222] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:48 2022] GET /identity/v3/role_assignments?user.id=17ce749fa1594f08939a19df72337822&scope.project.id=470cf0437a844f7484bc6b78d5b0de15&role.id=34f07ea559bb44a6b3d81c7c1ff19bbc => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:48.909095 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d1ae9-f743-4fae-abfd-81cdb1e34298 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:48.909393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d1ae9-f743-4fae-abfd-81cdb1e34298 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:48.909674 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d1ae9-f743-4fae-abfd-81cdb1e34298 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:48.911121 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 111/223] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:48.920164 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086e0f1-99c3-4567-b834-b696971d78b1 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:48.920164 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086e0f1-99c3-4567-b834-b696971d78b1 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:48.920164 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086e0f1-99c3-4567-b834-b696971d78b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:48.937809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-f086e0f1-99c3-4567-b834-b696971d78b1 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:48.939059 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f086e0f1-99c3-4567-b834-b696971d78b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:48.945733 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d1ae9-f743-4fae-abfd-81cdb1e34298 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:49.026996 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 113/224] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:49.050101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086e0f1-99c3-4567-b834-b696971d78b1 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:49.076519 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:49.079003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:49.159352 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086e0f1-99c3-4567-b834-b696971d78b1 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:49.171396 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d1ae9-f743-4fae-abfd-81cdb1e34298 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:49.197888 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92270a91-617e-4257-90ce-b687d5c450b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:49.198700 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92270a91-617e-4257-90ce-b687d5c450b9 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:49.198991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92270a91-617e-4257-90ce-b687d5c450b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:49.199270 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92270a91-617e-4257-90ce-b687d5c450b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:49.210171 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92270a91-617e-4257-90ce-b687d5c450b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:49.218772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-92270a91-617e-4257-90ce-b687d5c450b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:49.218772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:49.218772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:49.218772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:49.218772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:49.218772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:49.218772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:49.218772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:49.218772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:49.218772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:49.218772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:49.218772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:49.218772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:49.218772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:49.218772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:49.218772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:49.219672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:49.219672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:49.219672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:49.219672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:49.219672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:49.219672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:49.219672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:49.219672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:49.219672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:49.219672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:49.219672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:49.219672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:49.219672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:49.219672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:49.219672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:49.219672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:49.220496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:49.220496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:49.220496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:49.220496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:49.220496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:49.220496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:49.220496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:49.220496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:49.220496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:49.220496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:49.220496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:49.220496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:49.220496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 114/225] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:36:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:49.226064 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92270a91-617e-4257-90ce-b687d5c450b9 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:49.229254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97902a-80f3-4f2a-b402-99bf58055c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:49.230195 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97902a-80f3-4f2a-b402-99bf58055c6f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:49.230487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97902a-80f3-4f2a-b402-99bf58055c6f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:49.230761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97902a-80f3-4f2a-b402-99bf58055c6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:49.260718 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97902a-80f3-4f2a-b402-99bf58055c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:49.284485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-ce97902a-80f3-4f2a-b402-99bf58055c6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:49.284485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:49.284485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:49.284485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:49.284485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:49.284485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:49.284485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:49.284485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:49.284485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:49.284485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:49.284485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:49.284485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:49.284485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:49.284485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:49.284485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:49.284485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:49.286603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:49.286603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:49.286603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:49.286603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:49.286603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:49.286603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:49.286603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:49.286603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:49.286603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:49.286603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:49.286603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:49.286603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:49.286603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:49.286603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:49.286603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:49.286603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:49.288555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:49.288555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:49.288555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:49.288555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:49.288555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:49.288555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:49.288555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:49.288555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:49.288555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:49.288555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:49.288555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:49.288555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:36:49.288555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 112/226] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:36:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:49.292198 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97902a-80f3-4f2a-b402-99bf58055c6f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:49.321731 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:49.338039 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92270a91-617e-4257-90ce-b687d5c450b9 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:49.374575 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f41f2-5413-4e99-baf4-7feaa6b41e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:49.375259 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f41f2-5413-4e99-baf4-7feaa6b41e80 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:49.375546 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f41f2-5413-4e99-baf4-7feaa6b41e80 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:49.375826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f41f2-5413-4e99-baf4-7feaa6b41e80 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:49.376615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f41f2-5413-4e99-baf4-7feaa6b41e80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:49.376934 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f41f2-5413-4e99-baf4-7feaa6b41e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:49.378453 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f41f2-5413-4e99-baf4-7feaa6b41e80 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:49.387572 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 115/227] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:49.393046 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f41f2-5413-4e99-baf4-7feaa6b41e80 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:49.501520 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f41f2-5413-4e99-baf4-7feaa6b41e80 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:49.540548 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec1c01-bd16-4be5-a474-061f145f8d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:49.541357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec1c01-bd16-4be5-a474-061f145f8d51 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:49.541641 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec1c01-bd16-4be5-a474-061f145f8d51 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:49.541919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec1c01-bd16-4be5-a474-061f145f8d51 None admin] PATH_INFO: `/v3/users/4da9b5c624af4027a3f24e6f759d6d67` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:49.545836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec1c01-bd16-4be5-a474-061f145f8d51 None admin] RBAC: Authorizing `identity:get_user(user_id=4da9b5c624af4027a3f24e6f759d6d67)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:49.547318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec1c01-bd16-4be5-a474-061f145f8d51 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:49.549010 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 116/228] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:49 2022] GET /identity/v3/users/4da9b5c624af4027a3f24e6f759d6d67 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:49.559114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec1c01-bd16-4be5-a474-061f145f8d51 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:49.582715 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97902a-80f3-4f2a-b402-99bf58055c6f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:49.596841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:49.644807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:49.664963 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9590d8d-e931-43b0-a839-780759545a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:49.665568 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9590d8d-e931-43b0-a839-780759545a97 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:49.665857 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9590d8d-e931-43b0-a839-780759545a97 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:49.666138 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9590d8d-e931-43b0-a839-780759545a97 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:49.666903 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9590d8d-e931-43b0-a839-780759545a97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:49.667216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9590d8d-e931-43b0-a839-780759545a97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:49.668868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9590d8d-e931-43b0-a839-780759545a97 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:49.686784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 113/229] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:36:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:49.690580 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9590d8d-e931-43b0-a839-780759545a97 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:49.694912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec1c01-bd16-4be5-a474-061f145f8d51 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:49.760448 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19142f5-91fa-4a87-88b4-bdb816c26b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:49.761391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19142f5-91fa-4a87-88b4-bdb816c26b2a None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:49.761682 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19142f5-91fa-4a87-88b4-bdb816c26b2a None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:49.761963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19142f5-91fa-4a87-88b4-bdb816c26b2a None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:49.763576 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19142f5-91fa-4a87-88b4-bdb816c26b2a None admin] RBAC: Authorizing `identity:get_project(project_id=470cf0437a844f7484bc6b78d5b0de15)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:49.765136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19142f5-91fa-4a87-88b4-bdb816c26b2a None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:49.768066 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 117/230] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:49 2022] GET /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:49.777440 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19142f5-91fa-4a87-88b4-bdb816c26b2a None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:49.873786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9590d8d-e931-43b0-a839-780759545a97 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:49.919149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:49.935282 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517121e-7736-4085-a786-4341a6601b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:49.936175 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517121e-7736-4085-a786-4341a6601b14 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:49.936475 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517121e-7736-4085-a786-4341a6601b14 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:49.936761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517121e-7736-4085-a786-4341a6601b14 None admin] PATH_INFO: `/v3/users/4da9b5c624af4027a3f24e6f759d6d67` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:49.938655 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517121e-7736-4085-a786-4341a6601b14 None admin] RBAC: Authorizing `identity:get_user(user_id=4da9b5c624af4027a3f24e6f759d6d67)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:49.940113 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517121e-7736-4085-a786-4341a6601b14 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:49.942508 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 114/231] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:49 2022] GET /identity/v3/users/4da9b5c624af4027a3f24e6f759d6d67 => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:49.947919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517121e-7736-4085-a786-4341a6601b14 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:49.954287 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19142f5-91fa-4a87-88b4-bdb816c26b2a None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:50.021748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f0d54-1df3-4706-a760-8d7d931097cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:50.022722 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f0d54-1df3-4706-a760-8d7d931097cf None admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:50.023528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f0d54-1df3-4706-a760-8d7d931097cf None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:50.023856 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f0d54-1df3-4706-a760-8d7d931097cf None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15/users/4da9b5c624af4027a3f24e6f759d6d67/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:50.027249 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f0d54-1df3-4706-a760-8d7d931097cf None admin] RBAC: Authorizing `identity:create_grant(project_id=470cf0437a844f7484bc6b78d5b0de15, user_id=4da9b5c624af4027a3f24e6f759d6d67, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:50.028981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f0d54-1df3-4706-a760-8d7d931097cf None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:50.038048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:50.090354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517121e-7736-4085-a786-4341a6601b14 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:50.111144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 118/232] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:36:49 2022] PUT /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15/users/4da9b5c624af4027a3f24e6f759d6d67/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:36:50.140253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e887c4-fd12-4bd2-ba3f-315837ad653b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:50.141106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e887c4-fd12-4bd2-ba3f-315837ad653b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:50.141395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e887c4-fd12-4bd2-ba3f-315837ad653b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:50.141673 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e887c4-fd12-4bd2-ba3f-315837ad653b None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:50.142984 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e887c4-fd12-4bd2-ba3f-315837ad653b None admin] RBAC: Authorizing `identity:get_project(project_id=470cf0437a844f7484bc6b78d5b0de15)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:50.144489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e887c4-fd12-4bd2-ba3f-315837ad653b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:50.146312 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 115/233] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:49 2022] GET /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:50.152785 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f0d54-1df3-4706-a760-8d7d931097cf None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:50.317138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f0d54-1df3-4706-a760-8d7d931097cf None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:50.361517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd0c1d-383c-447e-91f5-1ce5dc698ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:50.362719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd0c1d-383c-447e-91f5-1ce5dc698ef6 None admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:50.363179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd0c1d-383c-447e-91f5-1ce5dc698ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:50.363629 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd0c1d-383c-447e-91f5-1ce5dc698ef6 None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15/users/4da9b5c624af4027a3f24e6f759d6d67/roles/cfd7c6febb2246d4a48765a0aa8563bf` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:50.366080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd0c1d-383c-447e-91f5-1ce5dc698ef6 None admin] RBAC: Authorizing `identity:create_grant(project_id=470cf0437a844f7484bc6b78d5b0de15, user_id=4da9b5c624af4027a3f24e6f759d6d67, role_id=cfd7c6febb2246d4a48765a0aa8563bf)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:50.367827 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd0c1d-383c-447e-91f5-1ce5dc698ef6 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:50.469639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:50.476740 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 119/234] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:36:50 2022] PUT /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15/users/4da9b5c624af4027a3f24e6f759d6d67/roles/cfd7c6febb2246d4a48765a0aa8563bf => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:36:50.700196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13f76a-8f77-4a47-af22-252c0c77877a None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:50.700727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13f76a-8f77-4a47-af22-252c0c77877a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:50.700827 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13f76a-8f77-4a47-af22-252c0c77877a None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:50.702392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 116/235] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:50.707964 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c133c16-cfc1-4777-bc0b-e9befb05a538 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:50.708363 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c133c16-cfc1-4777-bc0b-e9befb05a538 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:50.708569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c133c16-cfc1-4777-bc0b-e9befb05a538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:50.730370 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-4c133c16-cfc1-4777-bc0b-e9befb05a538 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:50.731609 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-4c133c16-cfc1-4777-bc0b-e9befb05a538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:50.739165 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c572615-2f3f-4122-a082-dad9847188e1 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:50.739461 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c572615-2f3f-4122-a082-dad9847188e1 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:50.739741 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c572615-2f3f-4122-a082-dad9847188e1 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:50.741436 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 117/236] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:50.747464 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e5d54-beae-43b1-820f-0db0a901f90b None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:50.748831 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e5d54-beae-43b1-820f-0db0a901f90b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:50.748831 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e5d54-beae-43b1-820f-0db0a901f90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:50.777421 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d16e5d54-beae-43b1-820f-0db0a901f90b None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:50.779136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d16e5d54-beae-43b1-820f-0db0a901f90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:50.893703 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 120/237] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:50.910755 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 118/238] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:50.924026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c133c16-cfc1-4777-bc0b-e9befb05a538 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:50.954680 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e5d54-beae-43b1-820f-0db0a901f90b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:51.068855 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:51.096392 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c133c16-cfc1-4777-bc0b-e9befb05a538 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:51.130825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:51.140654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc72da-cd8d-4ce4-b7be-613f491ec4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:51.141475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc72da-cd8d-4ce4-b7be-613f491ec4c0 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:51.141762 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc72da-cd8d-4ce4-b7be-613f491ec4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:51.142057 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc72da-cd8d-4ce4-b7be-613f491ec4c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:51.165128 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e5d54-beae-43b1-820f-0db0a901f90b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:51.166861 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc72da-cd8d-4ce4-b7be-613f491ec4c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:51.175241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-44fc72da-cd8d-4ce4-b7be-613f491ec4c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:51.175241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:51.175241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:51.175241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:51.175241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:51.175241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:51.175241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:51.175241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:51.175241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:51.175241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:51.175241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:51.175241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:51.175241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:51.175241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:51.175241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:51.175241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:51.176157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:51.176157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:51.176157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:51.176157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:51.176157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:51.176157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:51.176157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:51.176157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:51.176157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:51.176157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:51.176157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:51.176157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:51.176157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:51.176157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:51.176157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:51.176157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:51.176991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:51.176991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:51.176991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:51.176991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:51.176991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:51.176991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:51.176991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:51.176991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:51.176991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:51.176991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:51.176991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:51.176991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:51.176991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 121/239] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:51.182993 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc72da-cd8d-4ce4-b7be-613f491ec4c0 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:51.236702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dee414-6ce5-4c58-9356-ab1ad046bc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:51.237524 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dee414-6ce5-4c58-9356-ab1ad046bc4d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:51.237809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dee414-6ce5-4c58-9356-ab1ad046bc4d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:51.238085 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dee414-6ce5-4c58-9356-ab1ad046bc4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:51.241258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dee414-6ce5-4c58-9356-ab1ad046bc4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:51.243718 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dee414-6ce5-4c58-9356-ab1ad046bc4d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:51.245865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 119/240] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:51.261666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dee414-6ce5-4c58-9356-ab1ad046bc4d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:51.295602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc72da-cd8d-4ce4-b7be-613f491ec4c0 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:51.331532 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3876c47-2536-4a94-868a-e1e95a162ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:51.331966 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3876c47-2536-4a94-868a-e1e95a162ebc None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:51.332257 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3876c47-2536-4a94-868a-e1e95a162ebc None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:51.333911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3876c47-2536-4a94-868a-e1e95a162ebc None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:51.333911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3876c47-2536-4a94-868a-e1e95a162ebc None admin] RBAC: Adding query filter params (name=reader) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:51.333911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3876c47-2536-4a94-868a-e1e95a162ebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:51.335132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3876c47-2536-4a94-868a-e1e95a162ebc None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:51.348023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 122/241] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:51.350199 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3876c47-2536-4a94-868a-e1e95a162ebc None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:51.422049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:51.465753 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dee414-6ce5-4c58-9356-ab1ad046bc4d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:51.485893 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:51.515405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae4c52-ea5a-499a-8408-576d8f4400da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:51.516532 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae4c52-ea5a-499a-8408-576d8f4400da None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:51.517041 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae4c52-ea5a-499a-8408-576d8f4400da None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:51.517517 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae4c52-ea5a-499a-8408-576d8f4400da None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:51.519616 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae4c52-ea5a-499a-8408-576d8f4400da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:51.521342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae4c52-ea5a-499a-8408-576d8f4400da None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:51.546145 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3876c47-2536-4a94-868a-e1e95a162ebc None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:51.590523 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074472c-6333-4e78-8309-448d6668844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:51.591844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074472c-6333-4e78-8309-448d6668844a None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:51.592345 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074472c-6333-4e78-8309-448d6668844a None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:51.592862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074472c-6333-4e78-8309-448d6668844a None admin] PATH_INFO: `/v3/users/91441f65089e4100b33fb1aead090d14` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:51.609701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074472c-6333-4e78-8309-448d6668844a None admin] RBAC: Authorizing `identity:get_user(user_id=91441f65089e4100b33fb1aead090d14)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:51.611599 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074472c-6333-4e78-8309-448d6668844a None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:51.613966 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 123/242] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:51 2022] GET /identity/v3/users/91441f65089e4100b33fb1aead090d14 => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:51.621503 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074472c-6333-4e78-8309-448d6668844a None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:51.634968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 120/243] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Jun 16 18:36:51 2022] POST /identity/v3/users => generated 293 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:36:51.774021 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c5580-9e4f-4de9-a00f-a0979f6af63a None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:51.774675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c5580-9e4f-4de9-a00f-a0979f6af63a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:51.774675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c5580-9e4f-4de9-a00f-a0979f6af63a None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:51.776068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 121/244] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:51.779288 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074472c-6333-4e78-8309-448d6668844a None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:51.786406 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db74fb-ae21-4c1b-b42d-d75936402c03 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:51.786689 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db74fb-ae21-4c1b-b42d-d75936402c03 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:51.786965 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db74fb-ae21-4c1b-b42d-d75936402c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:51.796839 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:51.817558 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-11db74fb-ae21-4c1b-b42d-d75936402c03 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:51.818989 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-11db74fb-ae21-4c1b-b42d-d75936402c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:51.826664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81b5c6-9e36-4094-ba60-4b2dbb9c73e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:51.827348 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81b5c6-9e36-4094-ba60-4b2dbb9c73e9 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:51.827637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81b5c6-9e36-4094-ba60-4b2dbb9c73e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:51.827922 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81b5c6-9e36-4094-ba60-4b2dbb9c73e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:51.923534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 122/245] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:51.936253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81b5c6-9e36-4094-ba60-4b2dbb9c73e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:51.937865 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81b5c6-9e36-4094-ba60-4b2dbb9c73e9 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:51.948752 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db74fb-ae21-4c1b-b42d-d75936402c03 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:52.053902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 124/246] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:52.059761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81b5c6-9e36-4094-ba60-4b2dbb9c73e9 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:52.072423 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:52.072815 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:52.075963 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db74fb-ae21-4c1b-b42d-d75936402c03 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:52.122525 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eca020-4d24-4db1-aeb7-f276087527a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:52.123567 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eca020-4d24-4db1-aeb7-f276087527a1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:52.124016 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eca020-4d24-4db1-aeb7-f276087527a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:52.124483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eca020-4d24-4db1-aeb7-f276087527a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:52.139771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eca020-4d24-4db1-aeb7-f276087527a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:52.153321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-c5eca020-4d24-4db1-aeb7-f276087527a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:52.153321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:52.153321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:52.153321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:52.153321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:52.153321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:52.153321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:52.153321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:52.153321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:52.153321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:52.153321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:52.153321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:52.153321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:52.153321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:52.153321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:52.153321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:52.154272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:52.154272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:52.154272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:52.154272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:52.154272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:52.154272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:52.154272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:52.154272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:52.154272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:52.154272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:52.154272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:52.154272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:52.154272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:52.154272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:52.154272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:52.154272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:52.155080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:52.155080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:52.155080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:52.155080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:52.155080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:52.155080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:52.155080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:52.155080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:52.155080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:52.155080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:52.155080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:52.155080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:36:52.160349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 123/247] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:52.166805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81b5c6-9e36-4094-ba60-4b2dbb9c73e9 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:52.168401 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eca020-4d24-4db1-aeb7-f276087527a1 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:52.201946 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af164d-ce30-4e60-9b1f-0bdb317d4f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:52.204759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af164d-ce30-4e60-9b1f-0bdb317d4f0e None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:52.204759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af164d-ce30-4e60-9b1f-0bdb317d4f0e None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:52.204759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af164d-ce30-4e60-9b1f-0bdb317d4f0e None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:52.205402 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af164d-ce30-4e60-9b1f-0bdb317d4f0e None admin] RBAC: Authorizing `identity:get_project(project_id=470cf0437a844f7484bc6b78d5b0de15)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:52.206867 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af164d-ce30-4e60-9b1f-0bdb317d4f0e None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:52.208940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 125/248] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:52 2022] GET /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:52.216195 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af164d-ce30-4e60-9b1f-0bdb317d4f0e None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:52.300023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:52.307584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eca020-4d24-4db1-aeb7-f276087527a1 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:52.324814 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af164d-ce30-4e60-9b1f-0bdb317d4f0e None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:52.345803 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6cd22-37ec-4798-a5c6-e09de3d9ec11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:52.346772 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6cd22-37ec-4798-a5c6-e09de3d9ec11 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:52.347341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6cd22-37ec-4798-a5c6-e09de3d9ec11 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:52.347792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6cd22-37ec-4798-a5c6-e09de3d9ec11 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:52.350066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6cd22-37ec-4798-a5c6-e09de3d9ec11 None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:52.350567 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6cd22-37ec-4798-a5c6-e09de3d9ec11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:52.352528 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6cd22-37ec-4798-a5c6-e09de3d9ec11 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:52.362522 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13150e-687b-4e75-8631-9c19c433ad6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:52.363204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 124/249] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:52.363310 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13150e-687b-4e75-8631-9c19c433ad6f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:52.364547 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13150e-687b-4e75-8631-9c19c433ad6f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:52.364547 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13150e-687b-4e75-8631-9c19c433ad6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:52.364874 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13150e-687b-4e75-8631-9c19c433ad6f None admin] RBAC: Adding query filter params (role.id=1a958ec71abb4047bc9427c58b382a2c, scope.project.id=470cf0437a844f7484bc6b78d5b0de15, user.id=91441f65089e4100b33fb1aead090d14) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:52.365263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13150e-687b-4e75-8631-9c19c433ad6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:52.367400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13150e-687b-4e75-8631-9c19c433ad6f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:52.370333 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6cd22-37ec-4798-a5c6-e09de3d9ec11 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:52.374018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 126/250] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:52 2022] GET /identity/v3/role_assignments?user.id=91441f65089e4100b33fb1aead090d14&scope.project.id=470cf0437a844f7484bc6b78d5b0de15&role.id=1a958ec71abb4047bc9427c58b382a2c => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:52.399177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:52.485143 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6cd22-37ec-4798-a5c6-e09de3d9ec11 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:52.522901 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e9c2b-4e5f-46e4-ae20-16240534954f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:52.523813 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e9c2b-4e5f-46e4-ae20-16240534954f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:52.524104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e9c2b-4e5f-46e4-ae20-16240534954f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:52.524388 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e9c2b-4e5f-46e4-ae20-16240534954f None admin] PATH_INFO: `/v3/users/17ce749fa1594f08939a19df72337822` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:52.525689 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e9c2b-4e5f-46e4-ae20-16240534954f None admin] RBAC: Authorizing `identity:get_user(user_id=17ce749fa1594f08939a19df72337822)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:52.527282 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e9c2b-4e5f-46e4-ae20-16240534954f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:52.529018 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 125/251] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:52 2022] GET /identity/v3/users/17ce749fa1594f08939a19df72337822 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:52.534715 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13150e-687b-4e75-8631-9c19c433ad6f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:52.649629 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13150e-687b-4e75-8631-9c19c433ad6f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:52.697802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023704e-1547-4df0-ba0d-577146dce875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:52.699037 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023704e-1547-4df0-ba0d-577146dce875 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:52.699642 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023704e-1547-4df0-ba0d-577146dce875 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:52.700110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023704e-1547-4df0-ba0d-577146dce875 None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:52.705240 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023704e-1547-4df0-ba0d-577146dce875 None admin] RBAC: Authorizing `identity:get_project(project_id=470cf0437a844f7484bc6b78d5b0de15)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:52.706974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023704e-1547-4df0-ba0d-577146dce875 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:52.708976 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 127/252] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:52 2022] GET /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:52.714719 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e9c2b-4e5f-46e4-ae20-16240534954f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:52.825314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:52.834792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e9c2b-4e5f-46e4-ae20-16240534954f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:52.870539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86589db-cfc5-4a28-be63-6b2aa3709cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:52.871445 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86589db-cfc5-4a28-be63-6b2aa3709cd6 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:52.871725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86589db-cfc5-4a28-be63-6b2aa3709cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:52.872002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86589db-cfc5-4a28-be63-6b2aa3709cd6 None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15/users/17ce749fa1594f08939a19df72337822/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:52.874008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86589db-cfc5-4a28-be63-6b2aa3709cd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=470cf0437a844f7484bc6b78d5b0de15, user_id=17ce749fa1594f08939a19df72337822, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:52.875605 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86589db-cfc5-4a28-be63-6b2aa3709cd6 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:52.964575 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 126/253] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:36:52 2022] PUT /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15/users/17ce749fa1594f08939a19df72337822/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:36:53.009359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b453ef9-02cf-45f0-a530-801bea86857c None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:53.009878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b453ef9-02cf-45f0-a530-801bea86857c None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:53.009988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b453ef9-02cf-45f0-a530-801bea86857c None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:53.011618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 128/254] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:53.017195 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5bdae-023b-459d-8700-df00df2be345 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:53.017487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5bdae-023b-459d-8700-df00df2be345 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:53.017771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5bdae-023b-459d-8700-df00df2be345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:53.042680 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f6b5bdae-023b-459d-8700-df00df2be345 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:53.044003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f6b5bdae-023b-459d-8700-df00df2be345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:53.134111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4947f7-27d2-44c3-9943-f5b8c7ad9fb0 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:53.134325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4947f7-27d2-44c3-9943-f5b8c7ad9fb0 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:53.134615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4947f7-27d2-44c3-9943-f5b8c7ad9fb0 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:53.136161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 129/255] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:53.145962 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c806f4c-add3-479d-a00c-44811a6fbd98 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:53.146518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c806f4c-add3-479d-a00c-44811a6fbd98 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:53.146624 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 127/256] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:53.146721 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c806f4c-add3-479d-a00c-44811a6fbd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:53.185481 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-3c806f4c-add3-479d-a00c-44811a6fbd98 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:53.186689 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-3c806f4c-add3-479d-a00c-44811a6fbd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:53.189801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:53.191414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5bdae-023b-459d-8700-df00df2be345 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:53.304289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 130/257] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:53.323674 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:53.351752 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5bdae-023b-459d-8700-df00df2be345 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:53.366651 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c806f4c-add3-479d-a00c-44811a6fbd98 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:53.487212 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8be88-2230-43c3-8d85-666749f2ba07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:53.487959 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8be88-2230-43c3-8d85-666749f2ba07 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:53.488246 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8be88-2230-43c3-8d85-666749f2ba07 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:53.488548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8be88-2230-43c3-8d85-666749f2ba07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:53.507443 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8be88-2230-43c3-8d85-666749f2ba07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:53.525334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-fdc8be88-2230-43c3-8d85-666749f2ba07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:53.525334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:53.525334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:53.525334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:53.525334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:53.525334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:53.525334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:53.525334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:53.525334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:53.525334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:53.525334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:53.525334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:53.525334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:53.525334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:53.525334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:53.525334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:53.526276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:53.526276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:53.526276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:53.526276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:53.526276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:53.526276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:53.526276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:53.526276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:53.526276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:53.526276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:53.526276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:53.526276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:53.526276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:53.526276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:53.526276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:53.526276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:53.527107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:53.527107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:53.527107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:53.527107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:53.527107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:53.527107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:53.527107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:53.527107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:53.527107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:53.527107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:53.527107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:53.527107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:36:53.527107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 128/258] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:36:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:53.536811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8be88-2230-43c3-8d85-666749f2ba07 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:53.594709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c806f4c-add3-479d-a00c-44811a6fbd98 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:53.658097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1db40-9735-48d9-ad84-8b2e2a7a1bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:53.658940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1db40-9735-48d9-ad84-8b2e2a7a1bc4 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:53.659229 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1db40-9735-48d9-ad84-8b2e2a7a1bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:53.659509 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1db40-9735-48d9-ad84-8b2e2a7a1bc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:53.672002 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:53.675087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1db40-9735-48d9-ad84-8b2e2a7a1bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:53.683805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-12f1db40-9735-48d9-ad84-8b2e2a7a1bc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:53.683805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:53.683805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:53.683805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:53.683805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:53.683805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:53.683805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:53.683805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:53.683805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:53.683805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:53.683805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:53.683805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:53.683805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:53.683805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:53.683805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:53.683805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:53.692113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:53.692113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:53.692113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:53.692113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:53.692113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:53.692113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:53.692113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:53.692113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:53.692113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:53.692113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:53.692113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:53.692113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:53.692113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:53.692113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:53.692113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:53.692113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:53.692951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:53.692951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:53.692951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:53.692951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:53.692951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:53.692951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:53.692951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:53.692951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:53.692951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:53.692951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:53.692951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:53.692951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:53.692951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 131/259] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:36:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:53.692951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1db40-9735-48d9-ad84-8b2e2a7a1bc4 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:53.731088 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8be88-2230-43c3-8d85-666749f2ba07 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:53.816533 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e63748-343c-4dbf-bf01-982343f767e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:53.817680 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e63748-343c-4dbf-bf01-982343f767e1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:53.818164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e63748-343c-4dbf-bf01-982343f767e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:53.818644 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e63748-343c-4dbf-bf01-982343f767e1 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:53.820160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e63748-343c-4dbf-bf01-982343f767e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:53.820694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e63748-343c-4dbf-bf01-982343f767e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:53.822326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e63748-343c-4dbf-bf01-982343f767e1 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:53.831596 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 129/260] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:53.837700 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e63748-343c-4dbf-bf01-982343f767e1 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:53.840667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:53.918203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1db40-9735-48d9-ad84-8b2e2a7a1bc4 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:53.992458 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482621c-d4fe-45aa-baa0-582d2976a40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:53.994490 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482621c-d4fe-45aa-baa0-582d2976a40b None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:53.997821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482621c-d4fe-45aa-baa0-582d2976a40b None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:53.998321 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482621c-d4fe-45aa-baa0-582d2976a40b None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:53.999308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482621c-d4fe-45aa-baa0-582d2976a40b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:53.999836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482621c-d4fe-45aa-baa0-582d2976a40b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:54.001468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482621c-d4fe-45aa-baa0-582d2976a40b None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:54.025165 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 132/261] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:36:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:54.031538 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482621c-d4fe-45aa-baa0-582d2976a40b None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:54.035189 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e63748-343c-4dbf-bf01-982343f767e1 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:54.104494 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed349c8-7aa9-4db5-9449-48b37c1d92ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:54.105710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed349c8-7aa9-4db5-9449-48b37c1d92ce None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:54.106213 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed349c8-7aa9-4db5-9449-48b37c1d92ce None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:54.106686 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed349c8-7aa9-4db5-9449-48b37c1d92ce None admin] PATH_INFO: `/v3/users/4da9b5c624af4027a3f24e6f759d6d67` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:54.108112 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed349c8-7aa9-4db5-9449-48b37c1d92ce None admin] RBAC: Authorizing `identity:get_user(user_id=4da9b5c624af4027a3f24e6f759d6d67)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:54.110409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed349c8-7aa9-4db5-9449-48b37c1d92ce None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:54.113896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 130/262] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:53 2022] GET /identity/v3/users/4da9b5c624af4027a3f24e6f759d6d67 => generated 283 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:54.121031 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed349c8-7aa9-4db5-9449-48b37c1d92ce None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:54.154120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:54.220203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482621c-d4fe-45aa-baa0-582d2976a40b None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:54.241751 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:54.295054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09429d6-5f67-43f3-9dec-259c101fbb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:54.295938 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09429d6-5f67-43f3-9dec-259c101fbb4f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:54.296222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09429d6-5f67-43f3-9dec-259c101fbb4f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:54.296523 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09429d6-5f67-43f3-9dec-259c101fbb4f None admin] PATH_INFO: `/v3/users/4da9b5c624af4027a3f24e6f759d6d67` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:54.298340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09429d6-5f67-43f3-9dec-259c101fbb4f None admin] RBAC: Authorizing `identity:get_user(user_id=4da9b5c624af4027a3f24e6f759d6d67)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:54.300009 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09429d6-5f67-43f3-9dec-259c101fbb4f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:54.302903 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 133/263] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:54 2022] GET /identity/v3/users/4da9b5c624af4027a3f24e6f759d6d67 => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:54.309704 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09429d6-5f67-43f3-9dec-259c101fbb4f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:54.316008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed349c8-7aa9-4db5-9449-48b37c1d92ce None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:54.382507 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f67ce0-001b-4e1e-9082-7ae40b5690dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:54.382993 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f67ce0-001b-4e1e-9082-7ae40b5690dd None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:54.383291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f67ce0-001b-4e1e-9082-7ae40b5690dd None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:54.383566 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f67ce0-001b-4e1e-9082-7ae40b5690dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:54.429807 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09429d6-5f67-43f3-9dec-259c101fbb4f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:54.463232 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:54.477377 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a40791-05fc-4102-88e1-0449aa79e21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:54.478307 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a40791-05fc-4102-88e1-0449aa79e21d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:54.478814 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a40791-05fc-4102-88e1-0449aa79e21d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:54.479296 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a40791-05fc-4102-88e1-0449aa79e21d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:54.539593 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f67ce0-001b-4e1e-9082-7ae40b5690dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:54.541435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f67ce0-001b-4e1e-9082-7ae40b5690dd None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:54.614507 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a40791-05fc-4102-88e1-0449aa79e21d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:54.615813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a40791-05fc-4102-88e1-0449aa79e21d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:54.629607 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:54.667347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 131/264] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 18:36:54.673865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f67ce0-001b-4e1e-9082-7ae40b5690dd None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:54.784882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 134/265] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:54.792661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a40791-05fc-4102-88e1-0449aa79e21d None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:54.829025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:54.832058 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f67ce0-001b-4e1e-9082-7ae40b5690dd None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:54.908076 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35055667-74a1-4454-9e2c-6fb4bef4e773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:54.908980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35055667-74a1-4454-9e2c-6fb4bef4e773 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:54.909264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35055667-74a1-4454-9e2c-6fb4bef4e773 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:54.909541 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35055667-74a1-4454-9e2c-6fb4bef4e773 None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:54.910944 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35055667-74a1-4454-9e2c-6fb4bef4e773 None admin] RBAC: Authorizing `identity:get_project(project_id=470cf0437a844f7484bc6b78d5b0de15)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:54.913491 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35055667-74a1-4454-9e2c-6fb4bef4e773 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:54.915225 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 132/266] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:54 2022] GET /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:54.922255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35055667-74a1-4454-9e2c-6fb4bef4e773 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:54.934737 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a40791-05fc-4102-88e1-0449aa79e21d None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:54.995037 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:55.000344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad06bf1-8c8d-4043-ad71-89f93d2a5fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:55.005381 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad06bf1-8c8d-4043-ad71-89f93d2a5fa5 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.005695 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad06bf1-8c8d-4043-ad71-89f93d2a5fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.005964 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad06bf1-8c8d-4043-ad71-89f93d2a5fa5 None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.007764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad06bf1-8c8d-4043-ad71-89f93d2a5fa5 None admin] RBAC: Authorizing `identity:get_project(project_id=470cf0437a844f7484bc6b78d5b0de15)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:55.010548 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad06bf1-8c8d-4043-ad71-89f93d2a5fa5 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:55.013782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 135/267] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:54 2022] GET /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:55.023173 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad06bf1-8c8d-4043-ad71-89f93d2a5fa5 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:55.139557 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35055667-74a1-4454-9e2c-6fb4bef4e773 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:55.205491 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d552fa-b116-4065-84ea-c73fa0120c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:55.206081 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d552fa-b116-4065-84ea-c73fa0120c8c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.206366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d552fa-b116-4065-84ea-c73fa0120c8c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.206643 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d552fa-b116-4065-84ea-c73fa0120c8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.207484 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d552fa-b116-4065-84ea-c73fa0120c8c None admin] RBAC: Adding query filter params (role.id=416a52031d5d49b6a3fa0e9baa814436, scope.project.id=470cf0437a844f7484bc6b78d5b0de15, user.id=4da9b5c624af4027a3f24e6f759d6d67) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:55.207799 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d552fa-b116-4065-84ea-c73fa0120c8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:55.209275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d552fa-b116-4065-84ea-c73fa0120c8c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:55.218917 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:55.222351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 133/268] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:54 2022] GET /identity/v3/role_assignments?user.id=4da9b5c624af4027a3f24e6f759d6d67&scope.project.id=470cf0437a844f7484bc6b78d5b0de15&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:55.225061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad06bf1-8c8d-4043-ad71-89f93d2a5fa5 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:55.294911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782363a7-4199-4899-b90c-d1d4439d3ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:55.295611 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782363a7-4199-4899-b90c-d1d4439d3ff7 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.295901 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782363a7-4199-4899-b90c-d1d4439d3ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.296181 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782363a7-4199-4899-b90c-d1d4439d3ff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.297084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782363a7-4199-4899-b90c-d1d4439d3ff7 None admin] RBAC: Adding query filter params (role.id=cfd7c6febb2246d4a48765a0aa8563bf, scope.project.id=470cf0437a844f7484bc6b78d5b0de15, user.id=4da9b5c624af4027a3f24e6f759d6d67) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:55.297403 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782363a7-4199-4899-b90c-d1d4439d3ff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:55.298909 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782363a7-4199-4899-b90c-d1d4439d3ff7 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:55.308788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 136/269] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:55 2022] GET /identity/v3/role_assignments?user.id=4da9b5c624af4027a3f24e6f759d6d67&scope.project.id=470cf0437a844f7484bc6b78d5b0de15&role.id=cfd7c6febb2246d4a48765a0aa8563bf => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:55.344726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70ab83-a9eb-4b96-95fa-7bb5fce0236a None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.345068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70ab83-a9eb-4b96-95fa-7bb5fce0236a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.345303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70ab83-a9eb-4b96-95fa-7bb5fce0236a None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.347333 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 134/270] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:55.353092 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8b165-8882-434a-8d25-97bbd2619cfc None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.353392 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8b165-8882-434a-8d25-97bbd2619cfc None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.353674 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8b165-8882-434a-8d25-97bbd2619cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.382489 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-85b8b165-8882-434a-8d25-97bbd2619cfc None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:55.383774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-85b8b165-8882-434a-8d25-97bbd2619cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:55.486728 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 137/271] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:55.514364 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7caf26-daf4-4d61-ba87-55616092143c None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.514709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7caf26-daf4-4d61-ba87-55616092143c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.514998 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7caf26-daf4-4d61-ba87-55616092143c None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.516544 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 135/272] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:55.522230 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce24ad-0372-429f-8eae-1f8a3dd74330 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.522520 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce24ad-0372-429f-8eae-1f8a3dd74330 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.522804 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce24ad-0372-429f-8eae-1f8a3dd74330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.529296 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7caf26-daf4-4d61-ba87-55616092143c None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:55.543604 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-5dce24ad-0372-429f-8eae-1f8a3dd74330 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:55.544847 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5dce24ad-0372-429f-8eae-1f8a3dd74330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:55.627106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 138/273] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:55.628838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a604c-4342-4757-9887-bf01a3f176c8 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.629129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a604c-4342-4757-9887-bf01a3f176c8 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.629452 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a604c-4342-4757-9887-bf01a3f176c8 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.630928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 139/274] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:55.636380 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f5645-3ac5-46c5-ad11-c6663474ad12 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.636741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f5645-3ac5-46c5-ad11-c6663474ad12 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.636971 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f5645-3ac5-46c5-ad11-c6663474ad12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.658447 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-e75f5645-3ac5-46c5-ad11-c6663474ad12 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:55.659631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-e75f5645-3ac5-46c5-ad11-c6663474ad12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:55.686410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:55.698312 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7caf26-daf4-4d61-ba87-55616092143c None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:55.702232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:55.757770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 140/275] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:55.758931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971b3e9-07dd-4c38-987a-fcbcc0696166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:55.759688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971b3e9-07dd-4c38-987a-fcbcc0696166 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.759974 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971b3e9-07dd-4c38-987a-fcbcc0696166 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.760282 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971b3e9-07dd-4c38-987a-fcbcc0696166 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.761462 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971b3e9-07dd-4c38-987a-fcbcc0696166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:55.762932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971b3e9-07dd-4c38-987a-fcbcc0696166 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:55.764711 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 136/276] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:55.765743 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f5645-3ac5-46c5-ad11-c6663474ad12 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:55.770161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971b3e9-07dd-4c38-987a-fcbcc0696166 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:55.873233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f5645-3ac5-46c5-ad11-c6663474ad12 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:55.881777 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971b3e9-07dd-4c38-987a-fcbcc0696166 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:55.910455 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b71d7-4d34-4ffa-89ec-3d8cbdca8fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:55.911540 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b71d7-4d34-4ffa-89ec-3d8cbdca8fe6 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.911831 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b71d7-4d34-4ffa-89ec-3d8cbdca8fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.912114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b71d7-4d34-4ffa-89ec-3d8cbdca8fe6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.918402 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381e13b-b0b4-436b-a5a3-291b1434e117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:55.919088 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381e13b-b0b4-436b-a5a3-291b1434e117 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.919374 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381e13b-b0b4-436b-a5a3-291b1434e117 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.919655 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381e13b-b0b4-436b-a5a3-291b1434e117 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.920373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381e13b-b0b4-436b-a5a3-291b1434e117 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:55.921853 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381e13b-b0b4-436b-a5a3-291b1434e117 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:55.924152 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b71d7-4d34-4ffa-89ec-3d8cbdca8fe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:55.933812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-339b71d7-4d34-4ffa-89ec-3d8cbdca8fe6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:55.933812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:55.933812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:55.933812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:55.933812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:55.933812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:55.933812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:55.933812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:55.933812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:55.933812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:55.933812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:55.933812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:55.933812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:55.933812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:55.933812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:55.933812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:55.938530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:55.938530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:55.938530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:55.938530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:55.938530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:55.938530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:55.938530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:55.938530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:55.938530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:55.938530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:55.938530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:55.938530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:55.938530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:55.938530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:55.938530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:55.938530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:55.939354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:55.939354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:55.939354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:55.939354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:55.939354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:55.939354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:55.939354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:55.939354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:55.939354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:55.939354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:55.939354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:55.939354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:55.939354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 141/277] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:55.940633 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b71d7-4d34-4ffa-89ec-3d8cbdca8fe6 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:55.956023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:56.019804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 137/278] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Jun 16 18:36:55 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:36:56.021002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381e13b-b0b4-436b-a5a3-291b1434e117 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:56.049778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b71d7-4d34-4ffa-89ec-3d8cbdca8fe6 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:56.065798 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:56.089752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4683d3-86ea-4b4a-992b-fe68ea51a742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:56.090675 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4683d3-86ea-4b4a-992b-fe68ea51a742 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:56.091093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4683d3-86ea-4b4a-992b-fe68ea51a742 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:56.091450 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4683d3-86ea-4b4a-992b-fe68ea51a742 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:56.104853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4683d3-86ea-4b4a-992b-fe68ea51a742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:56.113916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-2c4683d3-86ea-4b4a-992b-fe68ea51a742 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:56.113916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:56.113916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:56.113916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:56.113916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:56.113916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:56.113916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:56.113916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:56.113916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:56.113916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:56.113916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:56.113916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:56.113916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:56.113916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:56.113916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:56.113916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:56.114890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:56.114890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:56.114890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:56.114890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:56.114890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:56.114890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:56.114890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:56.114890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:56.114890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:56.114890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:56.114890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:56.114890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:56.114890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:56.114890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:56.114890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:56.114890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:56.125820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:56.125820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:56.125820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:56.125820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:56.125820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:56.125820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:56.125820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:56.125820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:56.125820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:56.125820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:56.125820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:56.125820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:56.125820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 142/279] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:56.125820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4683d3-86ea-4b4a-992b-fe68ea51a742 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:56.169226 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381e13b-b0b4-436b-a5a3-291b1434e117 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:56.218584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd87e0-e88d-41a4-b015-708177ed95ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:56.219264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd87e0-e88d-41a4-b015-708177ed95ee None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:56.219544 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd87e0-e88d-41a4-b015-708177ed95ee None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:56.219822 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd87e0-e88d-41a4-b015-708177ed95ee None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:56.220620 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd87e0-e88d-41a4-b015-708177ed95ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:56.220926 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd87e0-e88d-41a4-b015-708177ed95ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:56.222323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd87e0-e88d-41a4-b015-708177ed95ee None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:56.226272 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:56.233613 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 138/280] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:56.239447 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd87e0-e88d-41a4-b015-708177ed95ee None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:56.259258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4683d3-86ea-4b4a-992b-fe68ea51a742 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:56.308197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4bac1-5637-4508-81d1-53ff7a897b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:56.308880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4bac1-5637-4508-81d1-53ff7a897b2e None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:56.309151 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4bac1-5637-4508-81d1-53ff7a897b2e None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:56.309426 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4bac1-5637-4508-81d1-53ff7a897b2e None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:56.310203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4bac1-5637-4508-81d1-53ff7a897b2e None admin] RBAC: Adding query filter params (name=member) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:56.310513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4bac1-5637-4508-81d1-53ff7a897b2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:56.312719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4bac1-5637-4508-81d1-53ff7a897b2e None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:56.326790 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 143/281] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:56.329740 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4bac1-5637-4508-81d1-53ff7a897b2e None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:56.364670 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:56.379309 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd87e0-e88d-41a4-b015-708177ed95ee None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:56.424072 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2f208-4832-49f8-a58c-de255a8124e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:56.425007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2f208-4832-49f8-a58c-de255a8124e5 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:56.425295 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2f208-4832-49f8-a58c-de255a8124e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:56.425578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2f208-4832-49f8-a58c-de255a8124e5 None admin] PATH_INFO: `/v3/users/91441f65089e4100b33fb1aead090d14` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:56.427566 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2f208-4832-49f8-a58c-de255a8124e5 None admin] RBAC: Authorizing `identity:get_user(user_id=91441f65089e4100b33fb1aead090d14)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:56.429277 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2f208-4832-49f8-a58c-de255a8124e5 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:56.430997 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 139/282] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:56 2022] GET /identity/v3/users/91441f65089e4100b33fb1aead090d14 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:56.432216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eef4db-2507-4e4e-a207-9a5d3526e519 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:56.438354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eef4db-2507-4e4e-a207-9a5d3526e519 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:56.438354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eef4db-2507-4e4e-a207-9a5d3526e519 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:56.438354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 140/283] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:56.439041 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eef4db-2507-4e4e-a207-9a5d3526e519 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:56.453721 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4bac1-5637-4508-81d1-53ff7a897b2e None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:56.490359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455e71c-ff8f-4b74-9c1d-cf2e8297da53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:56.492145 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455e71c-ff8f-4b74-9c1d-cf2e8297da53 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:56.492528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455e71c-ff8f-4b74-9c1d-cf2e8297da53 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:56.492878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455e71c-ff8f-4b74-9c1d-cf2e8297da53 None admin] PATH_INFO: `/v3/users/21ce0722e8274564982f7d8370fac4a2` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:56.495187 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:56.508036 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455e71c-ff8f-4b74-9c1d-cf2e8297da53 None admin] RBAC: Authorizing `identity:get_user(user_id=21ce0722e8274564982f7d8370fac4a2)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:56.512905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455e71c-ff8f-4b74-9c1d-cf2e8297da53 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:56.512905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 144/284] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:56 2022] GET /identity/v3/users/21ce0722e8274564982f7d8370fac4a2 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:56.513352 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34881cf-7250-4834-bb5d-cdf70681a222 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:56.513707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34881cf-7250-4834-bb5d-cdf70681a222 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:56.514152 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34881cf-7250-4834-bb5d-cdf70681a222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:56.531090 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-e34881cf-7250-4834-bb5d-cdf70681a222 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:56.532272 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-e34881cf-7250-4834-bb5d-cdf70681a222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:56.571086 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eef4db-2507-4e4e-a207-9a5d3526e519 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:56.610034 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 145/285] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:56.616594 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34881cf-7250-4834-bb5d-cdf70681a222 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:56.634210 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9822a8-caff-4a39-a53a-cc1d4013e965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:56.635086 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9822a8-caff-4a39-a53a-cc1d4013e965 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:56.635366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9822a8-caff-4a39-a53a-cc1d4013e965 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:56.635640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9822a8-caff-4a39-a53a-cc1d4013e965 None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:56.637732 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9822a8-caff-4a39-a53a-cc1d4013e965 None admin] RBAC: Authorizing `identity:get_project(project_id=470cf0437a844f7484bc6b78d5b0de15)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:56.639199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9822a8-caff-4a39-a53a-cc1d4013e965 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:56.641041 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 141/286] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:56 2022] GET /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:56.643543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9822a8-caff-4a39-a53a-cc1d4013e965 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:56.680667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:56.746187 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34881cf-7250-4834-bb5d-cdf70681a222 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:56.774606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:56.787018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718bfc9-ba17-4738-93d8-59fcf94c1df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:56.788373 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718bfc9-ba17-4738-93d8-59fcf94c1df2 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:56.788774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718bfc9-ba17-4738-93d8-59fcf94c1df2 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:56.789116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718bfc9-ba17-4738-93d8-59fcf94c1df2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:56.790080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718bfc9-ba17-4738-93d8-59fcf94c1df2 None admin] RBAC: Adding query filter params (role.id=34f07ea559bb44a6b3d81c7c1ff19bbc, user.id=21ce0722e8274564982f7d8370fac4a2, scope.system=all) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:56.790699 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718bfc9-ba17-4738-93d8-59fcf94c1df2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:56.792296 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718bfc9-ba17-4738-93d8-59fcf94c1df2 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:56.797839 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 146/287] 10.222.0.93 () {56 vars in 1308 bytes} [Thu Jun 16 18:36:56 2022] GET /identity/v3/role_assignments?user.id=21ce0722e8274564982f7d8370fac4a2&scope.system=all&role.id=34f07ea559bb44a6b3d81c7c1ff19bbc => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:56.798622 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718bfc9-ba17-4738-93d8-59fcf94c1df2 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:56.798867 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9822a8-caff-4a39-a53a-cc1d4013e965 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:56.844961 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23295eee-9747-4d94-8d6c-a0510303449b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:56.845676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23295eee-9747-4d94-8d6c-a0510303449b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:56.845960 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23295eee-9747-4d94-8d6c-a0510303449b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:56.846234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23295eee-9747-4d94-8d6c-a0510303449b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:56.858443 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23295eee-9747-4d94-8d6c-a0510303449b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:56.866267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-23295eee-9747-4d94-8d6c-a0510303449b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:56.866267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:56.866267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:56.866267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:56.866267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:56.866267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:56.866267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:56.866267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:56.866267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:56.866267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:56.866267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:56.866267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:56.866267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:56.866267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:56.866267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:56.866267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:56.867199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:56.867199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:56.867199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:56.867199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:56.867199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:56.867199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:56.867199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:56.867199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:56.867199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:56.867199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:56.867199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:56.867199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:56.867199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:56.867199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:56.867199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:56.867199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:56.868023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:56.868023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:56.868023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:56.868023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:56.868023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:56.868023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:56.868023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:56.868023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:56.868023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:56.868023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:56.868023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:56.868023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:36:56.868023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 142/288] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:56.877482 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23295eee-9747-4d94-8d6c-a0510303449b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:56.937998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718bfc9-ba17-4738-93d8-59fcf94c1df2 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:57.005568 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d9f22-23a3-401a-aae9-6e04396fc2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:57.006503 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d9f22-23a3-401a-aae9-6e04396fc2d8 None admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:57.006781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d9f22-23a3-401a-aae9-6e04396fc2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:57.007052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d9f22-23a3-401a-aae9-6e04396fc2d8 None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15/users/91441f65089e4100b33fb1aead090d14/roles/1a958ec71abb4047bc9427c58b382a2c` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:57.009053 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d9f22-23a3-401a-aae9-6e04396fc2d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=470cf0437a844f7484bc6b78d5b0de15, user_id=91441f65089e4100b33fb1aead090d14, role_id=1a958ec71abb4047bc9427c58b382a2c)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:57.010522 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d9f22-23a3-401a-aae9-6e04396fc2d8 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:57.034161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:57.051193 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23295eee-9747-4d94-8d6c-a0510303449b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:57.086737 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5f530-4a8a-4dad-823c-c15b19a98763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:57.087528 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5f530-4a8a-4dad-823c-c15b19a98763 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:57.087820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5f530-4a8a-4dad-823c-c15b19a98763 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:57.088108 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5f530-4a8a-4dad-823c-c15b19a98763 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:57.088921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5f530-4a8a-4dad-823c-c15b19a98763 None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:57.089318 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5f530-4a8a-4dad-823c-c15b19a98763 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:57.090824 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5f530-4a8a-4dad-823c-c15b19a98763 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:57.098413 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 147/289] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:36:56 2022] PUT /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15/users/91441f65089e4100b33fb1aead090d14/roles/1a958ec71abb4047bc9427c58b382a2c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:36:57.100840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 143/290] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:57.107544 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d9f22-23a3-401a-aae9-6e04396fc2d8 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:57.166359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:57.237349 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d9f22-23a3-401a-aae9-6e04396fc2d8 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:57.286181 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8365b-6ba2-49a5-afc3-fa16511275b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:57.287101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8365b-6ba2-49a5-afc3-fa16511275b7 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:57.287947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8365b-6ba2-49a5-afc3-fa16511275b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:57.288238 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8365b-6ba2-49a5-afc3-fa16511275b7 None admin] PATH_INFO: `/v3/users/17ce749fa1594f08939a19df72337822` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:57.289540 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8365b-6ba2-49a5-afc3-fa16511275b7 None admin] RBAC: Authorizing `identity:get_user(user_id=17ce749fa1594f08939a19df72337822)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:57.291056 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8365b-6ba2-49a5-afc3-fa16511275b7 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:57.292789 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 148/291] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:57 2022] GET /identity/v3/users/17ce749fa1594f08939a19df72337822 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:57.298364 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5f530-4a8a-4dad-823c-c15b19a98763 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:57.458496 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5f530-4a8a-4dad-823c-c15b19a98763 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:57.497718 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b8ae4-7468-4211-8b88-bbd15abbfdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:57.498739 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b8ae4-7468-4211-8b88-bbd15abbfdf8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:57.499234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b8ae4-7468-4211-8b88-bbd15abbfdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:57.499730 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b8ae4-7468-4211-8b88-bbd15abbfdf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:57.517067 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:57.591933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b8ae4-7468-4211-8b88-bbd15abbfdf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:57.593423 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b8ae4-7468-4211-8b88-bbd15abbfdf8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:57.733671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 144/292] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:57.738879 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8365b-6ba2-49a5-afc3-fa16511275b7 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:57.898788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8365b-6ba2-49a5-afc3-fa16511275b7 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:57.913245 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:57.934251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff887fc4-84b6-4334-a13e-37585f76199e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:57.935464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff887fc4-84b6-4334-a13e-37585f76199e None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:57.935905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff887fc4-84b6-4334-a13e-37585f76199e None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:57.936337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff887fc4-84b6-4334-a13e-37585f76199e None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:57.939154 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff887fc4-84b6-4334-a13e-37585f76199e None admin] RBAC: Authorizing `identity:get_project(project_id=470cf0437a844f7484bc6b78d5b0de15)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:57.941254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff887fc4-84b6-4334-a13e-37585f76199e None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:57.943310 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 149/293] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:57 2022] GET /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:57.949197 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b8ae4-7468-4211-8b88-bbd15abbfdf8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:58.020226 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:58.092557 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b8ae4-7468-4211-8b88-bbd15abbfdf8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:58.147024 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd96dcc-79ff-4866-8331-192c0287323b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:58.147974 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd96dcc-79ff-4866-8331-192c0287323b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:58.147974 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd96dcc-79ff-4866-8331-192c0287323b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:58.148301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd96dcc-79ff-4866-8331-192c0287323b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:58.149281 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd96dcc-79ff-4866-8331-192c0287323b None admin] RBAC: Adding query filter params (role.id=34f07ea559bb44a6b3d81c7c1ff19bbc, scope.project.id=470cf0437a844f7484bc6b78d5b0de15, user.id=17ce749fa1594f08939a19df72337822) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:58.149603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd96dcc-79ff-4866-8331-192c0287323b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:58.151219 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd96dcc-79ff-4866-8331-192c0287323b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:58.157926 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 145/294] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:57 2022] GET /identity/v3/role_assignments?user.id=17ce749fa1594f08939a19df72337822&scope.project.id=470cf0437a844f7484bc6b78d5b0de15&role.id=34f07ea559bb44a6b3d81c7c1ff19bbc => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:58.761697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61304b55-b1ce-4e4a-9d02-d11995b72126 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:58.762251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61304b55-b1ce-4e4a-9d02-d11995b72126 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:58.762556 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61304b55-b1ce-4e4a-9d02-d11995b72126 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:58.764370 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 150/295] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:58.770997 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe1908-72d3-4b62-9ae9-9e03134b0bc7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:58.772152 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe1908-72d3-4b62-9ae9-9e03134b0bc7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:58.772709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe1908-72d3-4b62-9ae9-9e03134b0bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:58.792286 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-95fe1908-72d3-4b62-9ae9-9e03134b0bc7 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:58.793813 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-95fe1908-72d3-4b62-9ae9-9e03134b0bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:58.806688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6403d-41ed-4fbe-a41c-95c841ae8a14 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:58.806688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6403d-41ed-4fbe-a41c-95c841ae8a14 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:58.806688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6403d-41ed-4fbe-a41c-95c841ae8a14 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:58.809076 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 151/296] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:58.813196 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ddf00-998f-4312-a656-18fa4b1c7699 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:58.813486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ddf00-998f-4312-a656-18fa4b1c7699 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:58.813768 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ddf00-998f-4312-a656-18fa4b1c7699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:58.834535 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-422ddf00-998f-4312-a656-18fa4b1c7699 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:58.835742 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-422ddf00-998f-4312-a656-18fa4b1c7699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:58.893769 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 146/297] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:58.914817 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 152/298] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:58.921527 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe1908-72d3-4b62-9ae9-9e03134b0bc7 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:58.938578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ddf00-998f-4312-a656-18fa4b1c7699 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:58.969130 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:59.027804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe1908-72d3-4b62-9ae9-9e03134b0bc7 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:59.051403 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ddf00-998f-4312-a656-18fa4b1c7699 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:59.064880 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96c2cc-02e2-494f-93fd-d7bf8419051a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:59.066036 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:59.066556 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96c2cc-02e2-494f-93fd-d7bf8419051a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.067362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96c2cc-02e2-494f-93fd-d7bf8419051a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.067852 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96c2cc-02e2-494f-93fd-d7bf8419051a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.069836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96c2cc-02e2-494f-93fd-d7bf8419051a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:59.071472 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96c2cc-02e2-494f-93fd-d7bf8419051a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:59.073633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 147/299] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:59.079107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96c2cc-02e2-494f-93fd-d7bf8419051a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:59.094959 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30685f-0841-48fb-a79c-95f863fb33a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:59.096048 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30685f-0841-48fb-a79c-95f863fb33a0 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.096338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30685f-0841-48fb-a79c-95f863fb33a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.096650 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30685f-0841-48fb-a79c-95f863fb33a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.109567 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30685f-0841-48fb-a79c-95f863fb33a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:59.120727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-da30685f-0841-48fb-a79c-95f863fb33a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:59.120727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:59.120727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:59.120727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:59.120727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:59.120727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:59.120727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:59.120727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:59.120727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:59.120727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:59.120727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:59.120727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:59.120727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:59.120727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:59.120727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:59.120727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:59.121631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:59.121631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:59.121631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:59.121631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:59.121631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:59.121631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:59.121631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:59.121631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:59.121631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:59.121631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:59.121631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:59.121631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:59.121631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:59.121631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:59.121631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:59.121631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:59.122424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:59.122424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:59.122424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:59.122424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:59.122424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:59.122424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:59.122424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:59.122424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:59.122424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:59.122424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:59.122424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:59.122424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:36:59.122424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 153/300] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:59.129069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30685f-0841-48fb-a79c-95f863fb33a0 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:59.214453 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96c2cc-02e2-494f-93fd-d7bf8419051a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:59.227616 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:59.240329 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30685f-0841-48fb-a79c-95f863fb33a0 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:59.261467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844be442-002f-44dc-b16d-d470a79ba7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:59.262423 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844be442-002f-44dc-b16d-d470a79ba7e5 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.262914 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844be442-002f-44dc-b16d-d470a79ba7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.268323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844be442-002f-44dc-b16d-d470a79ba7e5 None admin] PATH_INFO: `/v3/groups` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.269245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844be442-002f-44dc-b16d-d470a79ba7e5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:59.270889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844be442-002f-44dc-b16d-d470a79ba7e5 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:59.289237 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295b0a6-2b87-43d1-af4c-64b0d57838dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:59.289237 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295b0a6-2b87-43d1-af4c-64b0d57838dc None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.289237 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295b0a6-2b87-43d1-af4c-64b0d57838dc None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.289237 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295b0a6-2b87-43d1-af4c-64b0d57838dc None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.289757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295b0a6-2b87-43d1-af4c-64b0d57838dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:59.289757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295b0a6-2b87-43d1-af4c-64b0d57838dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:59.289757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295b0a6-2b87-43d1-af4c-64b0d57838dc None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:59.294492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 154/301] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:59.299027 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1e14f-c936-478a-8850-476a5454874b None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.299027 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1e14f-c936-478a-8850-476a5454874b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.299027 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1e14f-c936-478a-8850-476a5454874b None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.299027 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 155/302] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:59.300021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1e14f-c936-478a-8850-476a5454874b None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:59.335636 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:59.350313 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 148/303] 10.222.0.93 () {60 vars in 1134 bytes} [Thu Jun 16 18:36:59 2022] POST /identity/v3/groups => generated 229 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:36:59.352018 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15012755-398b-42e6-8700-8f85d361589a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.352666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15012755-398b-42e6-8700-8f85d361589a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.352960 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15012755-398b-42e6-8700-8f85d361589a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.370929 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-15012755-398b-42e6-8700-8f85d361589a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:59.372324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-15012755-398b-42e6-8700-8f85d361589a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:59.421733 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1e14f-c936-478a-8850-476a5454874b None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:59.462434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b4801-3049-497a-b92e-3961e5137091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:59.463617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b4801-3049-497a-b92e-3961e5137091 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.464050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b4801-3049-497a-b92e-3961e5137091 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.464496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b4801-3049-497a-b92e-3961e5137091 None admin] PATH_INFO: `/v3/users/21f2b2fafd7044e18ce913ae2939bb03` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.469135 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 149/304] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:59.485615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b4801-3049-497a-b92e-3961e5137091 None admin] RBAC: Authorizing `identity:get_user(user_id=21f2b2fafd7044e18ce913ae2939bb03)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:59.487382 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b4801-3049-497a-b92e-3961e5137091 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:59.489484 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 156/305] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:59 2022] GET /identity/v3/users/21f2b2fafd7044e18ce913ae2939bb03 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:59.494941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15012755-398b-42e6-8700-8f85d361589a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:59.498648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b4801-3049-497a-b92e-3961e5137091 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:59.614299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:59.618143 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:59.623541 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15012755-398b-42e6-8700-8f85d361589a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:59.628256 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b4801-3049-497a-b92e-3961e5137091 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:59.665742 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c22b9-a073-4d0d-b49f-524b57d31996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:59.666660 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c22b9-a073-4d0d-b49f-524b57d31996 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.667044 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c22b9-a073-4d0d-b49f-524b57d31996 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.667387 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c22b9-a073-4d0d-b49f-524b57d31996 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.677657 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4d0a0-ba7c-4bb7-bbc2-507125c3e81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:59.678340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4d0a0-ba7c-4bb7-bbc2-507125c3e81d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.678616 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4d0a0-ba7c-4bb7-bbc2-507125c3e81d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.678894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4d0a0-ba7c-4bb7-bbc2-507125c3e81d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.679903 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4d0a0-ba7c-4bb7-bbc2-507125c3e81d None admin] RBAC: Adding query filter params (role.id=1a958ec71abb4047bc9427c58b382a2c, user.id=21f2b2fafd7044e18ce913ae2939bb03, scope.system=all) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:59.680229 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4d0a0-ba7c-4bb7-bbc2-507125c3e81d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:59.682007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4d0a0-ba7c-4bb7-bbc2-507125c3e81d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:59.684323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c22b9-a073-4d0d-b49f-524b57d31996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:59.687838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 157/306] 10.222.0.93 () {56 vars in 1308 bytes} [Thu Jun 16 18:36:59 2022] GET /identity/v3/role_assignments?user.id=21f2b2fafd7044e18ce913ae2939bb03&scope.system=all&role.id=1a958ec71abb4047bc9427c58b382a2c => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:59.694435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-4b4c22b9-a073-4d0d-b49f-524b57d31996 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:59.694435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:59.694435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:59.694435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:59.694435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:59.694435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:59.694435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:59.694435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:59.694435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:59.694435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:59.694435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:59.694435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:59.694435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:59.694435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:59.694435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:59.694435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:59.695405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:59.695405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:59.695405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:59.695405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:59.695405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:59.695405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:59.695405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:59.695405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:59.695405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:59.695405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:59.695405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:59.695405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:59.695405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:59.695405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:59.695405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:59.695405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:59.696214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:59.696214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:59.696214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:59.696214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:59.696214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:59.696214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:59.696214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:59.696214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:59.696214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:59.696214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:59.696214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:59.696214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:36:59.704130 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 150/307] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:59.706018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4d0a0-ba7c-4bb7-bbc2-507125c3e81d None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:59.825101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4d0a0-ba7c-4bb7-bbc2-507125c3e81d None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:59.864093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70970c4a-5f03-4e06-b090-4b05a5e51a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:59.865393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70970c4a-5f03-4e06-b090-4b05a5e51a24 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.865629 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70970c4a-5f03-4e06-b090-4b05a5e51a24 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.865905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70970c4a-5f03-4e06-b090-4b05a5e51a24 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.866673 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70970c4a-5f03-4e06-b090-4b05a5e51a24 None admin] RBAC: Adding query filter params (name=member) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:59.867830 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70970c4a-5f03-4e06-b090-4b05a5e51a24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:59.868544 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b4fb5-f9f6-4d15-9986-790c428e933e None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.868836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b4fb5-f9f6-4d15-9986-790c428e933e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.869112 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b4fb5-f9f6-4d15-9986-790c428e933e None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.869316 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70970c4a-5f03-4e06-b090-4b05a5e51a24 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:59.870611 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 151/308] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:59.875654 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec8882-854a-4219-b102-6b4a40003a56 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.875951 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec8882-854a-4219-b102-6b4a40003a56 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.876235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec8882-854a-4219-b102-6b4a40003a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.881440 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 158/309] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:59.886928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70970c4a-5f03-4e06-b090-4b05a5e51a24 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:59.895560 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-0aec8882-854a-4219-b102-6b4a40003a56 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:59.897066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0aec8882-854a-4219-b102-6b4a40003a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:59.906541 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:59.972401 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 152/310] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:59.996031 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec8882-854a-4219-b102-6b4a40003a56 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:00.007441 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70970c4a-5f03-4e06-b090-4b05a5e51a24 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:00.042944 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec678e-b6de-4f6c-a775-03ee0d57b1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:00.044087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec678e-b6de-4f6c-a775-03ee0d57b1ec None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:00.044603 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec678e-b6de-4f6c-a775-03ee0d57b1ec None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:00.045018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec678e-b6de-4f6c-a775-03ee0d57b1ec None admin] PATH_INFO: `/v3/users/21ce0722e8274564982f7d8370fac4a2` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:00.046362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec678e-b6de-4f6c-a775-03ee0d57b1ec None admin] RBAC: Authorizing `identity:get_user(user_id=21ce0722e8274564982f7d8370fac4a2)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:00.047998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec678e-b6de-4f6c-a775-03ee0d57b1ec None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:00.050109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 159/311] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:59 2022] GET /identity/v3/users/21ce0722e8274564982f7d8370fac4a2 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:00.058379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec678e-b6de-4f6c-a775-03ee0d57b1ec None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:00.088186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:00.102343 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec8882-854a-4219-b102-6b4a40003a56 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:00.139672 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5e627-8fdf-4041-9da6-31917d1cae11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:00.140784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5e627-8fdf-4041-9da6-31917d1cae11 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:00.141275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5e627-8fdf-4041-9da6-31917d1cae11 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:00.141735 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5e627-8fdf-4041-9da6-31917d1cae11 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:00.152846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:00.152992 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5e627-8fdf-4041-9da6-31917d1cae11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:00.160935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-33a5e627-8fdf-4041-9da6-31917d1cae11 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:37:00.160935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:00.160935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:00.160935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:00.160935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:00.160935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:00.160935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:00.160935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:00.160935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:00.160935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:00.160935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:00.160935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:00.160935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:00.160935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:00.160935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:00.160935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:00.162404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:00.162404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:00.162404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:00.162404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:00.162404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:00.162404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:00.162404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:00.162404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:00.162404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:00.162404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:00.162404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:00.162404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:00.162404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:00.162404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:00.162404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:00.162404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:00.163204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:00.163204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:00.163204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:00.163204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:00.163204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:00.163204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:00.163204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:00.163204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:00.163204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:00.163204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:00.163204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:37:00.163204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:00.165003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec678e-b6de-4f6c-a775-03ee0d57b1ec None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:00.165675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 153/312] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:00.171426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5e627-8fdf-4041-9da6-31917d1cae11 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:00.208114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555b01b-f6fd-4a23-992e-8bf3525d08c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:00.209650 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555b01b-f6fd-4a23-992e-8bf3525d08c4 None admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:00.209917 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555b01b-f6fd-4a23-992e-8bf3525d08c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:00.210197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555b01b-f6fd-4a23-992e-8bf3525d08c4 None admin] PATH_INFO: `/v3/system/users/21ce0722e8274564982f7d8370fac4a2/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:00.216457 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555b01b-f6fd-4a23-992e-8bf3525d08c4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=21ce0722e8274564982f7d8370fac4a2, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:00.216457 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555b01b-f6fd-4a23-992e-8bf3525d08c4 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:00.290954 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5e627-8fdf-4041-9da6-31917d1cae11 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:00.304218 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 160/313] 10.222.0.93 () {58 vars in 1334 bytes} [Thu Jun 16 18:37:00 2022] PUT /identity/v3/system/users/21ce0722e8274564982f7d8370fac4a2/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:00.336301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1761e-2d38-4f45-ac55-6d40f4c739ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:00.337092 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1761e-2d38-4f45-ac55-6d40f4c739ca None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:00.337398 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1761e-2d38-4f45-ac55-6d40f4c739ca None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:00.337681 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1761e-2d38-4f45-ac55-6d40f4c739ca None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:00.338531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1761e-2d38-4f45-ac55-6d40f4c739ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:00.338841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1761e-2d38-4f45-ac55-6d40f4c739ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:00.340468 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1761e-2d38-4f45-ac55-6d40f4c739ca None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:00.350933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 154/314] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:37:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:00.356746 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555b01b-f6fd-4a23-992e-8bf3525d08c4 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:00.467811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555b01b-f6fd-4a23-992e-8bf3525d08c4 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:00.507461 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639fb5c-91da-455a-89e3-d3ea1338c7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:00.508681 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639fb5c-91da-455a-89e3-d3ea1338c7d4 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:00.509132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639fb5c-91da-455a-89e3-d3ea1338c7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:00.509557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639fb5c-91da-455a-89e3-d3ea1338c7d4 None admin] PATH_INFO: `/v3/users/91441f65089e4100b33fb1aead090d14` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:00.511043 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639fb5c-91da-455a-89e3-d3ea1338c7d4 None admin] RBAC: Authorizing `identity:get_user(user_id=91441f65089e4100b33fb1aead090d14)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:00.512684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639fb5c-91da-455a-89e3-d3ea1338c7d4 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:00.514780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 161/315] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:37:00 2022] GET /identity/v3/users/91441f65089e4100b33fb1aead090d14 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:00.520428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1761e-2d38-4f45-ac55-6d40f4c739ca None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:00.534975 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:00.629691 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1761e-2d38-4f45-ac55-6d40f4c739ca None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:00.664842 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61104b7-60b2-4fc6-bb95-3756389877fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:00.665648 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61104b7-60b2-4fc6-bb95-3756389877fd None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:00.666057 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61104b7-60b2-4fc6-bb95-3756389877fd None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:00.666439 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61104b7-60b2-4fc6-bb95-3756389877fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:00.737082 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61104b7-60b2-4fc6-bb95-3756389877fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:00.738627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61104b7-60b2-4fc6-bb95-3756389877fd None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:00.749974 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:00.860390 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 155/316] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:00.866000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639fb5c-91da-455a-89e3-d3ea1338c7d4 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:00.889054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:00.970985 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639fb5c-91da-455a-89e3-d3ea1338c7d4 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:01.007559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703992f-2427-4814-ac4a-f5e532a0eea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:01.009348 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703992f-2427-4814-ac4a-f5e532a0eea8 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:01.010058 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703992f-2427-4814-ac4a-f5e532a0eea8 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:01.010749 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703992f-2427-4814-ac4a-f5e532a0eea8 None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:01.012653 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703992f-2427-4814-ac4a-f5e532a0eea8 None admin] RBAC: Authorizing `identity:get_project(project_id=470cf0437a844f7484bc6b78d5b0de15)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:01.014279 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703992f-2427-4814-ac4a-f5e532a0eea8 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:01.016145 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 162/317] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:00 2022] GET /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:01.022830 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61104b7-60b2-4fc6-bb95-3756389877fd None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:01.128399 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61104b7-60b2-4fc6-bb95-3756389877fd None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:01.140267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:01.165631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f591b3-233a-4c05-90c6-34008e338a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:01.166322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f591b3-233a-4c05-90c6-34008e338a42 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:01.166606 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f591b3-233a-4c05-90c6-34008e338a42 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:01.166884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f591b3-233a-4c05-90c6-34008e338a42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:01.167738 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f591b3-233a-4c05-90c6-34008e338a42 None admin] RBAC: Adding query filter params (role.id=1a958ec71abb4047bc9427c58b382a2c, scope.project.id=470cf0437a844f7484bc6b78d5b0de15, user.id=91441f65089e4100b33fb1aead090d14) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:01.168058 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f591b3-233a-4c05-90c6-34008e338a42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:01.169566 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f591b3-233a-4c05-90c6-34008e338a42 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:01.176641 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 156/318] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:01 2022] GET /identity/v3/role_assignments?user.id=91441f65089e4100b33fb1aead090d14&scope.project.id=470cf0437a844f7484bc6b78d5b0de15&role.id=1a958ec71abb4047bc9427c58b382a2c => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:01.628590 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b656c2-2ba8-42a7-b285-267eefc8ed34 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:01.628935 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b656c2-2ba8-42a7-b285-267eefc8ed34 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:01.629112 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b656c2-2ba8-42a7-b285-267eefc8ed34 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:01.630620 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 163/319] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:01.635579 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d791fc3-a7b5-4f80-a13d-b1dca849629a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:01.636025 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d791fc3-a7b5-4f80-a13d-b1dca849629a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:01.636189 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d791fc3-a7b5-4f80-a13d-b1dca849629a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:01.652925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-2d791fc3-a7b5-4f80-a13d-b1dca849629a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:01.654112 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2d791fc3-a7b5-4f80-a13d-b1dca849629a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:01.722361 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 157/320] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:01.745072 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b656c2-2ba8-42a7-b285-267eefc8ed34 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:01.834281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:01.851383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b656c2-2ba8-42a7-b285-267eefc8ed34 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:01.889383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2daf3-c28e-42cb-b3e1-0cf10a7fe4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:01.890110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2daf3-c28e-42cb-b3e1-0cf10a7fe4c1 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:01.890395 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2daf3-c28e-42cb-b3e1-0cf10a7fe4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:01.890677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2daf3-c28e-42cb-b3e1-0cf10a7fe4c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:01.891847 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2daf3-c28e-42cb-b3e1-0cf10a7fe4c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:01.893327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2daf3-c28e-42cb-b3e1-0cf10a7fe4c1 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:01.895110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 164/321] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:01.901096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d791fc3-a7b5-4f80-a13d-b1dca849629a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:01.914615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975da7d-4e96-4204-b959-cf6a52355781 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:01.914914 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975da7d-4e96-4204-b959-cf6a52355781 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:01.915196 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975da7d-4e96-4204-b959-cf6a52355781 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:01.916813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 165/322] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:37:01.921393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9f06a-8d96-44b0-b8ae-df04b08cf9b5 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:01.921685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9f06a-8d96-44b0-b8ae-df04b08cf9b5 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:01.921971 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9f06a-8d96-44b0-b8ae-df04b08cf9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:01.938609 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-2ec9f06a-8d96-44b0-b8ae-df04b08cf9b5 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:01.939792 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2ec9f06a-8d96-44b0-b8ae-df04b08cf9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:02.006068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d791fc3-a7b5-4f80-a13d-b1dca849629a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:02.008176 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 166/323] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:37:02.009640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:02.039357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9f06a-8d96-44b0-b8ae-df04b08cf9b5 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:02.041116 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355df117-4fde-43e4-a713-7bd94af2d403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:02.042187 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355df117-4fde-43e4-a713-7bd94af2d403 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:02.043092 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355df117-4fde-43e4-a713-7bd94af2d403 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:02.044478 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355df117-4fde-43e4-a713-7bd94af2d403 None admin] PATH_INFO: `/v3/groups` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:02.044478 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355df117-4fde-43e4-a713-7bd94af2d403 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:02.045771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355df117-4fde-43e4-a713-7bd94af2d403 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:02.126701 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 158/324] 10.222.0.93 () {60 vars in 1134 bytes} [Thu Jun 16 18:37:01 2022] POST /identity/v3/groups => generated 226 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:37:02.128670 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:02.146931 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9f06a-8d96-44b0-b8ae-df04b08cf9b5 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:02.184845 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99466211-d0a7-4bf6-b3ce-51f451e710ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:02.186181 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99466211-d0a7-4bf6-b3ce-51f451e710ed None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:02.186615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99466211-d0a7-4bf6-b3ce-51f451e710ed None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:02.187067 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99466211-d0a7-4bf6-b3ce-51f451e710ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:02.199398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99466211-d0a7-4bf6-b3ce-51f451e710ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:02.208592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-99466211-d0a7-4bf6-b3ce-51f451e710ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:37:02.208592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:02.208592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:02.208592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:02.208592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:02.208592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:02.208592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:02.208592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:02.208592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:02.208592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:02.208592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:02.208592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:02.208592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:02.208592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:02.208592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:02.208592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:02.209621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:02.209621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:02.209621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:02.209621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:02.209621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:02.209621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:02.209621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:02.209621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:02.209621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:02.209621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:02.209621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:02.209621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:02.209621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:02.209621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:02.209621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:02.209621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:02.210435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:02.210435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:02.210435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:02.210435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:02.210435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:02.210435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:02.210435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:02.210435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:02.210435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:02.210435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:02.210435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:37:02.210435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:02.211345 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 167/325] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:02.217341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355df117-4fde-43e4-a713-7bd94af2d403 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:02.335037 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355df117-4fde-43e4-a713-7bd94af2d403 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:02.374210 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb420e-ddd0-457c-a2be-36c7cde606b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:02.375212 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb420e-ddd0-457c-a2be-36c7cde606b8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:02.375712 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb420e-ddd0-457c-a2be-36c7cde606b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:02.376258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb420e-ddd0-457c-a2be-36c7cde606b8 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:02.377228 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb420e-ddd0-457c-a2be-36c7cde606b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:02.377539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb420e-ddd0-457c-a2be-36c7cde606b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:02.378923 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb420e-ddd0-457c-a2be-36c7cde606b8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:02.388084 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 159/326] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:37:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:02.393647 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99466211-d0a7-4bf6-b3ce-51f451e710ed None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:02.502898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99466211-d0a7-4bf6-b3ce-51f451e710ed None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:02.540118 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cce6f7-9c31-463b-8a73-8235657ff6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:02.541049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cce6f7-9c31-463b-8a73-8235657ff6c6 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:02.541332 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cce6f7-9c31-463b-8a73-8235657ff6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:02.541609 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cce6f7-9c31-463b-8a73-8235657ff6c6 None admin] PATH_INFO: `/v3/users/21f2b2fafd7044e18ce913ae2939bb03` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:02.542910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cce6f7-9c31-463b-8a73-8235657ff6c6 None admin] RBAC: Authorizing `identity:get_user(user_id=21f2b2fafd7044e18ce913ae2939bb03)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:02.546641 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cce6f7-9c31-463b-8a73-8235657ff6c6 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:02.548475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 168/327] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:37:02 2022] GET /identity/v3/users/21f2b2fafd7044e18ce913ae2939bb03 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:02.557848 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb420e-ddd0-457c-a2be-36c7cde606b8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:02.595582 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:02.613490 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c51bbb-598a-49d8-b283-4d1147a4e570 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:02.613777 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c51bbb-598a-49d8-b283-4d1147a4e570 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:02.614687 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c51bbb-598a-49d8-b283-4d1147a4e570 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:02.616242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 169/328] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:37:02.622617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef45b4-930f-46a3-ab3b-ba03f925d114 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:02.622922 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef45b4-930f-46a3-ab3b-ba03f925d114 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:02.623189 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef45b4-930f-46a3-ab3b-ba03f925d114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:02.647537 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-35ef45b4-930f-46a3-ab3b-ba03f925d114 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:02.649152 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-35ef45b4-930f-46a3-ab3b-ba03f925d114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:02.657951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:02.685385 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb420e-ddd0-457c-a2be-36c7cde606b8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:02.731339 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e10dd-eeda-4f43-bae9-c95425c6c8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:02.733457 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e10dd-eeda-4f43-bae9-c95425c6c8fd None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:02.733457 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e10dd-eeda-4f43-bae9-c95425c6c8fd None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:02.733457 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e10dd-eeda-4f43-bae9-c95425c6c8fd None admin] PATH_INFO: `/v3/system/users/21f2b2fafd7044e18ce913ae2939bb03/roles/1a958ec71abb4047bc9427c58b382a2c` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:02.740336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 170/329] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:37:02.741316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e10dd-eeda-4f43-bae9-c95425c6c8fd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=21f2b2fafd7044e18ce913ae2939bb03, role_id=1a958ec71abb4047bc9427c58b382a2c)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:02.742719 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e10dd-eeda-4f43-bae9-c95425c6c8fd None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:02.765201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef45b4-930f-46a3-ab3b-ba03f925d114 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:02.802779 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 160/330] 10.222.0.93 () {58 vars in 1334 bytes} [Thu Jun 16 18:37:02 2022] PUT /identity/v3/system/users/21f2b2fafd7044e18ce913ae2939bb03/roles/1a958ec71abb4047bc9427c58b382a2c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:02.907594 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef45b4-930f-46a3-ab3b-ba03f925d114 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:02.953193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd604e30-c28a-4573-9517-3d8970a94fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:02.954023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd604e30-c28a-4573-9517-3d8970a94fc3 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:02.954311 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd604e30-c28a-4573-9517-3d8970a94fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:02.954677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd604e30-c28a-4573-9517-3d8970a94fc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:02.971671 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd604e30-c28a-4573-9517-3d8970a94fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:02.980709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-cd604e30-c28a-4573-9517-3d8970a94fc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:37:02.980709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:02.980709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:02.980709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:02.980709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:02.980709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:02.980709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:02.980709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:02.980709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:02.980709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:02.980709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:02.980709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:02.980709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:02.980709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:02.980709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:02.980709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:02.981664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:02.981664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:02.981664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:02.981664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:02.981664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:02.981664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:02.981664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:02.981664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:02.981664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:02.981664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:02.981664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:02.981664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:02.981664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:02.981664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:02.981664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:02.981664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:02.982473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:02.982473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:02.982473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:02.982473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:02.982473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:02.982473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:02.982473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:02.982473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:02.982473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:02.982473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:02.982473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:37:02.982473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:02.986338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 171/331] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:02.987770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e10dd-eeda-4f43-bae9-c95425c6c8fd None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:03.088205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:03.097331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e10dd-eeda-4f43-bae9-c95425c6c8fd None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:03.150206 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48e6c4-1a0c-4640-91a2-2217dde7a12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:03.150973 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48e6c4-1a0c-4640-91a2-2217dde7a12a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:03.151265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48e6c4-1a0c-4640-91a2-2217dde7a12a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:03.151550 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48e6c4-1a0c-4640-91a2-2217dde7a12a None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:03.152408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48e6c4-1a0c-4640-91a2-2217dde7a12a None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:03.152742 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48e6c4-1a0c-4640-91a2-2217dde7a12a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:03.154224 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48e6c4-1a0c-4640-91a2-2217dde7a12a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:03.169254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 161/332] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:37:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:03.175020 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd604e30-c28a-4573-9517-3d8970a94fc3 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:03.179513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:03.313358 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd604e30-c28a-4573-9517-3d8970a94fc3 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:03.356871 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950bc34-3f9b-4bbf-b8ab-10711e1ce81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:03.357693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950bc34-3f9b-4bbf-b8ab-10711e1ce81a None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:03.358149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950bc34-3f9b-4bbf-b8ab-10711e1ce81a None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:03.358430 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950bc34-3f9b-4bbf-b8ab-10711e1ce81a None admin] PATH_INFO: `/v3/users/21ce0722e8274564982f7d8370fac4a2` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:03.360336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950bc34-3f9b-4bbf-b8ab-10711e1ce81a None admin] RBAC: Authorizing `identity:get_user(user_id=21ce0722e8274564982f7d8370fac4a2)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:03.361821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950bc34-3f9b-4bbf-b8ab-10711e1ce81a None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:03.363760 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 172/333] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:37:03 2022] GET /identity/v3/users/21ce0722e8274564982f7d8370fac4a2 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:03.370615 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48e6c4-1a0c-4640-91a2-2217dde7a12a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:03.510264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48e6c4-1a0c-4640-91a2-2217dde7a12a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:03.551019 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881b049-5d33-4bf4-84fc-0fd6a2f8a856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:03.552224 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881b049-5d33-4bf4-84fc-0fd6a2f8a856 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:03.552524 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881b049-5d33-4bf4-84fc-0fd6a2f8a856 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:03.552800 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881b049-5d33-4bf4-84fc-0fd6a2f8a856 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:03.553641 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881b049-5d33-4bf4-84fc-0fd6a2f8a856 None admin] RBAC: Adding query filter params (role.id=34f07ea559bb44a6b3d81c7c1ff19bbc, user.id=21ce0722e8274564982f7d8370fac4a2, scope.system=all) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:03.553951 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881b049-5d33-4bf4-84fc-0fd6a2f8a856 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:03.555395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881b049-5d33-4bf4-84fc-0fd6a2f8a856 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:03.568332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 162/334] 10.222.0.93 () {56 vars in 1308 bytes} [Thu Jun 16 18:37:03 2022] GET /identity/v3/role_assignments?user.id=21ce0722e8274564982f7d8370fac4a2&scope.system=all&role.id=34f07ea559bb44a6b3d81c7c1ff19bbc => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:05.100684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be058a-9726-4bcc-82c5-d453f87d766b None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:05.101265 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be058a-9726-4bcc-82c5-d453f87d766b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:05.101265 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be058a-9726-4bcc-82c5-d453f87d766b None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:05.102836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 173/335] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:05.108243 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdab0be-6542-481a-9f2b-a67edee70737 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:05.108727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdab0be-6542-481a-9f2b-a67edee70737 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:05.108809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdab0be-6542-481a-9f2b-a67edee70737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:05.130793 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4fdab0be-6542-481a-9f2b-a67edee70737 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:05.131991 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4fdab0be-6542-481a-9f2b-a67edee70737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:05.134940 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:05.219240 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 163/336] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:05.254932 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be058a-9726-4bcc-82c5-d453f87d766b None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:05.356189 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:05.402005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be058a-9726-4bcc-82c5-d453f87d766b None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:05.449368 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634ab7c-048f-497e-af4e-cb6f821f2f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:05.450185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634ab7c-048f-497e-af4e-cb6f821f2f9e None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:05.450471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634ab7c-048f-497e-af4e-cb6f821f2f9e None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:05.450750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634ab7c-048f-497e-af4e-cb6f821f2f9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:05.466025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634ab7c-048f-497e-af4e-cb6f821f2f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:05.474197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-d634ab7c-048f-497e-af4e-cb6f821f2f9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:37:05.474197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:05.474197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:05.474197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:05.474197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:05.474197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:05.474197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:05.474197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:05.474197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:05.474197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:05.474197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:05.474197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:05.474197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:05.474197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:05.474197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:05.474197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:05.475155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:05.475155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:05.475155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:05.475155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:05.475155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:05.475155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:05.475155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:05.475155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:05.475155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:05.475155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:05.475155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:05.475155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:05.475155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:05.475155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:05.475155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:05.475155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:05.476401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:05.476401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:05.476401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:05.476401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:05.476401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:05.476401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:05.476401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:05.476401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:05.476401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:05.476401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:05.476401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:37:05.476401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:05.476401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 174/337] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:05.481535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdab0be-6542-481a-9f2b-a67edee70737 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:05.485131 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10153db9-7bdb-4414-b7d8-8d32e41dea73 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:05.485667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10153db9-7bdb-4414-b7d8-8d32e41dea73 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:05.486162 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10153db9-7bdb-4414-b7d8-8d32e41dea73 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:05.487730 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 175/338] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:37:05.496188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee260b6-0d3f-40f3-832e-8333c8e66a68 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:05.496835 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee260b6-0d3f-40f3-832e-8333c8e66a68 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:05.497339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee260b6-0d3f-40f3-832e-8333c8e66a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:05.523937 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-1ee260b6-0d3f-40f3-832e-8333c8e66a68 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:05.526265 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-1ee260b6-0d3f-40f3-832e-8333c8e66a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:05.674886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 176/339] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:37:05.692727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdab0be-6542-481a-9f2b-a67edee70737 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:05.727066 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee260b6-0d3f-40f3-832e-8333c8e66a68 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:05.758206 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ed93a-87a5-4561-beea-d6a9c3c2eddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:05.758902 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ed93a-87a5-4561-beea-d6a9c3c2eddc None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:05.759184 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ed93a-87a5-4561-beea-d6a9c3c2eddc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:05.759458 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ed93a-87a5-4561-beea-d6a9c3c2eddc None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:05.760222 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ed93a-87a5-4561-beea-d6a9c3c2eddc None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:05.760555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ed93a-87a5-4561-beea-d6a9c3c2eddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:05.761939 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ed93a-87a5-4561-beea-d6a9c3c2eddc None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:05.779936 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 164/340] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:37:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:05.785573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ed93a-87a5-4561-beea-d6a9c3c2eddc None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:05.791024 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:05.859063 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:05.947228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee260b6-0d3f-40f3-832e-8333c8e66a68 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:05.972059 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ed93a-87a5-4561-beea-d6a9c3c2eddc None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:05.990023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0714211-d66c-49e0-94f1-473f3190aa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:05.990847 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0714211-d66c-49e0-94f1-473f3190aa00 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:05.991132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0714211-d66c-49e0-94f1-473f3190aa00 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:05.991411 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0714211-d66c-49e0-94f1-473f3190aa00 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:06.002906 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0714211-d66c-49e0-94f1-473f3190aa00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:06.013278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-b0714211-d66c-49e0-94f1-473f3190aa00 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:06.013278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:06.013278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:06.013278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:06.013278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:06.013278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:06.013278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:06.013278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:06.013278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:06.013278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:06.013278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:06.013278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:06.013278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:06.013278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:06.013278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:06.013278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:06.014211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:06.014211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:06.014211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:06.014211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:06.014211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:06.014211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:06.014211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:06.014211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:06.014211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:06.014211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:06.014211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:06.014211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:06.014211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:06.014211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:06.014211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:06.014211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:06.015438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:06.015438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:06.015438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:06.015438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:06.015438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:06.015438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:06.015438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:06.015438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:06.015438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:06.015438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:06.015438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:06.015438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:06.015438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 177/341] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:37:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:06.016132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31608eb6-ca9d-4c86-a3dd-6ebe8db8249d None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:06.016415 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31608eb6-ca9d-4c86-a3dd-6ebe8db8249d None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:06.016597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31608eb6-ca9d-4c86-a3dd-6ebe8db8249d None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:06.017892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 178/342] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:06.024466 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da645b3b-c722-4ec5-a42a-41de50a9661e None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:06.024466 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da645b3b-c722-4ec5-a42a-41de50a9661e None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:06.024466 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da645b3b-c722-4ec5-a42a-41de50a9661e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:06.039515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2090c-be2a-4575-be33-911e48be0c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:06.040573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2090c-be2a-4575-be33-911e48be0c7c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:06.041208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2090c-be2a-4575-be33-911e48be0c7c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:06.041719 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2090c-be2a-4575-be33-911e48be0c7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:06.041905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-da645b3b-c722-4ec5-a42a-41de50a9661e None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:06.044491 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-da645b3b-c722-4ec5-a42a-41de50a9661e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:06.131600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 179/343] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:37:06.133121 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da645b3b-c722-4ec5-a42a-41de50a9661e None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:06.209562 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2090c-be2a-4575-be33-911e48be0c7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:06.211031 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2090c-be2a-4575-be33-911e48be0c7c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:06.215212 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:06.236851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:06.350194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da645b3b-c722-4ec5-a42a-41de50a9661e None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:06.401866 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 165/344] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:06.402726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2090c-be2a-4575-be33-911e48be0c7c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:06.416710 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d2184-9f38-4755-b098-3f610e14b8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:06.417664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d2184-9f38-4755-b098-3f610e14b8f9 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:06.417963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d2184-9f38-4755-b098-3f610e14b8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:06.418245 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d2184-9f38-4755-b098-3f610e14b8f9 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:06.419069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d2184-9f38-4755-b098-3f610e14b8f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:06.419429 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d2184-9f38-4755-b098-3f610e14b8f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:06.420926 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d2184-9f38-4755-b098-3f610e14b8f9 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:06.436462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 180/345] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:06.436462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b58908-7f19-47f7-8a34-d65b989ac906 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:06.436462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b58908-7f19-47f7-8a34-d65b989ac906 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:06.436462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b58908-7f19-47f7-8a34-d65b989ac906 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:06.436462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 181/346] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:06.437148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b58908-7f19-47f7-8a34-d65b989ac906 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:06.534604 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2090c-be2a-4575-be33-911e48be0c7c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:06.536248 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:06.565810 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b58908-7f19-47f7-8a34-d65b989ac906 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:06.577429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8beabb-183f-42c6-a338-6f1a3fa0399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:06.578231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8beabb-183f-42c6-a338-6f1a3fa0399f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:06.578525 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8beabb-183f-42c6-a338-6f1a3fa0399f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:06.578804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8beabb-183f-42c6-a338-6f1a3fa0399f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:06.584034 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:06.594364 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8beabb-183f-42c6-a338-6f1a3fa0399f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:06.606638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-8e8beabb-183f-42c6-a338-6f1a3fa0399f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:37:06.606638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:06.606638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:06.606638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:06.606638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:06.606638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:06.606638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:06.606638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:06.606638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:06.606638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:06.606638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:06.606638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:06.606638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:06.606638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:06.606638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:06.606638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:06.607609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:06.607609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:06.607609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:06.607609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:06.607609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:06.607609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:06.607609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:06.607609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:06.607609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:06.607609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:06.607609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:06.607609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:06.607609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:06.607609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:06.607609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:06.607609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:06.608561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:06.608561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:06.608561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:06.608561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:06.608561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:06.608561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:06.608561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:06.608561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:06.608561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:06.608561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:06.608561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:37:06.608561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:06.608561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 166/347] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:06.609290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1c32f-f2c7-4380-aaca-0209c4c87d05 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:06.609747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1c32f-f2c7-4380-aaca-0209c4c87d05 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:06.610186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1c32f-f2c7-4380-aaca-0209c4c87d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:06.628428 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829949b4-1cc1-45a8-bc22-84c572e61931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:06.629298 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b8c1c32f-f2c7-4380-aaca-0209c4c87d05 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:06.629571 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829949b4-1cc1-45a8-bc22-84c572e61931 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:06.629852 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829949b4-1cc1-45a8-bc22-84c572e61931 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:06.630125 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829949b4-1cc1-45a8-bc22-84c572e61931 None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:06.630509 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b8c1c32f-f2c7-4380-aaca-0209c4c87d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:06.631973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829949b4-1cc1-45a8-bc22-84c572e61931 None admin] RBAC: Authorizing `identity:get_project(project_id=ef31df6af6414934be49044ddb61049d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:06.634003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829949b4-1cc1-45a8-bc22-84c572e61931 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:06.637693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 182/348] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:06 2022] GET /identity/v3/projects/ef31df6af6414934be49044ddb61049d => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:06.638227 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829949b4-1cc1-45a8-bc22-84c572e61931 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:06.720958 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 167/349] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:06.722162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fe26f-de12-4d0f-a83b-602e652c22c4 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:06.722480 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fe26f-de12-4d0f-a83b-602e652c22c4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:06.723707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fe26f-de12-4d0f-a83b-602e652c22c4 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:06.728628 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 168/350] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:06.728628 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fe26f-de12-4d0f-a83b-602e652c22c4 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:06.772691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829949b4-1cc1-45a8-bc22-84c572e61931 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:06.822225 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977ec7c-0442-42ea-811b-0cb3c8d86bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:06.822817 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977ec7c-0442-42ea-811b-0cb3c8d86bc3 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:06.823105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977ec7c-0442-42ea-811b-0cb3c8d86bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:06.823386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977ec7c-0442-42ea-811b-0cb3c8d86bc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:06.855538 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:06.866164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fe26f-de12-4d0f-a83b-602e652c22c4 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:06.885957 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:06.911399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977ec7c-0442-42ea-811b-0cb3c8d86bc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:06.913635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977ec7c-0442-42ea-811b-0cb3c8d86bc3 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:06.917045 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c257ca3-dc96-43ce-a643-454e06567a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:06.917826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c257ca3-dc96-43ce-a643-454e06567a04 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:06.918115 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c257ca3-dc96-43ce-a643-454e06567a04 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:06.918389 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c257ca3-dc96-43ce-a643-454e06567a04 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:06.919149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c257ca3-dc96-43ce-a643-454e06567a04 None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:06.919455 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c257ca3-dc96-43ce-a643-454e06567a04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:06.921601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c257ca3-dc96-43ce-a643-454e06567a04 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:06.931690 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 169/351] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:37:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:06.932837 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c257ca3-dc96-43ce-a643-454e06567a04 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:07.052386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c257ca3-dc96-43ce-a643-454e06567a04 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:07.062647 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 183/352] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:07.063665 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baf441-49cf-431b-a49f-3d0744e793fc None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:07.063953 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baf441-49cf-431b-a49f-3d0744e793fc None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:07.064228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baf441-49cf-431b-a49f-3d0744e793fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:07.089460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-f1baf441-49cf-431b-a49f-3d0744e793fc None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:07.090748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f1baf441-49cf-431b-a49f-3d0744e793fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:07.091626 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a249d6-2d67-4e98-a1b2-4a5af920891b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:07.092535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a249d6-2d67-4e98-a1b2-4a5af920891b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:07.092833 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a249d6-2d67-4e98-a1b2-4a5af920891b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:07.093103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a249d6-2d67-4e98-a1b2-4a5af920891b None admin] PATH_INFO: `/v3/groups/585490eb890c4f8289ce519dc9966e88` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:07.101014 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a249d6-2d67-4e98-a1b2-4a5af920891b None admin] RBAC: Authorizing `identity:get_group(group_id=585490eb890c4f8289ce519dc9966e88)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:07.102486 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a249d6-2d67-4e98-a1b2-4a5af920891b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:07.104382 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 170/353] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:06 2022] GET /identity/v3/groups/585490eb890c4f8289ce519dc9966e88 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:07.105025 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a249d6-2d67-4e98-a1b2-4a5af920891b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:07.132241 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:07.184062 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 184/354] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:07.184944 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1baf441-49cf-431b-a49f-3d0744e793fc None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:07.203294 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:07.233520 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a249d6-2d67-4e98-a1b2-4a5af920891b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:07.284064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ce816-fe53-4419-9779-94aa567a5df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:07.284977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ce816-fe53-4419-9779-94aa567a5df8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:07.285265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ce816-fe53-4419-9779-94aa567a5df8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:07.285540 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ce816-fe53-4419-9779-94aa567a5df8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:07.296729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ce816-fe53-4419-9779-94aa567a5df8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:07.307190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-015ce816-fe53-4419-9779-94aa567a5df8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:07.307190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:07.307190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:07.307190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:07.307190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:07.307190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:07.307190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:07.307190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:07.307190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:07.307190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:07.307190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:07.307190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:07.307190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:07.307190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:07.307190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:07.307190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:07.308158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:07.308158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:07.308158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:07.308158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:07.308158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:07.308158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:07.308158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:07.308158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:07.308158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:07.308158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:07.308158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:07.308158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:07.308158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:07.308158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:07.308158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:07.308158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:07.309026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:07.309026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:07.309026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:07.309026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:07.309026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:07.309026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:07.309026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:07.309026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:07.309026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:07.309026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:07.309026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:07.309026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:07.309026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 171/355] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:37:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:07.309026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ce816-fe53-4419-9779-94aa567a5df8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:07.316090 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1baf441-49cf-431b-a49f-3d0744e793fc None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:07.358662 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab36817-4e63-4c0c-bdd6-86280a2ed449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:07.359234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab36817-4e63-4c0c-bdd6-86280a2ed449 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:07.359519 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab36817-4e63-4c0c-bdd6-86280a2ed449 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:07.359791 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab36817-4e63-4c0c-bdd6-86280a2ed449 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:07.406119 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:07.434080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ce816-fe53-4419-9779-94aa567a5df8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:07.448201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab36817-4e63-4c0c-bdd6-86280a2ed449 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:07.449944 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab36817-4e63-4c0c-bdd6-86280a2ed449 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:07.463991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:07.476108 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22323a-7b2c-44b7-b71b-d75513e8f4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:07.476108 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22323a-7b2c-44b7-b71b-d75513e8f4ce None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:07.476108 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22323a-7b2c-44b7-b71b-d75513e8f4ce None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:07.476491 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22323a-7b2c-44b7-b71b-d75513e8f4ce None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:07.477931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22323a-7b2c-44b7-b71b-d75513e8f4ce None admin] RBAC: Authorizing `identity:get_project(project_id=ef31df6af6414934be49044ddb61049d)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:07.479398 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22323a-7b2c-44b7-b71b-d75513e8f4ce None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:07.481153 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 172/356] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:07 2022] GET /identity/v3/projects/ef31df6af6414934be49044ddb61049d => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:07.481908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22323a-7b2c-44b7-b71b-d75513e8f4ce None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:07.567550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 185/357] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:07.568931 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95db29b-2003-4765-a13d-8a1315271194 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:07.569222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95db29b-2003-4765-a13d-8a1315271194 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:07.569499 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95db29b-2003-4765-a13d-8a1315271194 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:07.570789 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 186/358] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:07.571471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95db29b-2003-4765-a13d-8a1315271194 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:07.605232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22323a-7b2c-44b7-b71b-d75513e8f4ce None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:07.646967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d54836-63c8-429c-bfc6-30a841b41be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:07.647568 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d54836-63c8-429c-bfc6-30a841b41be1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:07.648482 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d54836-63c8-429c-bfc6-30a841b41be1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:07.648482 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d54836-63c8-429c-bfc6-30a841b41be1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:07.649026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d54836-63c8-429c-bfc6-30a841b41be1 None admin] RBAC: Adding query filter params (group.id=585490eb890c4f8289ce519dc9966e88, role.id=34f07ea559bb44a6b3d81c7c1ff19bbc, scope.project.id=ef31df6af6414934be49044ddb61049d) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:07.649344 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d54836-63c8-429c-bfc6-30a841b41be1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:07.650826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d54836-63c8-429c-bfc6-30a841b41be1 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:07.657740 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 173/359] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Jun 16 18:37:07 2022] GET /identity/v3/role_assignments?group.id=585490eb890c4f8289ce519dc9966e88&scope.project.id=ef31df6af6414934be49044ddb61049d&role.id=34f07ea559bb44a6b3d81c7c1ff19bbc => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:07.658363 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d54836-63c8-429c-bfc6-30a841b41be1 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:07.679258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:07.707445 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95db29b-2003-4765-a13d-8a1315271194 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:07.723495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:07.760595 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7592db4-e17b-4876-ba2d-0da88a5f1972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:07.761430 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7592db4-e17b-4876-ba2d-0da88a5f1972 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:07.761721 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7592db4-e17b-4876-ba2d-0da88a5f1972 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:07.762001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7592db4-e17b-4876-ba2d-0da88a5f1972 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:07.778738 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7592db4-e17b-4876-ba2d-0da88a5f1972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:07.787617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-b7592db4-e17b-4876-ba2d-0da88a5f1972 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:37:07.787617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:07.787617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:07.787617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:07.787617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:07.787617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:07.787617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:07.787617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:07.787617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:07.787617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:07.787617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:07.787617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:07.787617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:07.787617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:07.787617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:07.787617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:07.788707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:07.788707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:07.788707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:07.788707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:07.788707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:07.788707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:07.788707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:07.788707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:07.788707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:07.788707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:07.788707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:07.788707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:07.788707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:07.788707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:07.788707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:07.788707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:07.789553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:07.789553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:07.789553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:07.789553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:07.789553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:07.789553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:07.789553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:07.789553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:07.789553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:07.789553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:07.789553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:37:07.789553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:07.790188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 187/360] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:07.791070 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7592db4-e17b-4876-ba2d-0da88a5f1972 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:07.795144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d54836-63c8-429c-bfc6-30a841b41be1 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:07.840421 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe19129-6bb3-4577-9177-c4d2f12038dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:07.841013 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe19129-6bb3-4577-9177-c4d2f12038dd None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:07.841771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe19129-6bb3-4577-9177-c4d2f12038dd None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:07.841878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe19129-6bb3-4577-9177-c4d2f12038dd None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:07.842595 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe19129-6bb3-4577-9177-c4d2f12038dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:07.842899 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe19129-6bb3-4577-9177-c4d2f12038dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:07.845933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe19129-6bb3-4577-9177-c4d2f12038dd None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:07.857999 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 174/361] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:07.858832 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe19129-6bb3-4577-9177-c4d2f12038dd None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:07.926845 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7592db4-e17b-4876-ba2d-0da88a5f1972 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:07.966102 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:07.975205 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f88d71-a7f8-4680-8bf1-6610d27317df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:07.976086 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f88d71-a7f8-4680-8bf1-6610d27317df None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:07.976374 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f88d71-a7f8-4680-8bf1-6610d27317df None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:07.976684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f88d71-a7f8-4680-8bf1-6610d27317df None admin] PATH_INFO: `/v3/groups/585490eb890c4f8289ce519dc9966e88` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:07.977903 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f88d71-a7f8-4680-8bf1-6610d27317df None admin] RBAC: Authorizing `identity:get_group(group_id=585490eb890c4f8289ce519dc9966e88)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:07.979393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f88d71-a7f8-4680-8bf1-6610d27317df None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:07.981080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 188/362] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:07 2022] GET /identity/v3/groups/585490eb890c4f8289ce519dc9966e88 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:07.987888 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e3fee-8989-4409-afab-90fbc0fe58c8 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:07.987888 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e3fee-8989-4409-afab-90fbc0fe58c8 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:07.987888 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e3fee-8989-4409-afab-90fbc0fe58c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.001641 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-f20e3fee-8989-4409-afab-90fbc0fe58c8 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:08.002852 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f20e3fee-8989-4409-afab-90fbc0fe58c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:08.008376 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe19129-6bb3-4577-9177-c4d2f12038dd None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:08.041711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:08.052831 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf91ff-ff80-4b63-9e13-50f96921f255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:08.057260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf91ff-ff80-4b63-9e13-50f96921f255 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.057260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf91ff-ff80-4b63-9e13-50f96921f255 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.057260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf91ff-ff80-4b63-9e13-50f96921f255 None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.057260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf91ff-ff80-4b63-9e13-50f96921f255 None admin] RBAC: Authorizing `identity:get_project(project_id=470cf0437a844f7484bc6b78d5b0de15)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:08.057260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf91ff-ff80-4b63-9e13-50f96921f255 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:08.058778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 175/363] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:07 2022] GET /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:08.059460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf91ff-ff80-4b63-9e13-50f96921f255 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:08.088475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 189/364] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:08.089534 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e3fee-8989-4409-afab-90fbc0fe58c8 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:08.187601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf91ff-ff80-4b63-9e13-50f96921f255 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:08.219324 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e3fee-8989-4409-afab-90fbc0fe58c8 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:08.229317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd80ccd-e713-42a0-9938-f37c1cba8933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:08.230008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd80ccd-e713-42a0-9938-f37c1cba8933 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.230350 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd80ccd-e713-42a0-9938-f37c1cba8933 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.230742 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd80ccd-e713-42a0-9938-f37c1cba8933 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.231496 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd80ccd-e713-42a0-9938-f37c1cba8933 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:08.231807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd80ccd-e713-42a0-9938-f37c1cba8933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:08.233371 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd80ccd-e713-42a0-9938-f37c1cba8933 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:08.243110 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 176/365] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:37:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:08.243952 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd80ccd-e713-42a0-9938-f37c1cba8933 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:08.253895 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:08.275462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff878939-b02f-4602-b04c-4398fa4e3a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:08.276128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff878939-b02f-4602-b04c-4398fa4e3a1c None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.276415 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff878939-b02f-4602-b04c-4398fa4e3a1c None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.276739 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff878939-b02f-4602-b04c-4398fa4e3a1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.327848 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:08.370632 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff878939-b02f-4602-b04c-4398fa4e3a1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:08.372189 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff878939-b02f-4602-b04c-4398fa4e3a1c None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:08.389526 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd80ccd-e713-42a0-9938-f37c1cba8933 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:08.425034 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16b012-3048-43af-bf9f-030302171c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:08.426278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16b012-3048-43af-bf9f-030302171c3a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.426565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16b012-3048-43af-bf9f-030302171c3a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.426848 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16b012-3048-43af-bf9f-030302171c3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.427731 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16b012-3048-43af-bf9f-030302171c3a None admin] RBAC: Adding query filter params (group.id=585490eb890c4f8289ce519dc9966e88, role.id=cfd7c6febb2246d4a48765a0aa8563bf, scope.project.id=ef31df6af6414934be49044ddb61049d) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:08.428074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16b012-3048-43af-bf9f-030302171c3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:08.429551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16b012-3048-43af-bf9f-030302171c3a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:08.435270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 177/366] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Jun 16 18:37:08 2022] GET /identity/v3/role_assignments?group.id=585490eb890c4f8289ce519dc9966e88&scope.project.id=ef31df6af6414934be49044ddb61049d&role.id=cfd7c6febb2246d4a48765a0aa8563bf => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:08.435950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16b012-3048-43af-bf9f-030302171c3a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:08.504662 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 190/367] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:08.504662 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff878939-b02f-4602-b04c-4398fa4e3a1c None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:08.523612 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:08.573891 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16b012-3048-43af-bf9f-030302171c3a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:08.588586 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:08.614500 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c009932-b323-4f25-bc55-a2ec04a7120a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:08.615394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c009932-b323-4f25-bc55-a2ec04a7120a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.615679 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c009932-b323-4f25-bc55-a2ec04a7120a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.616143 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c009932-b323-4f25-bc55-a2ec04a7120a None admin] PATH_INFO: `/v3/groups/585490eb890c4f8289ce519dc9966e88` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.617384 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c009932-b323-4f25-bc55-a2ec04a7120a None admin] RBAC: Authorizing `identity:get_group(group_id=585490eb890c4f8289ce519dc9966e88)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:08.618846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c009932-b323-4f25-bc55-a2ec04a7120a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:08.620887 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 178/368] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:08 2022] GET /identity/v3/groups/585490eb890c4f8289ce519dc9966e88 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:08.621765 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c009932-b323-4f25-bc55-a2ec04a7120a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:08.632629 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff878939-b02f-4602-b04c-4398fa4e3a1c None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:08.676591 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dec00-ae3f-4482-844c-94ce8f9c3dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:08.677403 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dec00-ae3f-4482-844c-94ce8f9c3dda None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.677692 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dec00-ae3f-4482-844c-94ce8f9c3dda None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.678028 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dec00-ae3f-4482-844c-94ce8f9c3dda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.688787 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25dec00-ae3f-4482-844c-94ce8f9c3dda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:08.696606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-e25dec00-ae3f-4482-844c-94ce8f9c3dda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:08.696606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:08.696606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:08.696606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:08.696606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:08.696606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:08.696606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:08.696606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:08.696606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:08.696606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:08.696606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:08.696606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:08.696606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:08.696606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:08.696606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:08.696606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:08.697542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:08.697542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:08.697542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:08.697542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:08.697542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:08.697542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:08.697542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:08.697542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:08.697542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:08.697542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:08.697542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:08.697542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:08.697542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:08.697542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:08.697542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:08.697542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:08.698337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:08.698337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:08.698337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:08.698337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:08.698337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:08.698337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:08.698337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:08.698337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:08.698337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:08.698337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:08.698337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:08.698337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:08.698337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 191/369] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:08.699012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dec00-ae3f-4482-844c-94ce8f9c3dda None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:08.752127 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c009932-b323-4f25-bc55-a2ec04a7120a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:08.799467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702b997-66bb-4b3f-98d2-1483ebeb1a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:08.801277 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702b997-66bb-4b3f-98d2-1483ebeb1a49 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.801769 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702b997-66bb-4b3f-98d2-1483ebeb1a49 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.802624 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702b997-66bb-4b3f-98d2-1483ebeb1a49 None admin] PATH_INFO: `/v3/users/21f2b2fafd7044e18ce913ae2939bb03` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.804495 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702b997-66bb-4b3f-98d2-1483ebeb1a49 None admin] RBAC: Authorizing `identity:get_user(user_id=21f2b2fafd7044e18ce913ae2939bb03)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:08.807119 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702b997-66bb-4b3f-98d2-1483ebeb1a49 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:08.810010 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 179/370] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:37:08 2022] GET /identity/v3/users/21f2b2fafd7044e18ce913ae2939bb03 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:08.811370 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702b997-66bb-4b3f-98d2-1483ebeb1a49 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:08.814814 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:08.827504 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dec00-ae3f-4482-844c-94ce8f9c3dda None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:08.863328 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:08.877846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9a6c3-4665-4654-b612-38cba09757ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:08.879594 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9a6c3-4665-4654-b612-38cba09757ab None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.879849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9a6c3-4665-4654-b612-38cba09757ab None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.880374 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9a6c3-4665-4654-b612-38cba09757ab None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.882820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9a6c3-4665-4654-b612-38cba09757ab None admin] RBAC: Authorizing `identity:get_project(project_id=470cf0437a844f7484bc6b78d5b0de15)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:08.885855 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9a6c3-4665-4654-b612-38cba09757ab None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:08.892753 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 192/371] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:08 2022] GET /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:08.892753 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9a6c3-4665-4654-b612-38cba09757ab None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:08.957412 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702b997-66bb-4b3f-98d2-1483ebeb1a49 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:08.997334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725bd1a-f537-460b-a6fb-dd2ea1b82c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:08.998181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725bd1a-f537-460b-a6fb-dd2ea1b82c11 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.998569 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725bd1a-f537-460b-a6fb-dd2ea1b82c11 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.998951 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725bd1a-f537-460b-a6fb-dd2ea1b82c11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.999939 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725bd1a-f537-460b-a6fb-dd2ea1b82c11 None admin] RBAC: Adding query filter params (group.id=585490eb890c4f8289ce519dc9966e88, role.id=34f07ea559bb44a6b3d81c7c1ff19bbc, scope.project.id=470cf0437a844f7484bc6b78d5b0de15) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:09.000356 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725bd1a-f537-460b-a6fb-dd2ea1b82c11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:09.001973 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725bd1a-f537-460b-a6fb-dd2ea1b82c11 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:09.008833 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 180/372] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Jun 16 18:37:08 2022] GET /identity/v3/role_assignments?group.id=585490eb890c4f8289ce519dc9966e88&scope.project.id=470cf0437a844f7484bc6b78d5b0de15&role.id=34f07ea559bb44a6b3d81c7c1ff19bbc => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:09.009913 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725bd1a-f537-460b-a6fb-dd2ea1b82c11 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:09.015831 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9a6c3-4665-4654-b612-38cba09757ab None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:09.068230 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1078a9-fd86-4ea9-b6e9-7e63bdcab789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:09.069658 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1078a9-fd86-4ea9-b6e9-7e63bdcab789 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:09.070099 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1078a9-fd86-4ea9-b6e9-7e63bdcab789 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:09.070558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1078a9-fd86-4ea9-b6e9-7e63bdcab789 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:09.071495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1078a9-fd86-4ea9-b6e9-7e63bdcab789 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:09.071959 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1078a9-fd86-4ea9-b6e9-7e63bdcab789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:09.074228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1078a9-fd86-4ea9-b6e9-7e63bdcab789 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:09.086732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 193/373] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:09.087484 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:09.093330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1078a9-fd86-4ea9-b6e9-7e63bdcab789 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:09.137228 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725bd1a-f537-460b-a6fb-dd2ea1b82c11 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:09.180180 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b69f25-4cb5-41e2-9e22-dd53b28d6129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:09.181239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b69f25-4cb5-41e2-9e22-dd53b28d6129 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:09.182786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b69f25-4cb5-41e2-9e22-dd53b28d6129 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:09.183307 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b69f25-4cb5-41e2-9e22-dd53b28d6129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:09.184404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b69f25-4cb5-41e2-9e22-dd53b28d6129 None admin] RBAC: Adding query filter params (role.id=1a958ec71abb4047bc9427c58b382a2c, user.id=21f2b2fafd7044e18ce913ae2939bb03, scope.system=all) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:09.184993 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b69f25-4cb5-41e2-9e22-dd53b28d6129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:09.186666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b69f25-4cb5-41e2-9e22-dd53b28d6129 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:09.202262 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 181/374] 10.222.0.93 () {56 vars in 1308 bytes} [Thu Jun 16 18:37:09 2022] GET /identity/v3/role_assignments?user.id=21f2b2fafd7044e18ce913ae2939bb03&scope.system=all&role.id=1a958ec71abb4047bc9427c58b382a2c => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:09.204032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b69f25-4cb5-41e2-9e22-dd53b28d6129 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:09.224802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:09.298303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1078a9-fd86-4ea9-b6e9-7e63bdcab789 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:09.345033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b69f25-4cb5-41e2-9e22-dd53b28d6129 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:09.375907 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c956d76-136f-4a5e-bb33-3fce05770449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:09.376984 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c956d76-136f-4a5e-bb33-3fce05770449 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:09.377278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c956d76-136f-4a5e-bb33-3fce05770449 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:09.377563 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c956d76-136f-4a5e-bb33-3fce05770449 None admin] PATH_INFO: `/v3/groups/585490eb890c4f8289ce519dc9966e88` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:09.388459 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:09.388669 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c956d76-136f-4a5e-bb33-3fce05770449 None admin] RBAC: Authorizing `identity:get_group(group_id=585490eb890c4f8289ce519dc9966e88)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:09.388669 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c956d76-136f-4a5e-bb33-3fce05770449 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:09.388669 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 194/375] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:09 2022] GET /identity/v3/groups/585490eb890c4f8289ce519dc9966e88 => generated 226 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:09.392193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c956d76-136f-4a5e-bb33-3fce05770449 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:09.400774 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc268a-a06a-4642-9174-95b5f9a5a877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:09.401850 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc268a-a06a-4642-9174-95b5f9a5a877 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:09.402312 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc268a-a06a-4642-9174-95b5f9a5a877 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:09.403390 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc268a-a06a-4642-9174-95b5f9a5a877 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:09.552395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc268a-a06a-4642-9174-95b5f9a5a877 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:09.553916 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc268a-a06a-4642-9174-95b5f9a5a877 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:09.588051 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c956d76-136f-4a5e-bb33-3fce05770449 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:09.623191 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:09.639552 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2904cd-430c-4b3b-8f22-8f1325eeb453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:09.640226 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2904cd-430c-4b3b-8f22-8f1325eeb453 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:09.640540 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2904cd-430c-4b3b-8f22-8f1325eeb453 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:09.640823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2904cd-430c-4b3b-8f22-8f1325eeb453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:09.641676 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2904cd-430c-4b3b-8f22-8f1325eeb453 None admin] RBAC: Adding query filter params (group.id=585490eb890c4f8289ce519dc9966e88, role.id=cfd7c6febb2246d4a48765a0aa8563bf, scope.project.id=470cf0437a844f7484bc6b78d5b0de15) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:09.641995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2904cd-430c-4b3b-8f22-8f1325eeb453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:09.645019 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2904cd-430c-4b3b-8f22-8f1325eeb453 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:09.657745 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 195/376] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Jun 16 18:37:09 2022] GET /identity/v3/role_assignments?group.id=585490eb890c4f8289ce519dc9966e88&scope.project.id=470cf0437a844f7484bc6b78d5b0de15&role.id=cfd7c6febb2246d4a48765a0aa8563bf => generated 260 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:09.742464 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 182/377] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:09.748397 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2904cd-430c-4b3b-8f22-8f1325eeb453 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:09.892196 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2904cd-430c-4b3b-8f22-8f1325eeb453 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:09.927444 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584f59a-2dac-478b-8e4c-c58f32480297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:09.928319 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584f59a-2dac-478b-8e4c-c58f32480297 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:09.928634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584f59a-2dac-478b-8e4c-c58f32480297 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:09.928916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584f59a-2dac-478b-8e4c-c58f32480297 None admin] PATH_INFO: `/v3/projects/698d167bbea646fcaa71cda553a9912f` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:09.930135 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584f59a-2dac-478b-8e4c-c58f32480297 None admin] RBAC: Authorizing `identity:get_project(project_id=698d167bbea646fcaa71cda553a9912f)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:09.931701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584f59a-2dac-478b-8e4c-c58f32480297 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:09.933764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 196/378] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:09 2022] GET /identity/v3/projects/698d167bbea646fcaa71cda553a9912f => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:09.939200 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc268a-a06a-4642-9174-95b5f9a5a877 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:09.973797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:10.073106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc268a-a06a-4642-9174-95b5f9a5a877 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:10.122848 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f0969-e071-4c13-bfb8-0c23983f5eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:10.123721 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f0969-e071-4c13-bfb8-0c23983f5eda None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:10.124006 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f0969-e071-4c13-bfb8-0c23983f5eda None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:10.124284 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f0969-e071-4c13-bfb8-0c23983f5eda None admin] PATH_INFO: `/v3/groups/94218c5a51674717b4e9dd80b8c7e24a` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:10.133966 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f0969-e071-4c13-bfb8-0c23983f5eda None admin] RBAC: Authorizing `identity:get_group(group_id=94218c5a51674717b4e9dd80b8c7e24a)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:10.135469 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f0969-e071-4c13-bfb8-0c23983f5eda None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:10.137640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 183/379] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:09 2022] GET /identity/v3/groups/94218c5a51674717b4e9dd80b8c7e24a => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:10.143580 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584f59a-2dac-478b-8e4c-c58f32480297 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:10.223691 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36ba89-ed23-409d-9193-87e9267321e4 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:10.224208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36ba89-ed23-409d-9193-87e9267321e4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:10.224711 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36ba89-ed23-409d-9193-87e9267321e4 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:10.226251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 184/380] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:37:10.232740 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7b4ff-3599-4526-b6ea-7dfa959a2f02 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:10.233319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7b4ff-3599-4526-b6ea-7dfa959a2f02 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:10.233670 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7b4ff-3599-4526-b6ea-7dfa959a2f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:10.236998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:10.277416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-7bb7b4ff-3599-4526-b6ea-7dfa959a2f02 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:10.278816 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7bb7b4ff-3599-4526-b6ea-7dfa959a2f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:10.300921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584f59a-2dac-478b-8e4c-c58f32480297 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:10.342021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f0b7d-a0fe-4f5a-ab7b-e1277d2caa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:10.343104 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f0b7d-a0fe-4f5a-ab7b-e1277d2caa63 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:10.343573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f0b7d-a0fe-4f5a-ab7b-e1277d2caa63 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:10.344062 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f0b7d-a0fe-4f5a-ab7b-e1277d2caa63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:10.345268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f0b7d-a0fe-4f5a-ab7b-e1277d2caa63 None admin] RBAC: Adding query filter params (group.id=94218c5a51674717b4e9dd80b8c7e24a, role.id=416a52031d5d49b6a3fa0e9baa814436, scope.project.id=698d167bbea646fcaa71cda553a9912f) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:10.345767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f0b7d-a0fe-4f5a-ab7b-e1277d2caa63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:10.348888 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f0b7d-a0fe-4f5a-ab7b-e1277d2caa63 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:10.355756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 197/381] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Jun 16 18:37:10 2022] GET /identity/v3/role_assignments?group.id=94218c5a51674717b4e9dd80b8c7e24a&scope.project.id=698d167bbea646fcaa71cda553a9912f&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:10.428220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 185/382] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:10.463377 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f0b7d-a0fe-4f5a-ab7b-e1277d2caa63 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:10.603517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f0b7d-a0fe-4f5a-ab7b-e1277d2caa63 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:10.637497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:10.645553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e59a1-1f70-4f6e-b63b-845065202a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:10.650395 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e59a1-1f70-4f6e-b63b-845065202a18 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:10.650395 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e59a1-1f70-4f6e-b63b-845065202a18 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:10.650395 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e59a1-1f70-4f6e-b63b-845065202a18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:10.666499 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e59a1-1f70-4f6e-b63b-845065202a18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:10.674462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-874e59a1-1f70-4f6e-b63b-845065202a18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:37:10.674462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:10.674462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:10.674462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:10.674462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:10.674462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:10.674462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:10.674462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:10.674462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:10.674462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:10.674462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:10.674462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:10.674462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:10.674462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:10.674462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:10.674462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:10.675451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:10.675451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:10.675451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:10.675451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:10.675451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:10.675451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:10.675451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:10.675451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:10.675451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:10.675451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:10.675451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:10.675451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:10.675451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:10.675451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:10.675451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:10.675451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:10.676258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:10.676258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:10.676258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:10.676258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:10.676258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:10.676258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:10.676258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:10.676258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:10.676258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:10.676258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:10.676258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:37:10.676258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:10.679482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 198/383] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:10.685819 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7b4ff-3599-4526-b6ea-7dfa959a2f02 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:10.709465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:10.807223 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7b4ff-3599-4526-b6ea-7dfa959a2f02 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:10.843802 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a3f63-5298-4c9d-984e-7dc111abe92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:10.844891 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a3f63-5298-4c9d-984e-7dc111abe92e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:10.845381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a3f63-5298-4c9d-984e-7dc111abe92e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:10.845886 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a3f63-5298-4c9d-984e-7dc111abe92e None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:10.846880 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a3f63-5298-4c9d-984e-7dc111abe92e None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:10.847652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a3f63-5298-4c9d-984e-7dc111abe92e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:10.849335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a3f63-5298-4c9d-984e-7dc111abe92e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:10.858930 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 186/384] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:37:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:10.864726 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e59a1-1f70-4f6e-b63b-845065202a18 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:11.020292 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e59a1-1f70-4f6e-b63b-845065202a18 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:11.070117 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd34ec8-2063-4437-9c39-83e0b9d63bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:11.070996 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34ec8-2063-4437-9c39-83e0b9d63bfb None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:11.071289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34ec8-2063-4437-9c39-83e0b9d63bfb None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:11.071571 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34ec8-2063-4437-9c39-83e0b9d63bfb None admin] PATH_INFO: `/v3/groups/585490eb890c4f8289ce519dc9966e88` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:11.077160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd34ec8-2063-4437-9c39-83e0b9d63bfb None admin] RBAC: Authorizing `identity:get_group(group_id=585490eb890c4f8289ce519dc9966e88)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:11.078635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd34ec8-2063-4437-9c39-83e0b9d63bfb None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:11.080676 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 199/385] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:10 2022] GET /identity/v3/groups/585490eb890c4f8289ce519dc9966e88 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:11.086037 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a3f63-5298-4c9d-984e-7dc111abe92e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:11.190240 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:11.217112 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a3f63-5298-4c9d-984e-7dc111abe92e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:11.258351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec009100-a8cf-4e96-86fc-07a997da4938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:11.259699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec009100-a8cf-4e96-86fc-07a997da4938 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:11.260186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec009100-a8cf-4e96-86fc-07a997da4938 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:11.260747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec009100-a8cf-4e96-86fc-07a997da4938 None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:11.262220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec009100-a8cf-4e96-86fc-07a997da4938 None admin] RBAC: Authorizing `identity:get_project(project_id=ef31df6af6414934be49044ddb61049d)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:11.264344 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec009100-a8cf-4e96-86fc-07a997da4938 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:11.266362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 187/386] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:11 2022] GET /identity/v3/projects/ef31df6af6414934be49044ddb61049d => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:11.277575 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd34ec8-2063-4437-9c39-83e0b9d63bfb None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:11.287591 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8e87d-a710-4649-8ae0-8f3b51858b0e None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:11.288180 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8e87d-a710-4649-8ae0-8f3b51858b0e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:11.288683 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8e87d-a710-4649-8ae0-8f3b51858b0e None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:11.290555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 188/387] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:11.300723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13e707-ed8a-4267-a4ba-3d764172ab4d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:11.301292 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13e707-ed8a-4267-a4ba-3d764172ab4d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:11.301774 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13e707-ed8a-4267-a4ba-3d764172ab4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:11.319044 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4c13e707-ed8a-4267-a4ba-3d764172ab4d None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:11.320611 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4c13e707-ed8a-4267-a4ba-3d764172ab4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:11.394222 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 189/388] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:37:11.400476 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:11.428149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13e707-ed8a-4267-a4ba-3d764172ab4d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:11.510387 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd34ec8-2063-4437-9c39-83e0b9d63bfb None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:11.518161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:11.541664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13e707-ed8a-4267-a4ba-3d764172ab4d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:11.577192 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f56297-c627-4f8b-975f-13be8bf1ebae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:11.578342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f56297-c627-4f8b-975f-13be8bf1ebae None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:11.578830 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f56297-c627-4f8b-975f-13be8bf1ebae None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:11.579331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f56297-c627-4f8b-975f-13be8bf1ebae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:11.589920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f56297-c627-4f8b-975f-13be8bf1ebae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:11.599354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-53f56297-c627-4f8b-975f-13be8bf1ebae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:11.599354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:11.599354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:11.599354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:11.599354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:11.599354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:11.599354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:11.599354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:11.599354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:11.599354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:11.599354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:11.599354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:11.599354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:11.599354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:11.599354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:11.599354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:11.600306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:11.600306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:11.600306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:11.600306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:11.600306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:11.600306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:11.600306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:11.600306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:11.600306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:11.600306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:11.600306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:11.600306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:11.600306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:11.600306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:11.600306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:11.600306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:11.601157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:11.601157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:11.601157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:11.601157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:11.601157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:11.601157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:11.601157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:11.601157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:11.601157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:11.601157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:11.601157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:11.601157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:11.603820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 190/389] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:37:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:11.609640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f56297-c627-4f8b-975f-13be8bf1ebae None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:11.615768 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e814b2-3950-43a1-ba3b-44831879de4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:11.617014 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e814b2-3950-43a1-ba3b-44831879de4b None admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:11.619185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e814b2-3950-43a1-ba3b-44831879de4b None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:11.619704 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e814b2-3950-43a1-ba3b-44831879de4b None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d/groups/585490eb890c4f8289ce519dc9966e88/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:11.623817 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e814b2-3950-43a1-ba3b-44831879de4b None admin] RBAC: Authorizing `identity:create_grant(project_id=ef31df6af6414934be49044ddb61049d, group_id=585490eb890c4f8289ce519dc9966e88, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:11.628286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e814b2-3950-43a1-ba3b-44831879de4b None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:11.733705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f56297-c627-4f8b-975f-13be8bf1ebae None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:11.770412 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442742d7-7a3e-4762-b214-7ae5a444dba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:11.771624 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442742d7-7a3e-4762-b214-7ae5a444dba4 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:11.772135 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442742d7-7a3e-4762-b214-7ae5a444dba4 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:11.772653 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442742d7-7a3e-4762-b214-7ae5a444dba4 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:11.773644 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442742d7-7a3e-4762-b214-7ae5a444dba4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:11.773830 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 200/390] 10.222.0.93 () {58 vars in 1442 bytes} [Thu Jun 16 18:37:11 2022] PUT /identity/v3/projects/ef31df6af6414934be49044ddb61049d/groups/585490eb890c4f8289ce519dc9966e88/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:11.774341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442742d7-7a3e-4762-b214-7ae5a444dba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:11.780468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42669010-de81-4060-98ca-e9147ed200be None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:11.780468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42669010-de81-4060-98ca-e9147ed200be None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:11.780468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42669010-de81-4060-98ca-e9147ed200be None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:11.780468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 201/391] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:11.781993 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442742d7-7a3e-4762-b214-7ae5a444dba4 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:11.784941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424d47e-c4c5-42f1-b7d0-c70d5e2b3db1 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:11.785235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424d47e-c4c5-42f1-b7d0-c70d5e2b3db1 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:11.785516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424d47e-c4c5-42f1-b7d0-c70d5e2b3db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:11.792114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:11.800270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 191/392] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:11.805793 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442742d7-7a3e-4762-b214-7ae5a444dba4 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:11.810199 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-d424d47e-c4c5-42f1-b7d0-c70d5e2b3db1 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:11.810199 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-d424d47e-c4c5-42f1-b7d0-c70d5e2b3db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:11.897658 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 202/393] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:11.923461 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424d47e-c4c5-42f1-b7d0-c70d5e2b3db1 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:11.974289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:12.047775 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424d47e-c4c5-42f1-b7d0-c70d5e2b3db1 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:12.057761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442742d7-7a3e-4762-b214-7ae5a444dba4 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:12.095702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956fb31-5b31-4d89-81be-e9d331eb352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:12.097071 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956fb31-5b31-4d89-81be-e9d331eb352e None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.097618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956fb31-5b31-4d89-81be-e9d331eb352e None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.097900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956fb31-5b31-4d89-81be-e9d331eb352e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.106288 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65478f-7029-4945-997b-c44ce6709ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:12.107659 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65478f-7029-4945-997b-c44ce6709ba9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.108603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65478f-7029-4945-997b-c44ce6709ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.109081 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65478f-7029-4945-997b-c44ce6709ba9 None admin] PATH_INFO: `/v3/groups/585490eb890c4f8289ce519dc9966e88` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.110808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65478f-7029-4945-997b-c44ce6709ba9 None admin] RBAC: Authorizing `identity:get_group(group_id=585490eb890c4f8289ce519dc9966e88)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:12.110913 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956fb31-5b31-4d89-81be-e9d331eb352e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:12.114028 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65478f-7029-4945-997b-c44ce6709ba9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:12.116296 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 192/394] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:11 2022] GET /identity/v3/groups/585490eb890c4f8289ce519dc9966e88 => generated 226 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:12.118707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-2956fb31-5b31-4d89-81be-e9d331eb352e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:37:12.118707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:12.118707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:12.118707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:12.118707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:12.118707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:12.118707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:12.118707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:12.118707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:12.118707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:12.118707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:12.118707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:12.118707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:12.118707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:12.118707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:12.118707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:12.120144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:12.120144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:12.120144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:12.120144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:12.120144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:12.120144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:12.120144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:12.120144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:12.120144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:12.120144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:12.120144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:12.120144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:12.120144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:12.120144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:12.120144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:12.120144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:12.123610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:12.123610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:12.123610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:12.123610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:12.123610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:12.123610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:12.123610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:12.123610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:12.123610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:12.123610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:12.123610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:37:12.123610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:12.123610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 203/395] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:12.125577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65478f-7029-4945-997b-c44ce6709ba9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:12.130503 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956fb31-5b31-4d89-81be-e9d331eb352e None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:12.210953 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:12.248751 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65478f-7029-4945-997b-c44ce6709ba9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:12.294223 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12bc81-b050-4689-8b60-a2d8d63c5109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:12.295690 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12bc81-b050-4689-8b60-a2d8d63c5109 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.296177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12bc81-b050-4689-8b60-a2d8d63c5109 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.296579 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12bc81-b050-4689-8b60-a2d8d63c5109 None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.298145 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12bc81-b050-4689-8b60-a2d8d63c5109 None admin] RBAC: Authorizing `identity:get_project(project_id=ef31df6af6414934be49044ddb61049d)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:12.299760 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12bc81-b050-4689-8b60-a2d8d63c5109 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:12.302132 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 193/396] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:12 2022] GET /identity/v3/projects/ef31df6af6414934be49044ddb61049d => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:12.313171 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12bc81-b050-4689-8b60-a2d8d63c5109 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:12.337394 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:12.341205 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956fb31-5b31-4d89-81be-e9d331eb352e None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:12.377025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c26ea6-78bb-4a8f-8c88-60785a586337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:12.378237 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c26ea6-78bb-4a8f-8c88-60785a586337 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.378529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c26ea6-78bb-4a8f-8c88-60785a586337 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.378810 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c26ea6-78bb-4a8f-8c88-60785a586337 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.379645 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c26ea6-78bb-4a8f-8c88-60785a586337 None admin] RBAC: Adding query filter params (name=member) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:12.380267 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c26ea6-78bb-4a8f-8c88-60785a586337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:12.381981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c26ea6-78bb-4a8f-8c88-60785a586337 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:12.391529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 204/397] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:37:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:12.393151 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9e1eb-fd1e-4f00-a2ae-40370d398c26 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.394026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9e1eb-fd1e-4f00-a2ae-40370d398c26 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.394417 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9e1eb-fd1e-4f00-a2ae-40370d398c26 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.399910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 205/398] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:12.401316 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9e1eb-fd1e-4f00-a2ae-40370d398c26 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:12.453764 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12bc81-b050-4689-8b60-a2d8d63c5109 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:12.500254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98b428-0a2f-4bb9-a817-f62d7510de99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:12.502063 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98b428-0a2f-4bb9-a817-f62d7510de99 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.503364 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98b428-0a2f-4bb9-a817-f62d7510de99 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.503855 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98b428-0a2f-4bb9-a817-f62d7510de99 None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d/groups/585490eb890c4f8289ce519dc9966e88/roles/cfd7c6febb2246d4a48765a0aa8563bf` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.507641 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98b428-0a2f-4bb9-a817-f62d7510de99 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef31df6af6414934be49044ddb61049d, group_id=585490eb890c4f8289ce519dc9966e88, role_id=cfd7c6febb2246d4a48765a0aa8563bf)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:12.510057 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98b428-0a2f-4bb9-a817-f62d7510de99 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:12.514389 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:12.515155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9e1eb-fd1e-4f00-a2ae-40370d398c26 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:12.552744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ea5ce-54aa-4b0a-9990-ff1edc78e020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:12.553953 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ea5ce-54aa-4b0a-9990-ff1edc78e020 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.554246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ea5ce-54aa-4b0a-9990-ff1edc78e020 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.554528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ea5ce-54aa-4b0a-9990-ff1edc78e020 None admin] PATH_INFO: `/v3/groups/585490eb890c4f8289ce519dc9966e88` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.555752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ea5ce-54aa-4b0a-9990-ff1edc78e020 None admin] RBAC: Authorizing `identity:get_group(group_id=585490eb890c4f8289ce519dc9966e88)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:12.557261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ea5ce-54aa-4b0a-9990-ff1edc78e020 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:12.559048 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 206/399] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:12 2022] GET /identity/v3/groups/585490eb890c4f8289ce519dc9966e88 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:12.560627 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c2dac-4a77-442e-843d-48ecf3be575e None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.560627 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c2dac-4a77-442e-843d-48ecf3be575e None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.560870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c2dac-4a77-442e-843d-48ecf3be575e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.581249 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-856c2dac-4a77-442e-843d-48ecf3be575e None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:12.582445 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-856c2dac-4a77-442e-843d-48ecf3be575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:12.606425 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:12.627342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 194/400] 10.222.0.93 () {58 vars in 1442 bytes} [Thu Jun 16 18:37:12 2022] PUT /identity/v3/projects/ef31df6af6414934be49044ddb61049d/groups/585490eb890c4f8289ce519dc9966e88/roles/cfd7c6febb2246d4a48765a0aa8563bf => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:12.628720 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98b428-0a2f-4bb9-a817-f62d7510de99 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:12.695140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 207/401] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:12.742136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c2dac-4a77-442e-843d-48ecf3be575e None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:12.758738 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98b428-0a2f-4bb9-a817-f62d7510de99 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:12.808310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b381ae1-fe0d-4502-bd8c-98867eaad0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:12.809174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b381ae1-fe0d-4502-bd8c-98867eaad0e2 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.809471 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b381ae1-fe0d-4502-bd8c-98867eaad0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.809751 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b381ae1-fe0d-4502-bd8c-98867eaad0e2 None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.814875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b381ae1-fe0d-4502-bd8c-98867eaad0e2 None admin] RBAC: Authorizing `identity:get_project(project_id=470cf0437a844f7484bc6b78d5b0de15)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:12.816373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b381ae1-fe0d-4502-bd8c-98867eaad0e2 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:12.820819 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 195/402] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:12 2022] GET /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:12.824795 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b381ae1-fe0d-4502-bd8c-98867eaad0e2 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:12.899256 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:12.906431 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c2dac-4a77-442e-843d-48ecf3be575e None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:12.950700 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b381ae1-fe0d-4502-bd8c-98867eaad0e2 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:12.954725 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca16ad2-df81-4df7-9c6d-b723d959f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:12.955614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca16ad2-df81-4df7-9c6d-b723d959f2bc None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.955902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca16ad2-df81-4df7-9c6d-b723d959f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.956178 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca16ad2-df81-4df7-9c6d-b723d959f2bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.967274 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca16ad2-df81-4df7-9c6d-b723d959f2bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:12.976751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-5ca16ad2-df81-4df7-9c6d-b723d959f2bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:12.976751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:12.976751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:12.976751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:12.976751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:12.976751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:12.976751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:12.976751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:12.976751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:12.976751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:12.976751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:12.976751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:12.976751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:12.976751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:12.976751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:12.976751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:12.977677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:12.977677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:12.977677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:12.977677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:12.977677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:12.977677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:12.977677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:12.977677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:12.977677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:12.977677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:12.977677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:12.977677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:12.977677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:12.977677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:12.977677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:12.977677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:12.978495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:12.978495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:12.978495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:12.978495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:12.978495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:12.978495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:12.978495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:12.978495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:12.978495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:12.978495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:12.978495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:12.978495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:12.982977 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 208/403] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:37:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:12.984327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504086e-00b5-4875-8fc4-5fd4f45d0a88 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.984657 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504086e-00b5-4875-8fc4-5fd4f45d0a88 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.985310 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504086e-00b5-4875-8fc4-5fd4f45d0a88 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.987482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 209/404] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:12.988340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504086e-00b5-4875-8fc4-5fd4f45d0a88 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:12.993867 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8566cfc-eb11-4382-91e9-c26e68d7f426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:12.994778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8566cfc-eb11-4382-91e9-c26e68d7f426 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.995061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8566cfc-eb11-4382-91e9-c26e68d7f426 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.995340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8566cfc-eb11-4382-91e9-c26e68d7f426 None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15/groups/585490eb890c4f8289ce519dc9966e88/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.997381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8566cfc-eb11-4382-91e9-c26e68d7f426 None admin] RBAC: Authorizing `identity:create_grant(project_id=470cf0437a844f7484bc6b78d5b0de15, group_id=585490eb890c4f8289ce519dc9966e88, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:12.999271 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8566cfc-eb11-4382-91e9-c26e68d7f426 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:13.012426 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:13.091587 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504086e-00b5-4875-8fc4-5fd4f45d0a88 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:13.103813 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 196/405] 10.222.0.93 () {58 vars in 1442 bytes} [Thu Jun 16 18:37:12 2022] PUT /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15/groups/585490eb890c4f8289ce519dc9966e88/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:37:13.106243 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958cc72-e5ac-4514-9ae5-028b05fd56ea None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:13.106919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958cc72-e5ac-4514-9ae5-028b05fd56ea None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:13.107466 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958cc72-e5ac-4514-9ae5-028b05fd56ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:13.143993 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-9958cc72-e5ac-4514-9ae5-028b05fd56ea None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:13.147776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9958cc72-e5ac-4514-9ae5-028b05fd56ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:13.155126 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24715c66-d3e8-48c7-9494-255cdab49b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:13.157077 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24715c66-d3e8-48c7-9494-255cdab49b13 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:13.157788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24715c66-d3e8-48c7-9494-255cdab49b13 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:13.158281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24715c66-d3e8-48c7-9494-255cdab49b13 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:13.164487 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24715c66-d3e8-48c7-9494-255cdab49b13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:13.165173 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24715c66-d3e8-48c7-9494-255cdab49b13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:13.166903 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24715c66-d3e8-48c7-9494-255cdab49b13 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:13.184257 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 210/406] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:13.191444 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24715c66-d3e8-48c7-9494-255cdab49b13 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:13.275161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 197/407] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:13.298495 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958cc72-e5ac-4514-9ae5-028b05fd56ea None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:13.327891 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:13.347943 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24715c66-d3e8-48c7-9494-255cdab49b13 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:13.362780 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:13.401007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f9048-e9c7-4872-8550-2f6ce094e41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:13.402834 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f9048-e9c7-4872-8550-2f6ce094e41c None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:13.403270 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f9048-e9c7-4872-8550-2f6ce094e41c None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:13.403716 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f9048-e9c7-4872-8550-2f6ce094e41c None admin] PATH_INFO: `/v3/groups/585490eb890c4f8289ce519dc9966e88` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:13.405602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f9048-e9c7-4872-8550-2f6ce094e41c None admin] RBAC: Authorizing `identity:get_group(group_id=585490eb890c4f8289ce519dc9966e88)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:13.407214 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f9048-e9c7-4872-8550-2f6ce094e41c None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:13.411090 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 211/408] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:13 2022] GET /identity/v3/groups/585490eb890c4f8289ce519dc9966e88 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:13.417433 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f9048-e9c7-4872-8550-2f6ce094e41c None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:13.438972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958cc72-e5ac-4514-9ae5-028b05fd56ea None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:13.507530 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dac85-00e7-4f82-9164-1061d09277c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:13.508543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dac85-00e7-4f82-9164-1061d09277c3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:13.508923 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dac85-00e7-4f82-9164-1061d09277c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:13.509304 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dac85-00e7-4f82-9164-1061d09277c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:13.536993 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84dac85-00e7-4f82-9164-1061d09277c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:13.544801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-f84dac85-00e7-4f82-9164-1061d09277c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:13.544801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:13.544801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:13.544801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:13.544801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:13.544801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:13.544801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:13.544801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:13.544801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:13.544801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:13.544801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:13.544801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:13.544801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:13.544801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:13.544801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:13.544801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:13.545879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:13.545879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:13.545879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:13.545879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:13.545879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:13.545879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:13.545879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:13.545879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:13.545879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:13.545879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:13.545879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:13.545879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:13.545879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:13.545879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:13.545879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:13.545879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:13.546875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:13.546875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:13.546875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:13.546875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:13.546875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:13.546875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:13.546875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:13.546875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:13.546875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:13.546875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:13.546875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:13.546875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:13.547687 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 198/409] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:13.561494 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dac85-00e7-4f82-9164-1061d09277c3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:13.576575 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f9048-e9c7-4872-8550-2f6ce094e41c None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:13.616759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4730507-df8d-43e7-ba1c-613da564a3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:13.617880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4730507-df8d-43e7-ba1c-613da564a3a8 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:13.618942 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4730507-df8d-43e7-ba1c-613da564a3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:13.619528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4730507-df8d-43e7-ba1c-613da564a3a8 None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:13.622010 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4730507-df8d-43e7-ba1c-613da564a3a8 None admin] RBAC: Authorizing `identity:get_project(project_id=470cf0437a844f7484bc6b78d5b0de15)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:13.624292 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4730507-df8d-43e7-ba1c-613da564a3a8 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:13.626781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 212/410] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:13 2022] GET /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:13.633265 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4730507-df8d-43e7-ba1c-613da564a3a8 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:13.668938 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:13.764458 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dac85-00e7-4f82-9164-1061d09277c3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:13.780929 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:13.782959 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4730507-df8d-43e7-ba1c-613da564a3a8 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:13.796266 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ebe7c-cb37-40ff-a047-8343a3968916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:13.797013 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ebe7c-cb37-40ff-a047-8343a3968916 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:13.797299 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ebe7c-cb37-40ff-a047-8343a3968916 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:13.797570 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ebe7c-cb37-40ff-a047-8343a3968916 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:13.798315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ebe7c-cb37-40ff-a047-8343a3968916 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:13.798617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ebe7c-cb37-40ff-a047-8343a3968916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:13.800029 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ebe7c-cb37-40ff-a047-8343a3968916 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:13.816519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 199/411] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:13.825378 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ebe7c-cb37-40ff-a047-8343a3968916 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:13.836033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fe8e5-16c3-4e42-974f-da2a316549db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:13.837261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fe8e5-16c3-4e42-974f-da2a316549db None admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:13.837795 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fe8e5-16c3-4e42-974f-da2a316549db None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:13.838296 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fe8e5-16c3-4e42-974f-da2a316549db None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15/groups/585490eb890c4f8289ce519dc9966e88/roles/cfd7c6febb2246d4a48765a0aa8563bf` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:13.840742 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fe8e5-16c3-4e42-974f-da2a316549db None admin] RBAC: Authorizing `identity:create_grant(project_id=470cf0437a844f7484bc6b78d5b0de15, group_id=585490eb890c4f8289ce519dc9966e88, role_id=cfd7c6febb2246d4a48765a0aa8563bf)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:13.842382 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fe8e5-16c3-4e42-974f-da2a316549db None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:13.913533 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 213/412] 10.222.0.93 () {58 vars in 1442 bytes} [Thu Jun 16 18:37:13 2022] PUT /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15/groups/585490eb890c4f8289ce519dc9966e88/roles/cfd7c6febb2246d4a48765a0aa8563bf => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:13.972066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ebe7c-cb37-40ff-a047-8343a3968916 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:14.021530 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d292c-015c-41d4-8217-59b76621ef56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:14.022422 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d292c-015c-41d4-8217-59b76621ef56 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:14.022702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d292c-015c-41d4-8217-59b76621ef56 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:14.022974 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d292c-015c-41d4-8217-59b76621ef56 None admin] PATH_INFO: `/v3/groups/94218c5a51674717b4e9dd80b8c7e24a` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:14.027125 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d292c-015c-41d4-8217-59b76621ef56 None admin] RBAC: Authorizing `identity:get_group(group_id=94218c5a51674717b4e9dd80b8c7e24a)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:14.028704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d292c-015c-41d4-8217-59b76621ef56 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:14.030631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 200/413] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:13 2022] GET /identity/v3/groups/94218c5a51674717b4e9dd80b8c7e24a => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:14.036475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fe8e5-16c3-4e42-974f-da2a316549db None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:14.154789 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:14.180010 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fe8e5-16c3-4e42-974f-da2a316549db None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:14.214278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7fe3d-4a16-41f0-99ac-2d192a01772f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:14.215205 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7fe3d-4a16-41f0-99ac-2d192a01772f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:14.215489 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7fe3d-4a16-41f0-99ac-2d192a01772f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:14.215800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7fe3d-4a16-41f0-99ac-2d192a01772f None admin] PATH_INFO: `/v3/projects/698d167bbea646fcaa71cda553a9912f` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:14.217143 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7fe3d-4a16-41f0-99ac-2d192a01772f None admin] RBAC: Authorizing `identity:get_project(project_id=698d167bbea646fcaa71cda553a9912f)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:14.222439 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7fe3d-4a16-41f0-99ac-2d192a01772f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:14.222439 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 214/414] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:14 2022] GET /identity/v3/projects/698d167bbea646fcaa71cda553a9912f => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:14.228451 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d292c-015c-41d4-8217-59b76621ef56 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:14.293416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:14.350101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d292c-015c-41d4-8217-59b76621ef56 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:14.390725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55c277-cf79-4fc6-876d-35a8bfcf7510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:14.391943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55c277-cf79-4fc6-876d-35a8bfcf7510 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:14.392391 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55c277-cf79-4fc6-876d-35a8bfcf7510 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:14.392889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55c277-cf79-4fc6-876d-35a8bfcf7510 None admin] PATH_INFO: `/v3/projects/698d167bbea646fcaa71cda553a9912f/groups/94218c5a51674717b4e9dd80b8c7e24a/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:14.395119 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55c277-cf79-4fc6-876d-35a8bfcf7510 None admin] RBAC: Authorizing `identity:create_grant(project_id=698d167bbea646fcaa71cda553a9912f, group_id=94218c5a51674717b4e9dd80b8c7e24a, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:14.396866 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55c277-cf79-4fc6-876d-35a8bfcf7510 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:14.502097 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 201/415] 10.222.0.93 () {58 vars in 1442 bytes} [Thu Jun 16 18:37:14 2022] PUT /identity/v3/projects/698d167bbea646fcaa71cda553a9912f/groups/94218c5a51674717b4e9dd80b8c7e24a/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:14.570230 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243412e-1764-4f92-9598-718520e41175 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:14.571205 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243412e-1764-4f92-9598-718520e41175 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:14.571685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243412e-1764-4f92-9598-718520e41175 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:14.573365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 215/416] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:14.579174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5865666-e023-4896-9edc-5a65df6b9a8a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:14.579794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5865666-e023-4896-9edc-5a65df6b9a8a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:14.580329 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5865666-e023-4896-9edc-5a65df6b9a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:14.601319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b5865666-e023-4896-9edc-5a65df6b9a8a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:14.602594 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b5865666-e023-4896-9edc-5a65df6b9a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:14.700017 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 202/417] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:14.725516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243412e-1764-4f92-9598-718520e41175 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:14.841222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243412e-1764-4f92-9598-718520e41175 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:14.878749 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b021c-f266-45fc-8e8d-4afc58727849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:14.879560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b021c-f266-45fc-8e8d-4afc58727849 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:14.879843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b021c-f266-45fc-8e8d-4afc58727849 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:14.880122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b021c-f266-45fc-8e8d-4afc58727849 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:14.890691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b021c-f266-45fc-8e8d-4afc58727849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:14.898870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-4f4b021c-f266-45fc-8e8d-4afc58727849 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:37:14.898870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:14.898870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:14.898870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:14.898870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:14.898870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:14.898870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:14.898870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:14.898870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:14.898870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:14.898870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:14.898870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:14.898870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:14.898870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:14.898870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:14.898870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:14.899776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:14.899776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:14.899776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:14.899776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:14.899776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:14.899776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:14.899776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:14.899776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:14.899776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:14.899776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:14.899776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:14.899776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:14.899776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:14.899776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:14.899776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:14.899776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:14.900719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:14.900719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:14.900719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:14.900719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:14.900719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:14.900719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:14.900719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:14.900719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:14.900719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:14.900719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:14.900719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:37:14.900719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:14.900719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 216/418] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:14.906195 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5865666-e023-4896-9edc-5a65df6b9a8a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:14.984801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:15.087087 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5865666-e023-4896-9edc-5a65df6b9a8a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:15.134595 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3fee9-d130-4b12-9c36-7290e66308c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:15.135202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3fee9-d130-4b12-9c36-7290e66308c3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:15.135489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3fee9-d130-4b12-9c36-7290e66308c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:15.135767 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3fee9-d130-4b12-9c36-7290e66308c3 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:15.136553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3fee9-d130-4b12-9c36-7290e66308c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:15.136865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3fee9-d130-4b12-9c36-7290e66308c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:15.138257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3fee9-d130-4b12-9c36-7290e66308c3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:15.152121 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 203/419] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:37:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:15.157706 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b021c-f266-45fc-8e8d-4afc58727849 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:15.174897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:15.314593 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b021c-f266-45fc-8e8d-4afc58727849 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:15.370260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9ad8a-b3c0-4fc5-9d83-d5c52f558eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:15.370925 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9ad8a-b3c0-4fc5-9d83-d5c52f558eab None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:15.371212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9ad8a-b3c0-4fc5-9d83-d5c52f558eab None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:15.371491 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9ad8a-b3c0-4fc5-9d83-d5c52f558eab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:15.474808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9ad8a-b3c0-4fc5-9d83-d5c52f558eab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:15.476235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9ad8a-b3c0-4fc5-9d83-d5c52f558eab None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:15.488884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:15.616196 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 217/420] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:15.621575 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3fee9-d130-4b12-9c36-7290e66308c3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:15.631742 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4bc64-c34c-4252-815c-86d02900cc8b None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:15.632035 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4bc64-c34c-4252-815c-86d02900cc8b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:15.632319 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4bc64-c34c-4252-815c-86d02900cc8b None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:15.633694 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 218/421] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:15.640922 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c0cec-4ed5-4241-9b2d-96e14fc8c861 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:15.641210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c0cec-4ed5-4241-9b2d-96e14fc8c861 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:15.641490 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c0cec-4ed5-4241-9b2d-96e14fc8c861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:15.669456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-1f6c0cec-4ed5-4241-9b2d-96e14fc8c861 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:15.670661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-1f6c0cec-4ed5-4241-9b2d-96e14fc8c861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:15.751019 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 219/422] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:15.780973 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:15.785104 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c0cec-4ed5-4241-9b2d-96e14fc8c861 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:15.788889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3fee9-d130-4b12-9c36-7290e66308c3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:15.832924 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:15.889207 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841bcee-da62-46e7-85f6-5f197ce4f506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:15.890113 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841bcee-da62-46e7-85f6-5f197ce4f506 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:15.890399 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841bcee-da62-46e7-85f6-5f197ce4f506 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:15.890677 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841bcee-da62-46e7-85f6-5f197ce4f506 None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:15.891969 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841bcee-da62-46e7-85f6-5f197ce4f506 None admin] RBAC: Authorizing `identity:get_project(project_id=ef31df6af6414934be49044ddb61049d)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:15.892931 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c0cec-4ed5-4241-9b2d-96e14fc8c861 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:15.894028 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841bcee-da62-46e7-85f6-5f197ce4f506 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:15.896087 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 204/423] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:15 2022] GET /identity/v3/projects/ef31df6af6414934be49044ddb61049d => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:15.903012 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841bcee-da62-46e7-85f6-5f197ce4f506 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:15.936475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c148b-3df7-4785-9f03-a70cc5469711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:15.939817 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c148b-3df7-4785-9f03-a70cc5469711 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:15.940106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c148b-3df7-4785-9f03-a70cc5469711 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:15.940386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c148b-3df7-4785-9f03-a70cc5469711 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:15.968400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c148b-3df7-4785-9f03-a70cc5469711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:15.984365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-107c148b-3df7-4785-9f03-a70cc5469711 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:15.984365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:15.984365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:15.984365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:15.984365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:15.984365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:15.984365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:15.984365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:15.984365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:15.984365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:15.984365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:15.984365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:15.984365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:15.984365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:15.984365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:15.984365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:15.985305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:15.985305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:15.985305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:15.985305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:15.985305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:15.985305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:15.985305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:15.985305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:15.985305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:15.985305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:15.985305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:15.985305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:15.985305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:15.985305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:15.985305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:15.985305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:15.986155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:15.986155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:15.986155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:15.986155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:15.986155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:15.986155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:15.986155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:15.986155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:15.986155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:15.986155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:15.986155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:15.986155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:15.993430 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 220/424] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:37:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:15.994305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c148b-3df7-4785-9f03-a70cc5469711 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:16.061562 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841bcee-da62-46e7-85f6-5f197ce4f506 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:16.094978 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:16.097216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f13e8f-d355-4ab4-83c7-82753ed452a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:16.098086 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f13e8f-d355-4ab4-83c7-82753ed452a8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.098370 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f13e8f-d355-4ab4-83c7-82753ed452a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.098649 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f13e8f-d355-4ab4-83c7-82753ed452a8 None admin] PATH_INFO: `/v3/groups/585490eb890c4f8289ce519dc9966e88` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.099844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f13e8f-d355-4ab4-83c7-82753ed452a8 None admin] RBAC: Authorizing `identity:get_group(group_id=585490eb890c4f8289ce519dc9966e88)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:16.101364 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f13e8f-d355-4ab4-83c7-82753ed452a8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:16.101549 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c148b-3df7-4785-9f03-a70cc5469711 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:16.103147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 205/425] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:15 2022] GET /identity/v3/groups/585490eb890c4f8289ce519dc9966e88 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:16.111276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ed876-bbda-440a-9a59-6ebfd81e145a None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.111276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ed876-bbda-440a-9a59-6ebfd81e145a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.111276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ed876-bbda-440a-9a59-6ebfd81e145a None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.111276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 206/426] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:16.111276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ed876-bbda-440a-9a59-6ebfd81e145a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:16.141730 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:16.141981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ce82d-1d59-4006-af03-fe33eb546d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:16.143199 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ce82d-1d59-4006-af03-fe33eb546d6e None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.143686 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ce82d-1d59-4006-af03-fe33eb546d6e None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.143801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ce82d-1d59-4006-af03-fe33eb546d6e None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.144545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ce82d-1d59-4006-af03-fe33eb546d6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:16.144916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ce82d-1d59-4006-af03-fe33eb546d6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:16.146319 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ce82d-1d59-4006-af03-fe33eb546d6e None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:16.154996 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 221/427] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:16.156283 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805fe2a-2130-40e9-96bc-31f6770c2b46 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.160980 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805fe2a-2130-40e9-96bc-31f6770c2b46 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.161172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805fe2a-2130-40e9-96bc-31f6770c2b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.178349 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-5805fe2a-2130-40e9-96bc-31f6770c2b46 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:16.179560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5805fe2a-2130-40e9-96bc-31f6770c2b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:16.217163 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ed876-bbda-440a-9a59-6ebfd81e145a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:16.257228 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df04ba2-1be8-48eb-98f1-8b27180d44d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:16.258305 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df04ba2-1be8-48eb-98f1-8b27180d44d1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.258791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df04ba2-1be8-48eb-98f1-8b27180d44d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.259268 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df04ba2-1be8-48eb-98f1-8b27180d44d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.260466 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df04ba2-1be8-48eb-98f1-8b27180d44d1 None admin] RBAC: Adding query filter params (group.id=585490eb890c4f8289ce519dc9966e88, role.id=34f07ea559bb44a6b3d81c7c1ff19bbc, scope.project.id=ef31df6af6414934be49044ddb61049d) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:16.260909 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 222/428] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:16.261431 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df04ba2-1be8-48eb-98f1-8b27180d44d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:16.261535 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805fe2a-2130-40e9-96bc-31f6770c2b46 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:16.268478 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df04ba2-1be8-48eb-98f1-8b27180d44d1 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:16.286972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 207/429] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Jun 16 18:37:16 2022] GET /identity/v3/role_assignments?group.id=585490eb890c4f8289ce519dc9966e88&scope.project.id=ef31df6af6414934be49044ddb61049d&role.id=34f07ea559bb44a6b3d81c7c1ff19bbc => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:16.293232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df04ba2-1be8-48eb-98f1-8b27180d44d1 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:16.380098 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:16.393953 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805fe2a-2130-40e9-96bc-31f6770c2b46 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:16.406910 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df04ba2-1be8-48eb-98f1-8b27180d44d1 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:16.418042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:16.447220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ff019-22bf-4341-9544-88cf20b8834f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:16.448012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ff019-22bf-4341-9544-88cf20b8834f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.448306 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ff019-22bf-4341-9544-88cf20b8834f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.448627 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ff019-22bf-4341-9544-88cf20b8834f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.450359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef374e-38b9-4327-b785-739dde63cc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:16.451433 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef374e-38b9-4327-b785-739dde63cc0d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.451936 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef374e-38b9-4327-b785-739dde63cc0d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.452411 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef374e-38b9-4327-b785-739dde63cc0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.472280 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef374e-38b9-4327-b785-739dde63cc0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:16.487117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-fcef374e-38b9-4327-b785-739dde63cc0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:37:16.487117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:16.487117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:16.487117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:16.487117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:16.487117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:16.487117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:16.487117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:16.487117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:16.487117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:16.487117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:16.487117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:16.487117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:16.487117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:16.487117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:16.487117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:16.488080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:16.488080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:16.488080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:16.488080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:16.488080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:16.488080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:16.488080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:16.488080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:16.488080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:16.488080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:16.488080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:16.488080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:16.488080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:16.488080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:16.488080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:16.488080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:16.488917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:16.488917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:16.488917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:16.488917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:16.488917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:16.488917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:16.488917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:16.488917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:16.488917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:16.488917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:16.488917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:37:16.488917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:16.498675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 208/430] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:16.505543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef374e-38b9-4327-b785-739dde63cc0d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:16.569312 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ff019-22bf-4341-9544-88cf20b8834f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:16.570981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ff019-22bf-4341-9544-88cf20b8834f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:16.620407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef374e-38b9-4327-b785-739dde63cc0d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:16.664191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32c7f7-181a-437e-9526-e5bbf607dcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:16.665290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32c7f7-181a-437e-9526-e5bbf607dcd7 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.665812 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32c7f7-181a-437e-9526-e5bbf607dcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.666166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32c7f7-181a-437e-9526-e5bbf607dcd7 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.667024 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32c7f7-181a-437e-9526-e5bbf607dcd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:16.667407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32c7f7-181a-437e-9526-e5bbf607dcd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:16.668948 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32c7f7-181a-437e-9526-e5bbf607dcd7 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:16.680056 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 209/431] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:37:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:16.682696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b976804-72fa-42a7-9bad-75d3c1c5ea2f None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.687740 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b976804-72fa-42a7-9bad-75d3c1c5ea2f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.688151 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b976804-72fa-42a7-9bad-75d3c1c5ea2f None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.689767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:16.694184 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 210/432] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:16 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:16.694184 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b976804-72fa-42a7-9bad-75d3c1c5ea2f None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:16.715868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:16.718729 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 223/433] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:16.720015 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1539e-90eb-4fa9-ae1d-c1bf4e37f472 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.722124 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1539e-90eb-4fa9-ae1d-c1bf4e37f472 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.722124 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1539e-90eb-4fa9-ae1d-c1bf4e37f472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.742668 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-46e1539e-90eb-4fa9-ae1d-c1bf4e37f472 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:16.743875 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-46e1539e-90eb-4fa9-ae1d-c1bf4e37f472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:16.838804 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 224/434] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:16.841094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1539e-90eb-4fa9-ae1d-c1bf4e37f472 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:16.848764 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b976804-72fa-42a7-9bad-75d3c1c5ea2f None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:16.891972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50e425-7d3f-4395-8d77-2c2db758b884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:16.893192 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50e425-7d3f-4395-8d77-2c2db758b884 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.893480 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50e425-7d3f-4395-8d77-2c2db758b884 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.893753 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50e425-7d3f-4395-8d77-2c2db758b884 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.959946 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1539e-90eb-4fa9-ae1d-c1bf4e37f472 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:16.961678 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50e425-7d3f-4395-8d77-2c2db758b884 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:16.963152 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50e425-7d3f-4395-8d77-2c2db758b884 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:16.979201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:16.989920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:16.996470 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f743261-34f5-4f48-8efd-78a0056e2e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:16.997345 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f743261-34f5-4f48-8efd-78a0056e2e78 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.997630 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f743261-34f5-4f48-8efd-78a0056e2e78 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.997911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f743261-34f5-4f48-8efd-78a0056e2e78 None admin] PATH_INFO: `/v3/projects/ef31df6af6414934be49044ddb61049d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.999122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f743261-34f5-4f48-8efd-78a0056e2e78 None admin] RBAC: Authorizing `identity:get_project(project_id=ef31df6af6414934be49044ddb61049d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:17.000613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f743261-34f5-4f48-8efd-78a0056e2e78 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:17.002353 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 225/435] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:16 2022] GET /identity/v3/projects/ef31df6af6414934be49044ddb61049d => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:17.003113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f743261-34f5-4f48-8efd-78a0056e2e78 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:17.078501 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 211/436] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:17.080465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc38fb-d793-4da7-89e8-83101bbbccca None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:17.080764 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc38fb-d793-4da7-89e8-83101bbbccca None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:17.081046 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc38fb-d793-4da7-89e8-83101bbbccca None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:17.086333 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 212/437] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:17.086333 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc38fb-d793-4da7-89e8-83101bbbccca None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:17.115407 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f743261-34f5-4f48-8efd-78a0056e2e78 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:17.148217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d35bd-c3f4-4787-80dd-10b3a38318b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:17.149043 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d35bd-c3f4-4787-80dd-10b3a38318b2 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:17.149330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d35bd-c3f4-4787-80dd-10b3a38318b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:17.149610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d35bd-c3f4-4787-80dd-10b3a38318b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:17.159942 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d35bd-c3f4-4787-80dd-10b3a38318b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:17.167974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-897d35bd-c3f4-4787-80dd-10b3a38318b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:17.167974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:17.167974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:17.167974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:17.167974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:17.167974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:17.167974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:17.167974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:17.167974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:17.167974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:17.167974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:17.167974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:17.167974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:17.167974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:17.167974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:17.167974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:17.169044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:17.169044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:17.169044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:17.169044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:17.169044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:17.169044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:17.169044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:17.169044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:17.169044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:17.169044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:17.169044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:17.169044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:17.169044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:17.169044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:17.169044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:17.169044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:17.169851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:17.169851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:17.169851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:17.169851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:17.169851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:17.169851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:17.169851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:17.169851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:17.169851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:17.169851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:17.169851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:17.169851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:17.169851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 226/438] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:37:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:17.170744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d35bd-c3f4-4787-80dd-10b3a38318b2 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:17.183624 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc38fb-d793-4da7-89e8-83101bbbccca None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:17.200516 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:17.215845 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:17.217019 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34acd97-288e-4478-8bad-1867f079f2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:17.217875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34acd97-288e-4478-8bad-1867f079f2cf None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:17.218161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34acd97-288e-4478-8bad-1867f079f2cf None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:17.218436 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34acd97-288e-4478-8bad-1867f079f2cf None admin] PATH_INFO: `/v3/groups/585490eb890c4f8289ce519dc9966e88` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:17.219624 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34acd97-288e-4478-8bad-1867f079f2cf None admin] RBAC: Authorizing `identity:get_group(group_id=585490eb890c4f8289ce519dc9966e88)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:17.221913 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34acd97-288e-4478-8bad-1867f079f2cf None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:17.223556 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 213/439] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:17 2022] GET /identity/v3/groups/585490eb890c4f8289ce519dc9966e88 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:17.224793 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f99c2-0e22-48eb-9799-49f0dbc586ba None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:17.225093 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f99c2-0e22-48eb-9799-49f0dbc586ba None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:17.225371 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f99c2-0e22-48eb-9799-49f0dbc586ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:17.240885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-113f99c2-0e22-48eb-9799-49f0dbc586ba None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:17.242704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-113f99c2-0e22-48eb-9799-49f0dbc586ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:17.273086 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d35bd-c3f4-4787-80dd-10b3a38318b2 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:17.308959 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91377ea-8d86-4458-a90a-ce5c8f8c772d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:17.309815 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 214/440] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:17.309958 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91377ea-8d86-4458-a90a-ce5c8f8c772d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:17.310154 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91377ea-8d86-4458-a90a-ce5c8f8c772d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:17.310363 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91377ea-8d86-4458-a90a-ce5c8f8c772d None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:17.310645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f99c2-0e22-48eb-9799-49f0dbc586ba None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:17.321417 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91377ea-8d86-4458-a90a-ce5c8f8c772d None admin] RBAC: Authorizing `identity:get_project(project_id=470cf0437a844f7484bc6b78d5b0de15)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:17.323043 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91377ea-8d86-4458-a90a-ce5c8f8c772d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:17.330123 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 227/441] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:17 2022] GET /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:17.330123 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91377ea-8d86-4458-a90a-ce5c8f8c772d None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:17.420026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f99c2-0e22-48eb-9799-49f0dbc586ba None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:17.435303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91377ea-8d86-4458-a90a-ce5c8f8c772d None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:17.436652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:17.448380 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:17.454441 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9bbd2-bb50-47d5-b31d-d918d48dc854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:17.455110 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9bbd2-bb50-47d5-b31d-d918d48dc854 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:17.455389 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9bbd2-bb50-47d5-b31d-d918d48dc854 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:17.455663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9bbd2-bb50-47d5-b31d-d918d48dc854 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:17.456402 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9bbd2-bb50-47d5-b31d-d918d48dc854 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:17.456736 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9bbd2-bb50-47d5-b31d-d918d48dc854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:17.458097 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9bbd2-bb50-47d5-b31d-d918d48dc854 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:17.465929 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 215/442] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:17.466638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9bbd2-bb50-47d5-b31d-d918d48dc854 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:17.473351 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5d84d-0d0c-4238-8f10-87080f7c16dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:17.474018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5d84d-0d0c-4238-8f10-87080f7c16dc None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:17.474304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5d84d-0d0c-4238-8f10-87080f7c16dc None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:17.474583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5d84d-0d0c-4238-8f10-87080f7c16dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:17.475423 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5d84d-0d0c-4238-8f10-87080f7c16dc None admin] RBAC: Adding query filter params (group.id=585490eb890c4f8289ce519dc9966e88, role.id=cfd7c6febb2246d4a48765a0aa8563bf, scope.project.id=ef31df6af6414934be49044ddb61049d) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:17.475737 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5d84d-0d0c-4238-8f10-87080f7c16dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:17.477225 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5d84d-0d0c-4238-8f10-87080f7c16dc None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:17.483352 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 228/443] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Jun 16 18:37:17 2022] GET /identity/v3/role_assignments?group.id=585490eb890c4f8289ce519dc9966e88&scope.project.id=ef31df6af6414934be49044ddb61049d&role.id=cfd7c6febb2246d4a48765a0aa8563bf => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:17.484046 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5d84d-0d0c-4238-8f10-87080f7c16dc None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:17.583171 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9bbd2-bb50-47d5-b31d-d918d48dc854 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:17.594616 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5d84d-0d0c-4238-8f10-87080f7c16dc None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:17.619851 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df596bb1-92f3-47f4-9411-fc68d7e604c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:17.620754 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df596bb1-92f3-47f4-9411-fc68d7e604c9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:17.621034 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df596bb1-92f3-47f4-9411-fc68d7e604c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:17.621313 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df596bb1-92f3-47f4-9411-fc68d7e604c9 None admin] PATH_INFO: `/v3/groups/585490eb890c4f8289ce519dc9966e88` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:17.622560 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df596bb1-92f3-47f4-9411-fc68d7e604c9 None admin] RBAC: Authorizing `identity:get_group(group_id=585490eb890c4f8289ce519dc9966e88)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:17.624049 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df596bb1-92f3-47f4-9411-fc68d7e604c9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:17.625795 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 216/444] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:17 2022] GET /identity/v3/groups/585490eb890c4f8289ce519dc9966e88 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:17.626579 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df596bb1-92f3-47f4-9411-fc68d7e604c9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:17.638930 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad68fef-bd51-49fb-8227-9bf2018c5762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:17.640031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad68fef-bd51-49fb-8227-9bf2018c5762 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:17.640620 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad68fef-bd51-49fb-8227-9bf2018c5762 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:17.640969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad68fef-bd51-49fb-8227-9bf2018c5762 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:17.652392 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad68fef-bd51-49fb-8227-9bf2018c5762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:17.661486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-bad68fef-bd51-49fb-8227-9bf2018c5762 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:17.661486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:17.661486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:17.661486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:17.661486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:17.661486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:17.661486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:17.661486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:17.661486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:17.661486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:17.661486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:17.661486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:17.661486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:17.661486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:17.661486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:17.661486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:17.662391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:17.662391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:17.662391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:17.662391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:17.662391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:17.662391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:17.662391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:17.662391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:17.662391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:17.662391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:17.662391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:17.662391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:17.662391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:17.662391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:17.662391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:17.662391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:17.663222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:17.663222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:17.663222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:17.663222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:17.663222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:17.663222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:17.663222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:17.663222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:17.663222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:17.663222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:17.663222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:17.663222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:17.663222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 229/445] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:17.663881 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad68fef-bd51-49fb-8227-9bf2018c5762 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:17.689910 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:17.710873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:17.756785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df596bb1-92f3-47f4-9411-fc68d7e604c9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:17.778834 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad68fef-bd51-49fb-8227-9bf2018c5762 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:17.795872 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65944c6a-0a60-4b82-8951-5e35ba7f0714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:17.796562 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65944c6a-0a60-4b82-8951-5e35ba7f0714 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:17.796854 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65944c6a-0a60-4b82-8951-5e35ba7f0714 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:17.797132 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65944c6a-0a60-4b82-8951-5e35ba7f0714 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:17.821983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18087ac-16d7-4234-a95e-a8892941a2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:17.822648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18087ac-16d7-4234-a95e-a8892941a2dc None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:17.822928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18087ac-16d7-4234-a95e-a8892941a2dc None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:17.823199 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18087ac-16d7-4234-a95e-a8892941a2dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:17.824050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18087ac-16d7-4234-a95e-a8892941a2dc None admin] RBAC: Adding query filter params (group.id=585490eb890c4f8289ce519dc9966e88, role.id=34f07ea559bb44a6b3d81c7c1ff19bbc, scope.project.id=470cf0437a844f7484bc6b78d5b0de15) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:17.824346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18087ac-16d7-4234-a95e-a8892941a2dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:17.825865 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18087ac-16d7-4234-a95e-a8892941a2dc None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:17.836642 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 230/446] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Jun 16 18:37:17 2022] GET /identity/v3/role_assignments?group.id=585490eb890c4f8289ce519dc9966e88&scope.project.id=470cf0437a844f7484bc6b78d5b0de15&role.id=34f07ea559bb44a6b3d81c7c1ff19bbc => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:17.836642 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18087ac-16d7-4234-a95e-a8892941a2dc None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:17.890350 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65944c6a-0a60-4b82-8951-5e35ba7f0714 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:17.892394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65944c6a-0a60-4b82-8951-5e35ba7f0714 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:17.944556 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:17.959346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18087ac-16d7-4234-a95e-a8892941a2dc None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:17.961034 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:17.998539 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378b243-b65b-463b-ae0b-2621fa6857e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:17.999221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378b243-b65b-463b-ae0b-2621fa6857e9 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:17.999505 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378b243-b65b-463b-ae0b-2621fa6857e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:17.999811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378b243-b65b-463b-ae0b-2621fa6857e9 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:18.000729 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378b243-b65b-463b-ae0b-2621fa6857e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:18.001289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378b243-b65b-463b-ae0b-2621fa6857e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:18.003186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378b243-b65b-463b-ae0b-2621fa6857e9 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:18.008744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 217/447] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:18.014924 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65944c6a-0a60-4b82-8951-5e35ba7f0714 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:18.016598 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 231/448] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:18.022081 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378b243-b65b-463b-ae0b-2621fa6857e9 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:18.142633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65944c6a-0a60-4b82-8951-5e35ba7f0714 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:18.145387 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378b243-b65b-463b-ae0b-2621fa6857e9 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:18.180702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3a525-d3c0-47e9-acdc-6eebf35738af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:18.181215 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3a525-d3c0-47e9-acdc-6eebf35738af None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:18.181435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3a525-d3c0-47e9-acdc-6eebf35738af None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:18.181706 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3a525-d3c0-47e9-acdc-6eebf35738af None admin] PATH_INFO: `/v3/projects/470cf0437a844f7484bc6b78d5b0de15` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:18.182894 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3a525-d3c0-47e9-acdc-6eebf35738af None admin] RBAC: Authorizing `identity:get_project(project_id=470cf0437a844f7484bc6b78d5b0de15)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:18.184508 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3a525-d3c0-47e9-acdc-6eebf35738af None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:18.186365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 218/449] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:18 2022] GET /identity/v3/projects/470cf0437a844f7484bc6b78d5b0de15 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:18.192061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3a525-d3c0-47e9-acdc-6eebf35738af None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:18.194140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c9f03-2ddd-4d91-9e30-483a0e090c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:18.194798 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c9f03-2ddd-4d91-9e30-483a0e090c0f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:18.195082 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c9f03-2ddd-4d91-9e30-483a0e090c0f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:18.195362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c9f03-2ddd-4d91-9e30-483a0e090c0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:18.210771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:18.228970 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:18.265140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c9f03-2ddd-4d91-9e30-483a0e090c0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:18.266640 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c9f03-2ddd-4d91-9e30-483a0e090c0f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:18.296540 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3a525-d3c0-47e9-acdc-6eebf35738af None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:18.331048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9e4da-62ec-4504-bc1b-41d76aa797af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:18.331911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9e4da-62ec-4504-bc1b-41d76aa797af None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:18.332197 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9e4da-62ec-4504-bc1b-41d76aa797af None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:18.332568 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9e4da-62ec-4504-bc1b-41d76aa797af None admin] PATH_INFO: `/v3/groups/585490eb890c4f8289ce519dc9966e88` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:18.333768 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9e4da-62ec-4504-bc1b-41d76aa797af None admin] RBAC: Authorizing `identity:get_group(group_id=585490eb890c4f8289ce519dc9966e88)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:18.335214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9e4da-62ec-4504-bc1b-41d76aa797af None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:18.336875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 219/450] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:18 2022] GET /identity/v3/groups/585490eb890c4f8289ce519dc9966e88 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:18.342655 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9e4da-62ec-4504-bc1b-41d76aa797af None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:18.365755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 232/451] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:18.371215 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c9f03-2ddd-4d91-9e30-483a0e090c0f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:18.422710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:18.432183 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:18.441161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9e4da-62ec-4504-bc1b-41d76aa797af None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:18.469045 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c9f03-2ddd-4d91-9e30-483a0e090c0f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:18.474898 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6cf7e-4900-4bc1-b6b8-2d96760aa883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:18.475559 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6cf7e-4900-4bc1-b6b8-2d96760aa883 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:18.475848 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6cf7e-4900-4bc1-b6b8-2d96760aa883 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:18.476135 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6cf7e-4900-4bc1-b6b8-2d96760aa883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:18.477009 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6cf7e-4900-4bc1-b6b8-2d96760aa883 None admin] RBAC: Adding query filter params (group.id=585490eb890c4f8289ce519dc9966e88, role.id=cfd7c6febb2246d4a48765a0aa8563bf, scope.project.id=470cf0437a844f7484bc6b78d5b0de15) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:18.477320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6cf7e-4900-4bc1-b6b8-2d96760aa883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:18.478767 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6cf7e-4900-4bc1-b6b8-2d96760aa883 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:18.484921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 220/452] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Jun 16 18:37:18 2022] GET /identity/v3/role_assignments?group.id=585490eb890c4f8289ce519dc9966e88&scope.project.id=470cf0437a844f7484bc6b78d5b0de15&role.id=cfd7c6febb2246d4a48765a0aa8563bf => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:18.504131 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451321d-e022-4ad1-9951-544b5fe12674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:18.505068 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451321d-e022-4ad1-9951-544b5fe12674 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:18.505363 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451321d-e022-4ad1-9951-544b5fe12674 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:18.505643 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451321d-e022-4ad1-9951-544b5fe12674 None admin] PATH_INFO: `/v3/projects/698d167bbea646fcaa71cda553a9912f` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:18.506935 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451321d-e022-4ad1-9951-544b5fe12674 None admin] RBAC: Authorizing `identity:get_project(project_id=698d167bbea646fcaa71cda553a9912f)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:18.508427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451321d-e022-4ad1-9951-544b5fe12674 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:18.510242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 233/453] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:18 2022] GET /identity/v3/projects/698d167bbea646fcaa71cda553a9912f => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:18.516129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6cf7e-4900-4bc1-b6b8-2d96760aa883 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:18.622487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6cf7e-4900-4bc1-b6b8-2d96760aa883 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:18.658060 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebb6ec-1e6d-4977-bf39-cd5834ecf9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:18.658918 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebb6ec-1e6d-4977-bf39-cd5834ecf9c5 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:18.659200 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebb6ec-1e6d-4977-bf39-cd5834ecf9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:18.659474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebb6ec-1e6d-4977-bf39-cd5834ecf9c5 None admin] PATH_INFO: `/v3/groups/94218c5a51674717b4e9dd80b8c7e24a` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:18.660762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebb6ec-1e6d-4977-bf39-cd5834ecf9c5 None admin] RBAC: Authorizing `identity:get_group(group_id=94218c5a51674717b4e9dd80b8c7e24a)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:18.662216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebb6ec-1e6d-4977-bf39-cd5834ecf9c5 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:18.663984 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 221/454] 10.222.0.93 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:18 2022] GET /identity/v3/groups/94218c5a51674717b4e9dd80b8c7e24a => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:18.670675 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451321d-e022-4ad1-9951-544b5fe12674 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:18.775191 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451321d-e022-4ad1-9951-544b5fe12674 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:18.804569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:18.809622 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2819c-cadf-418c-852f-b796be8d7a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:18.810280 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2819c-cadf-418c-852f-b796be8d7a15 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:18.810567 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2819c-cadf-418c-852f-b796be8d7a15 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:18.810847 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2819c-cadf-418c-852f-b796be8d7a15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:18.811685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2819c-cadf-418c-852f-b796be8d7a15 None admin] RBAC: Adding query filter params (group.id=94218c5a51674717b4e9dd80b8c7e24a, role.id=416a52031d5d49b6a3fa0e9baa814436, scope.project.id=698d167bbea646fcaa71cda553a9912f) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:18.812004 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2819c-cadf-418c-852f-b796be8d7a15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:18.813514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2819c-cadf-418c-852f-b796be8d7a15 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:18.819752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 234/455] 10.222.0.93 () {56 vars in 1376 bytes} [Thu Jun 16 18:37:18 2022] GET /identity/v3/role_assignments?group.id=94218c5a51674717b4e9dd80b8c7e24a&scope.project.id=698d167bbea646fcaa71cda553a9912f&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:21.590693 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bca5a-7669-4a4a-bcda-936961487831 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:21.591192 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bca5a-7669-4a4a-bcda-936961487831 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:21.591192 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bca5a-7669-4a4a-bcda-936961487831 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:21.592815 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 222/456] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:21.600341 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15571f0d-9071-48f6-ae18-fddb2e8fec50 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:21.600831 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15571f0d-9071-48f6-ae18-fddb2e8fec50 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:21.600931 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15571f0d-9071-48f6-ae18-fddb2e8fec50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:21.607550 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acd13a-7460-4eec-a656-43b9e05aad1e None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:21.612122 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acd13a-7460-4eec-a656-43b9e05aad1e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:21.612122 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acd13a-7460-4eec-a656-43b9e05aad1e None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:21.612122 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 223/457] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:37:21.624334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b755c-2e95-42b7-a0bd-b3cae4ea5ffb None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:21.624683 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b755c-2e95-42b7-a0bd-b3cae4ea5ffb None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:21.624923 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b755c-2e95-42b7-a0bd-b3cae4ea5ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:21.627610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-15571f0d-9071-48f6-ae18-fddb2e8fec50 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:21.628889 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-15571f0d-9071-48f6-ae18-fddb2e8fec50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:21.660303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-489b755c-2e95-42b7-a0bd-b3cae4ea5ffb None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:21.661528 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-489b755c-2e95-42b7-a0bd-b3cae4ea5ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:21.689304 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:21.734514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 235/458] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:37:21.736298 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1030009-70f8-441b-b5e5-8a93b1eadd80 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:21.736826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1030009-70f8-441b-b5e5-8a93b1eadd80 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:21.737311 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1030009-70f8-441b-b5e5-8a93b1eadd80 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:21.738984 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 236/459] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:21.747966 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f14150-dc13-44ce-acc4-f2c5a48f37e2 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:21.749286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f14150-dc13-44ce-acc4-f2c5a48f37e2 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:21.749922 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f14150-dc13-44ce-acc4-f2c5a48f37e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:21.768505 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 224/460] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:37:21.772376 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b755c-2e95-42b7-a0bd-b3cae4ea5ffb None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:21.782206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-57f14150-dc13-44ce-acc4-f2c5a48f37e2 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:21.789365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-57f14150-dc13-44ce-acc4-f2c5a48f37e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:21.872529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 237/461] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:37:21.873746 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f14150-dc13-44ce-acc4-f2c5a48f37e2 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:21.892702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b755c-2e95-42b7-a0bd-b3cae4ea5ffb None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:21.936309 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c10602-b43e-4471-a965-18bdaa495aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:21.937540 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c10602-b43e-4471-a965-18bdaa495aac None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:21.938550 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c10602-b43e-4471-a965-18bdaa495aac None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:21.947219 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c10602-b43e-4471-a965-18bdaa495aac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:21.955026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c10602-b43e-4471-a965-18bdaa495aac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:21.957444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c10602-b43e-4471-a965-18bdaa495aac None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:21.961035 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:21.967985 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:21.983707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-42c10602-b43e-4471-a965-18bdaa495aac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:21.983707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:21.983707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:21.983707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:21.983707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:21.983707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:21.983707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:21.983707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:21.983707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:21.983707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:21.983707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:21.983707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:21.983707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:21.983707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:21.983707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:21.985011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:21.985011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:21.985011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:21.985011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:21.985011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:21.985011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:21.985011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:21.985011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:21.985011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:21.985011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:21.985011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:21.985011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:21.985011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:21.985011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:21.985011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:21.985011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:21.985011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:21.985868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:21.985868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:21.985868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:21.985868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:21.985868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 225/462] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:21.991454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c10602-b43e-4471-a965-18bdaa495aac None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:22.016875 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f14150-dc13-44ce-acc4-f2c5a48f37e2 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:22.051502 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fbb4e-61b1-44d3-bf12-cab2b117bf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.052294 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fbb4e-61b1-44d3-bf12-cab2b117bf05 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.052673 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fbb4e-61b1-44d3-bf12-cab2b117bf05 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.053395 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fbb4e-61b1-44d3-bf12-cab2b117bf05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.065476 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fbb4e-61b1-44d3-bf12-cab2b117bf05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:22.066967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fbb4e-61b1-44d3-bf12-cab2b117bf05 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:22.088999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-1d1fbb4e-61b1-44d3-bf12-cab2b117bf05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:22.088999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:22.088999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:22.088999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:22.088999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:22.088999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:22.088999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:22.088999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:22.088999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:22.088999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:22.088999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:22.088999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:22.088999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:22.088999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:22.088999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:22.089921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:22.089921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:22.089921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:22.089921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:22.089921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:22.089921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:22.089921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:22.089921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:22.089921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:22.089921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:22.089921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:22.089921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:22.089921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:22.089921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:22.089921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:22.089921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:22.089921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:22.090793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:22.090793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:22.090793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:22.090793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:22.090793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 238/463] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:22.096002 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fbb4e-61b1-44d3-bf12-cab2b117bf05 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:22.113243 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c10602-b43e-4471-a965-18bdaa495aac None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:22.152143 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0962a67-23e8-4d84-a74a-4bf609d4121e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.152905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0962a67-23e8-4d84-a74a-4bf609d4121e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.153193 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0962a67-23e8-4d84-a74a-4bf609d4121e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.153471 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0962a67-23e8-4d84-a74a-4bf609d4121e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.164545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0962a67-23e8-4d84-a74a-4bf609d4121e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:22.165981 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0962a67-23e8-4d84-a74a-4bf609d4121e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:22.183964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-a0962a67-23e8-4d84-a74a-4bf609d4121e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:22.183964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:22.183964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:22.183964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:22.183964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:22.183964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:22.183964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:22.183964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:22.183964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:22.183964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:22.183964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:22.183964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:22.183964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:22.183964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:22.183964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:22.184879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:22.184879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:22.184879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:22.184879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:22.184879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:22.184879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:22.184879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:22.184879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:22.184879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:22.184879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:22.184879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:22.184879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:22.184879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:22.184879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:22.184879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:22.184879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:22.184879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:22.185725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:22.185725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:22.185725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:22.185725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:22.185725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 226/464] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:22.186517 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4513a-d619-4308-8775-7b299f469bf7 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.186680 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4513a-d619-4308-8775-7b299f469bf7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.187146 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4513a-d619-4308-8775-7b299f469bf7 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.192500 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 227/465] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:22.192500 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4513a-d619-4308-8775-7b299f469bf7 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:22.216015 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fbb4e-61b1-44d3-bf12-cab2b117bf05 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:22.225740 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:22.252348 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:22.255897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb6fd9-1f5c-448f-b6f4-46b59a28a6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.256608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb6fd9-1f5c-448f-b6f4-46b59a28a6f3 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.256939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb6fd9-1f5c-448f-b6f4-46b59a28a6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.257217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb6fd9-1f5c-448f-b6f4-46b59a28a6f3 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.257952 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb6fd9-1f5c-448f-b6f4-46b59a28a6f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:22.258264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb6fd9-1f5c-448f-b6f4-46b59a28a6f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:22.259703 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb6fd9-1f5c-448f-b6f4-46b59a28a6f3 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:22.283137 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 239/466] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:22.283137 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb6fd9-1f5c-448f-b6f4-46b59a28a6f3 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:22.309224 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4513a-d619-4308-8775-7b299f469bf7 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:22.346031 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497faa68-647a-4cd8-8c7a-096510919a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.346699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497faa68-647a-4cd8-8c7a-096510919a9a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.346980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497faa68-647a-4cd8-8c7a-096510919a9a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.347252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497faa68-647a-4cd8-8c7a-096510919a9a None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.347970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497faa68-647a-4cd8-8c7a-096510919a9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:22.348270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497faa68-647a-4cd8-8c7a-096510919a9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:22.349726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497faa68-647a-4cd8-8c7a-096510919a9a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:22.367853 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 228/467] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:22.367853 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62487fc7-2f55-40ba-b290-f16b17c42535 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.367853 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62487fc7-2f55-40ba-b290-f16b17c42535 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.367853 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62487fc7-2f55-40ba-b290-f16b17c42535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.385015 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-62487fc7-2f55-40ba-b290-f16b17c42535 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:22.386192 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-62487fc7-2f55-40ba-b290-f16b17c42535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:22.389515 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb6fd9-1f5c-448f-b6f4-46b59a28a6f3 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:22.427928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6eb7b4-320e-4dc5-a560-993f10f3a316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.428566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6eb7b4-320e-4dc5-a560-993f10f3a316 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.428856 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6eb7b4-320e-4dc5-a560-993f10f3a316 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.429142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6eb7b4-320e-4dc5-a560-993f10f3a316 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.429885 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6eb7b4-320e-4dc5-a560-993f10f3a316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:22.430537 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6eb7b4-320e-4dc5-a560-993f10f3a316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:22.431615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6eb7b4-320e-4dc5-a560-993f10f3a316 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:22.447553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 240/468] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:22.448285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6eb7b4-320e-4dc5-a560-993f10f3a316 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:22.474957 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 229/469] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:22.475619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62487fc7-2f55-40ba-b290-f16b17c42535 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:22.479104 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:22.519574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:22.564737 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6eb7b4-320e-4dc5-a560-993f10f3a316 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:22.586410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62487fc7-2f55-40ba-b290-f16b17c42535 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:22.602025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5701eaa-a1b4-4c0d-b1f5-2e931e16b43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.602694 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5701eaa-a1b4-4c0d-b1f5-2e931e16b43e None admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.603091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5701eaa-a1b4-4c0d-b1f5-2e931e16b43e None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.603365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5701eaa-a1b4-4c0d-b1f5-2e931e16b43e None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.604188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5701eaa-a1b4-4c0d-b1f5-2e931e16b43e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:22.605656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5701eaa-a1b4-4c0d-b1f5-2e931e16b43e None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:22.620932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e6f45-f053-47f4-9177-7758df5bd781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.625396 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e6f45-f053-47f4-9177-7758df5bd781 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.625396 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e6f45-f053-47f4-9177-7758df5bd781 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.625396 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e6f45-f053-47f4-9177-7758df5bd781 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.625396 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e6f45-f053-47f4-9177-7758df5bd781 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:22.625396 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e6f45-f053-47f4-9177-7758df5bd781 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:22.705174 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 241/470] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Jun 16 18:37:22 2022] POST /identity/v3/users => generated 248 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:22.705922 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5701eaa-a1b4-4c0d-b1f5-2e931e16b43e None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:22.736797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 230/471] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Jun 16 18:37:22 2022] POST /identity/v3/users => generated 248 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:22.736797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e6f45-f053-47f4-9177-7758df5bd781 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:22.873723 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:22.899992 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5701eaa-a1b4-4c0d-b1f5-2e931e16b43e None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:22.933869 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:22.945839 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e6f45-f053-47f4-9177-7758df5bd781 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:22.952156 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a275a63-d499-4112-85e9-5d0b2bdde8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.952890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a275a63-d499-4112-85e9-5d0b2bdde8dd None admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.953715 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a275a63-d499-4112-85e9-5d0b2bdde8dd None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.957682 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a275a63-d499-4112-85e9-5d0b2bdde8dd None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.957682 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a275a63-d499-4112-85e9-5d0b2bdde8dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:22.957682 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a275a63-d499-4112-85e9-5d0b2bdde8dd None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:22.989025 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d735a-043e-4006-b142-22acb58c0a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.990305 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d735a-043e-4006-b142-22acb58c0a2b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.990305 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d735a-043e-4006-b142-22acb58c0a2b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.990498 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d735a-043e-4006-b142-22acb58c0a2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:23.001290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d735a-043e-4006-b142-22acb58c0a2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:23.002726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d735a-043e-4006-b142-22acb58c0a2b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:23.021231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-352d735a-043e-4006-b142-22acb58c0a2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:23.021231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:23.021231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:23.021231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:23.021231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:23.021231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:23.021231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:23.021231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:23.021231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:23.021231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:23.021231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:23.021231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:23.021231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:23.021231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:23.021231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:23.022176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:23.022176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:23.022176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:23.022176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:23.022176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:23.022176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:23.022176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:23.022176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:23.022176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:23.022176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:23.022176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:23.022176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:23.022176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:23.022176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:23.022176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:23.022176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:23.022176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:23.023461 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:23.023461 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:23.023461 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:23.023461 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:23.023461 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 231/472] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:23.023932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051ea38-5934-4412-a3b8-fcc25f2bd44b None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:23.023932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051ea38-5934-4412-a3b8-fcc25f2bd44b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:23.024198 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051ea38-5934-4412-a3b8-fcc25f2bd44b None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:23.025627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 232/473] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:23.028651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051ea38-5934-4412-a3b8-fcc25f2bd44b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:23.051271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 242/474] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Jun 16 18:37:22 2022] POST /identity/v3/users => generated 246 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:23.057288 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef6f05-8abb-437b-9e50-b38dcb5fd945 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:23.058558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef6f05-8abb-437b-9e50-b38dcb5fd945 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:23.059098 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef6f05-8abb-437b-9e50-b38dcb5fd945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:23.089702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-26ef6f05-8abb-437b-9e50-b38dcb5fd945 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:23.091008 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-26ef6f05-8abb-437b-9e50-b38dcb5fd945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:23.172458 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 243/475] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:23.186216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051ea38-5934-4412-a3b8-fcc25f2bd44b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:23.228557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef6f05-8abb-437b-9e50-b38dcb5fd945 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:23.255311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48066bcd-a639-4cf0-8e9c-90b16a31c90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:23.255992 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48066bcd-a639-4cf0-8e9c-90b16a31c90f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:23.256280 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48066bcd-a639-4cf0-8e9c-90b16a31c90f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:23.257242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48066bcd-a639-4cf0-8e9c-90b16a31c90f None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:23.257995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48066bcd-a639-4cf0-8e9c-90b16a31c90f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:23.258308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48066bcd-a639-4cf0-8e9c-90b16a31c90f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:23.259706 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48066bcd-a639-4cf0-8e9c-90b16a31c90f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:23.283753 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 233/476] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:23.291879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48066bcd-a639-4cf0-8e9c-90b16a31c90f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:23.305497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:23.349541 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:23.392140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef6f05-8abb-437b-9e50-b38dcb5fd945 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:23.435718 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48066bcd-a639-4cf0-8e9c-90b16a31c90f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:23.447420 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd081ad-4302-450a-8bda-a0ba32bbf40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:23.448138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd081ad-4302-450a-8bda-a0ba32bbf40f None admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:23.448453 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd081ad-4302-450a-8bda-a0ba32bbf40f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:23.448768 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd081ad-4302-450a-8bda-a0ba32bbf40f None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:23.449863 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd081ad-4302-450a-8bda-a0ba32bbf40f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:23.451573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd081ad-4302-450a-8bda-a0ba32bbf40f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:23.481359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc96c5d-f00e-4af2-b795-669bb369e665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:23.482269 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc96c5d-f00e-4af2-b795-669bb369e665 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:23.482701 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc96c5d-f00e-4af2-b795-669bb369e665 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:23.483139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc96c5d-f00e-4af2-b795-669bb369e665 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:23.483999 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc96c5d-f00e-4af2-b795-669bb369e665 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:23.485709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc96c5d-f00e-4af2-b795-669bb369e665 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:23.492258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.sql.core [None req-6dd081ad-4302-450a-8bda-a0ba32bbf40f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 18:37:23.492258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 18:37:23.492258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [parameters: {'id': '81c9ac26265544eb9dc438e77895bdcd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 18:37:23.492258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86943) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 18:37:23.512409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-6dd081ad-4302-450a-8bda-a0ba32bbf40f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 18:37:23.512409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:23.512409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 18:37:23.512409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 18:37:23.512409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 18:37:23.512409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 18:37:23.512409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 18:37:23.512409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 18:37:23.512409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 18:37:23.512409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application conn.query(q) Jun 16 18:37:23.512409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 18:37:23.512409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 18:37:23.512409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 18:37:23.512409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application result.read() Jun 16 18:37:23.512409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 18:37:23.519144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 18:37:23.519144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 18:37:23.519144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 18:37:23.519144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 18:37:23.519144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 18:37:23.519144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 18:37:23.519144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 18:37:23.519144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 18:37:23.519144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:23.519144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 18:37:23.519144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:23.519144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:23.519144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 18:37:23.519144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 18:37:23.519144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 16 18:37:23.519144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return ref.to_dict() Jun 16 18:37:23.519144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 18:37:23.519144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application next(self.gen) Jun 16 18:37:23.520290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 18:37:23.520290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application yield resource Jun 16 18:37:23.520290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 18:37:23.520290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application next(self.gen) Jun 16 18:37:23.520290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 18:37:23.520290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 18:37:23.520290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:37:23.520290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 18:37:23.520290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:37:23.520290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise self.value Jun 16 18:37:23.520290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 18:37:23.520290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 18:37:23.520290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 18:37:23.520290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application session.commit() Jun 16 18:37:23.520290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 18:37:23.520290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 18:37:23.520290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 18:37:23.521437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 18:37:23.521437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 18:37:23.521437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self.session.flush() Jun 16 18:37:23.521437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 18:37:23.521437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 18:37:23.521437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 18:37:23.521437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 18:37:23.521437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 18:37:23.521437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application compat.raise_( Jun 16 18:37:23.521437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 18:37:23.521437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception Jun 16 18:37:23.521437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 18:37:23.521437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 18:37:23.521437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 18:37:23.521437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 18:37:23.521437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 18:37:23.521437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 18:37:23.522513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 18:37:23.522513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 18:37:23.522513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 18:37:23.522513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 18:37:23.522513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 18:37:23.522513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 18:37:23.522513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 18:37:23.522513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 18:37:23.522513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 18:37:23.522513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 18:37:23.522513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 18:37:23.522513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 18:37:23.522513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 18:37:23.522513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 18:37:23.522513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 18:37:23.522513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception Jun 16 18:37:23.523550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 18:37:23.523550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 18:37:23.523550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 18:37:23.523550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 18:37:23.523550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 18:37:23.523550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 18:37:23.523550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 18:37:23.523550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application conn.query(q) Jun 16 18:37:23.523550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 18:37:23.523550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 18:37:23.523550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 18:37:23.523550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application result.read() Jun 16 18:37:23.523550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 18:37:23.523550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 18:37:23.523550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 18:37:23.523550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 18:37:23.524564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 18:37:23.524564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 18:37:23.524564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 18:37:23.524564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 18:37:23.524564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 18:37:23.524564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 18:37:23.524564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [parameters: {'id': '81c9ac26265544eb9dc438e77895bdcd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 18:37:23.524564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 18:37:23.524564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:23.524564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:23.524564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:23.524564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:23.524564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:23.524564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:23.524564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:23.524564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:23.525573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:23.525573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:23.525573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:23.525573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:23.525573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:23.525573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:23.525573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 16 18:37:23.525573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 16 18:37:23.525573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:23.525573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:23.525573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 16 18:37:23.525573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 16 18:37:23.525573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 18:37:23.525573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 18:37:23.525573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 18:37:23.525573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:23.526667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 244/477] 10.222.0.93 () {60 vars in 1131 bytes} [Thu Jun 16 18:37:23 2022] POST /identity/v3/roles => generated 144 bytes in 286 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:23.528552 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd081ad-4302-450a-8bda-a0ba32bbf40f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:23.607765 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 234/478] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Jun 16 18:37:23 2022] POST /identity/v3/users => generated 249 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:23.644302 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd081ad-4302-450a-8bda-a0ba32bbf40f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:23.688672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3439b0-bab4-4d03-bd46-4c246a3aa723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:23.689506 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3439b0-bab4-4d03-bd46-4c246a3aa723 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:23.689795 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3439b0-bab4-4d03-bd46-4c246a3aa723 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:23.690074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3439b0-bab4-4d03-bd46-4c246a3aa723 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:23.692207 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:23.706729 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3439b0-bab4-4d03-bd46-4c246a3aa723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:23.714822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-fd3439b0-bab4-4d03-bd46-4c246a3aa723 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:23.714822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:23.714822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:23.714822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:23.714822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:23.714822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:23.714822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:23.714822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:23.714822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:23.714822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:23.714822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:23.714822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:23.714822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:23.714822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:23.714822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:23.714822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:23.715842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:23.715842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:23.715842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:23.715842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:23.715842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:23.715842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:23.715842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:23.715842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:23.715842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:23.715842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:23.715842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:23.715842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:23.715842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:23.715842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:23.715842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:23.715842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:23.716646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:23.716646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:23.716646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:23.716646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:23.716646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:23.716646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:23.716646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:23.716646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:23.716646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:23.716646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:23.716646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:23.716646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:23.716646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 245/479] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:37:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:23.722491 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc96c5d-f00e-4af2-b795-669bb369e665 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:23.791801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:23.834242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc96c5d-f00e-4af2-b795-669bb369e665 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:23.880742 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fce8ff-b6d8-47ef-a299-8588d1bc7244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:23.881437 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fce8ff-b6d8-47ef-a299-8588d1bc7244 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:23.881724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fce8ff-b6d8-47ef-a299-8588d1bc7244 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:23.882002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fce8ff-b6d8-47ef-a299-8588d1bc7244 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:23.882766 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fce8ff-b6d8-47ef-a299-8588d1bc7244 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:23.883078 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fce8ff-b6d8-47ef-a299-8588d1bc7244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:23.884471 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fce8ff-b6d8-47ef-a299-8588d1bc7244 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:23.897651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 235/480] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:25.368161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582507d-145f-4dc6-99e5-e7421014d1b2 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:25.368707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582507d-145f-4dc6-99e5-e7421014d1b2 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:25.368814 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582507d-145f-4dc6-99e5-e7421014d1b2 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:25.370260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 246/481] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:25.371659 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45385ea8-80c9-4443-a8c4-a9dac46470b5 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:25.372026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45385ea8-80c9-4443-a8c4-a9dac46470b5 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:25.372225 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45385ea8-80c9-4443-a8c4-a9dac46470b5 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:25.373595 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 236/482] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:25.380396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de909d57-a3ef-4b3a-9b39-5ec6532bfe39 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:25.380750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de909d57-a3ef-4b3a-9b39-5ec6532bfe39 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:25.380979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de909d57-a3ef-4b3a-9b39-5ec6532bfe39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:25.393943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba66ccd-2f22-44b7-b55d-ad26125b5bcf None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:25.394223 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba66ccd-2f22-44b7-b55d-ad26125b5bcf None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:25.394513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba66ccd-2f22-44b7-b55d-ad26125b5bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:25.403207 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-de909d57-a3ef-4b3a-9b39-5ec6532bfe39 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:25.404394 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-de909d57-a3ef-4b3a-9b39-5ec6532bfe39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:25.429164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-0ba66ccd-2f22-44b7-b55d-ad26125b5bcf None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:25.430400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0ba66ccd-2f22-44b7-b55d-ad26125b5bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:25.539822 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 237/483] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:25.568506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba66ccd-2f22-44b7-b55d-ad26125b5bcf None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:25.571159 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 247/484] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:37:25.594792 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de909d57-a3ef-4b3a-9b39-5ec6532bfe39 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:25.656593 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:25.704549 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba66ccd-2f22-44b7-b55d-ad26125b5bcf None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:25.744538 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b9220-6327-4825-b5f6-00e5537de629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:25.745743 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b9220-6327-4825-b5f6-00e5537de629 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:25.747919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b9220-6327-4825-b5f6-00e5537de629 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:25.748428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b9220-6327-4825-b5f6-00e5537de629 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:25.768691 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b9220-6327-4825-b5f6-00e5537de629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:25.779202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-285b9220-6327-4825-b5f6-00e5537de629 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:25.779202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:25.779202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:25.779202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:25.779202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:25.779202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:25.779202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:25.779202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:25.779202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:25.779202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:25.779202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:25.779202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:25.779202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:25.779202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:25.779202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:25.779202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:25.780381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:25.780381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:25.780381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:25.780381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:25.780381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:25.780381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:25.780381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:25.780381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:25.780381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:25.780381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:25.780381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:25.780381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:25.780381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:25.780381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:25.780381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:25.780381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:25.781968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:25.781968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:25.781968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:25.781968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:25.781968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:25.781968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:25.781968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:25.781968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:25.781968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:25.781968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:25.781968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:25.781968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:25.794364 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 238/485] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:25.800371 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b9220-6327-4825-b5f6-00e5537de629 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:25.804089 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de909d57-a3ef-4b3a-9b39-5ec6532bfe39 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:25.855811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:25.874100 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81add29-a6e5-41eb-a8d5-0299889a80a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:25.875038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81add29-a6e5-41eb-a8d5-0299889a80a8 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:25.875401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81add29-a6e5-41eb-a8d5-0299889a80a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:25.875755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81add29-a6e5-41eb-a8d5-0299889a80a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:25.889641 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81add29-a6e5-41eb-a8d5-0299889a80a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:25.901427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-d81add29-a6e5-41eb-a8d5-0299889a80a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:25.901427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:25.901427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:25.901427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:25.901427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:25.901427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:25.901427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:25.901427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:25.901427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:25.901427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:25.901427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:25.901427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:25.901427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:25.901427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:25.901427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:25.901427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:25.902557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:25.902557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:25.902557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:25.902557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:25.902557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:25.902557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:25.902557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:25.902557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:25.902557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:25.902557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:25.902557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:25.902557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:25.902557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:25.902557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:25.902557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:25.902557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:25.903569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:25.903569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:25.903569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:25.903569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:25.903569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:25.903569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:25.903569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:25.903569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:25.903569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:25.903569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:25.903569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:25.903569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:25.908033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 248/486] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:25.910141 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde7ff2-5664-4945-a178-eba1db00bd93 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:25.910446 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde7ff2-5664-4945-a178-eba1db00bd93 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:25.910726 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde7ff2-5664-4945-a178-eba1db00bd93 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:25.912344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 249/487] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:25.917510 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde7ff2-5664-4945-a178-eba1db00bd93 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:25.955977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b9220-6327-4825-b5f6-00e5537de629 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:25.974590 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:25.997948 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55dfdf-1354-49a6-8f5c-28d61991d560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:25.998639 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55dfdf-1354-49a6-8f5c-28d61991d560 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:25.998928 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55dfdf-1354-49a6-8f5c-28d61991d560 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:25.999210 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55dfdf-1354-49a6-8f5c-28d61991d560 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.000566 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55dfdf-1354-49a6-8f5c-28d61991d560 None admin] RBAC: Adding query filter params (name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:26.000881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55dfdf-1354-49a6-8f5c-28d61991d560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:26.002267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55dfdf-1354-49a6-8f5c-28d61991d560 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:26.011677 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 239/488] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:26.013031 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe89f75-e4ab-4f7a-8e39-4cb5992d48a4 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.013324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe89f75-e4ab-4f7a-8e39-4cb5992d48a4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.013607 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe89f75-e4ab-4f7a-8e39-4cb5992d48a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.030793 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6fe89f75-e4ab-4f7a-8e39-4cb5992d48a4 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:26.031994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6fe89f75-e4ab-4f7a-8e39-4cb5992d48a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:26.058042 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde7ff2-5664-4945-a178-eba1db00bd93 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:26.101482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594779d5-1c59-4fcc-a513-b5508b94b05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:26.102182 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594779d5-1c59-4fcc-a513-b5508b94b05a None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.102473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594779d5-1c59-4fcc-a513-b5508b94b05a None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.102757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594779d5-1c59-4fcc-a513-b5508b94b05a None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.104008 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594779d5-1c59-4fcc-a513-b5508b94b05a None admin] RBAC: Adding query filter params (name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:26.104008 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594779d5-1c59-4fcc-a513-b5508b94b05a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:26.105396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594779d5-1c59-4fcc-a513-b5508b94b05a None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:26.115865 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 250/489] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:26.116978 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594779d5-1c59-4fcc-a513-b5508b94b05a None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:26.123071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 240/490] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:26.124208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe89f75-e4ab-4f7a-8e39-4cb5992d48a4 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:26.194483 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:26.248035 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594779d5-1c59-4fcc-a513-b5508b94b05a None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:26.254579 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe89f75-e4ab-4f7a-8e39-4cb5992d48a4 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:26.264261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:26.289186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dc51a-a5f8-41ac-8348-9784963d28b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:26.289998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dc51a-a5f8-41ac-8348-9784963d28b5 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.290289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dc51a-a5f8-41ac-8348-9784963d28b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.290571 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dc51a-a5f8-41ac-8348-9784963d28b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.300804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a55eb8-fc4c-4b4b-9d07-ff844d485ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:26.301938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a55eb8-fc4c-4b4b-9d07-ff844d485ab7 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.302428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a55eb8-fc4c-4b4b-9d07-ff844d485ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.302904 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a55eb8-fc4c-4b4b-9d07-ff844d485ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.304021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dc51a-a5f8-41ac-8348-9784963d28b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:26.305555 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dc51a-a5f8-41ac-8348-9784963d28b5 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:26.314289 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a55eb8-fc4c-4b4b-9d07-ff844d485ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:26.316078 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a55eb8-fc4c-4b4b-9d07-ff844d485ab7 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:26.323398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-6b6dc51a-a5f8-41ac-8348-9784963d28b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:26.323398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:26.323398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:26.323398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:26.323398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:26.323398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:26.323398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:26.323398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:26.323398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:26.323398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:26.323398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:26.323398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:26.323398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:26.323398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:26.323398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:26.330732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:26.330732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:26.330732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:26.330732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:26.330732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:26.330732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:26.330732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:26.330732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:26.330732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:26.330732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:26.330732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:26.330732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:26.330732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:26.330732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:26.330732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:26.330732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:26.330732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:26.331611 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:26.331611 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:26.331611 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:26.331611 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:26.331611 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 251/491] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:26.331611 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dc51a-a5f8-41ac-8348-9784963d28b5 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:26.336979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-d1a55eb8-fc4c-4b4b-9d07-ff844d485ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:26.336979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:26.336979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:26.336979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:26.336979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:26.336979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:26.336979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:26.336979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:26.336979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:26.336979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:26.336979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:26.336979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:26.336979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:26.336979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:26.336979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:26.337821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:26.337821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:26.337821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:26.337821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:26.337821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:26.337821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:26.337821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:26.337821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:26.337821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:26.337821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:26.337821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:26.337821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:26.337821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:26.337821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:26.337821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:26.337821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:26.337821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:26.338683 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:26.338683 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:26.338683 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:26.338683 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:26.340951 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 241/492] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:26.341960 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a55eb8-fc4c-4b4b-9d07-ff844d485ab7 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:26.454457 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:26.458552 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dc51a-a5f8-41ac-8348-9784963d28b5 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:26.458696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a55eb8-fc4c-4b4b-9d07-ff844d485ab7 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:26.494704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac28ca-8139-43bf-9d7f-d9df08c8d531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:26.495424 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac28ca-8139-43bf-9d7f-d9df08c8d531 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.495712 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac28ca-8139-43bf-9d7f-d9df08c8d531 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.495813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6a769-9621-4adf-ad0e-f2281f61e969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:26.495987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac28ca-8139-43bf-9d7f-d9df08c8d531 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.496540 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6a769-9621-4adf-ad0e-f2281f61e969 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.496811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac28ca-8139-43bf-9d7f-d9df08c8d531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:26.496907 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6a769-9621-4adf-ad0e-f2281f61e969 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.497102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6a769-9621-4adf-ad0e-f2281f61e969 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.497195 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac28ca-8139-43bf-9d7f-d9df08c8d531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:26.498554 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac28ca-8139-43bf-9d7f-d9df08c8d531 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:26.508449 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6a769-9621-4adf-ad0e-f2281f61e969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:26.515921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 242/493] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:26.515921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac28ca-8139-43bf-9d7f-d9df08c8d531 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:26.516559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-27e6a769-9621-4adf-ad0e-f2281f61e969 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:26.516559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:26.516559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:26.516559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:26.516559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:26.516559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:26.516559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:26.516559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:26.516559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:26.516559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:26.516559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:26.516559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:26.516559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:26.516559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:26.516559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:26.516559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:26.517465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:26.517465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:26.517465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:26.517465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:26.517465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:26.517465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:26.517465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:26.517465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:26.517465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:26.517465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:26.517465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:26.517465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:26.517465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:26.517465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:26.517465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:26.517465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:26.519759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:26.519759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:26.519759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:26.519759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:26.519759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:26.519759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:26.519759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:26.519759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:26.519759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:26.519759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:26.519759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:26.519759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:26.519759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 252/494] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:26.519759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f32697-c263-447e-aa82-b359df0d8ade None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.520512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f32697-c263-447e-aa82-b359df0d8ade None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.520512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f32697-c263-447e-aa82-b359df0d8ade None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.525572 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 253/495] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:26.526833 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f32697-c263-447e-aa82-b359df0d8ade None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:26.544048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:26.624978 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac28ca-8139-43bf-9d7f-d9df08c8d531 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:26.638864 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f32697-c263-447e-aa82-b359df0d8ade None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:26.658801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7c154-460b-4cad-9967-82c822396fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:26.659462 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7c154-460b-4cad-9967-82c822396fcb None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.659782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7c154-460b-4cad-9967-82c822396fcb None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.660059 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7c154-460b-4cad-9967-82c822396fcb None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.660804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7c154-460b-4cad-9967-82c822396fcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:26.661114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7c154-460b-4cad-9967-82c822396fcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:26.662476 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7c154-460b-4cad-9967-82c822396fcb None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:26.673698 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eddc58-35e7-452f-9540-39a0dddab099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:26.674418 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 243/496] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:26.674538 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eddc58-35e7-452f-9540-39a0dddab099 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.674757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eddc58-35e7-452f-9540-39a0dddab099 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.675028 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eddc58-35e7-452f-9540-39a0dddab099 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.675723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca596c17-b4c4-4d43-bfff-80244279456a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.676018 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca596c17-b4c4-4d43-bfff-80244279456a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.676298 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca596c17-b4c4-4d43-bfff-80244279456a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.687476 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eddc58-35e7-452f-9540-39a0dddab099 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:26.689003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eddc58-35e7-452f-9540-39a0dddab099 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:26.693526 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-ca596c17-b4c4-4d43-bfff-80244279456a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:26.694716 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ca596c17-b4c4-4d43-bfff-80244279456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:26.705545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-a3eddc58-35e7-452f-9540-39a0dddab099 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 18:37:26.705545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:26.705545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:26.705545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:26.705545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:26.705545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:26.705545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:26.705545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:26.705545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:26.705545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:26.705545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:26.705545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:26.705545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:26.705545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:26.705545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:26.705545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:26.706561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:26.706561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:26.706561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:26.706561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:26.706561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:26.706561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:26.706561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:26.706561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:26.706561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:26.706561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:26.706561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:26.706561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:26.706561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:26.706561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:26.706561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:26.706561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:26.706561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:26.706561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:26.707462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:26.707462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:26.707462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:26.707462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:26.707462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:26.707462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:26.707462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:26.707462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:26.707462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 18:37:26.707462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:26.707462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 254/497] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:26.708043 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eddc58-35e7-452f-9540-39a0dddab099 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:26.730039 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:26.791221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 244/498] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:26.792564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab3422-5092-461e-af26-929806903520 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.792860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab3422-5092-461e-af26-929806903520 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.793126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab3422-5092-461e-af26-929806903520 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.794543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 245/499] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:26.795034 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab3422-5092-461e-af26-929806903520 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:26.805013 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:26.829645 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eddc58-35e7-452f-9540-39a0dddab099 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:26.863782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60e138-1f05-4611-852e-4ba30d487158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:26.864483 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60e138-1f05-4611-852e-4ba30d487158 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.864766 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60e138-1f05-4611-852e-4ba30d487158 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.865043 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60e138-1f05-4611-852e-4ba30d487158 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.865791 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60e138-1f05-4611-852e-4ba30d487158 None admin] RBAC: Adding query filter params (name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:26.866104 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60e138-1f05-4611-852e-4ba30d487158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:26.867491 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60e138-1f05-4611-852e-4ba30d487158 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:26.875993 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 255/500] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:26.876765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60e138-1f05-4611-852e-4ba30d487158 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:26.895493 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab3422-5092-461e-af26-929806903520 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:26.930164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee731cbf-def8-413e-a0fd-8a0b11fa26b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:26.930958 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee731cbf-def8-413e-a0fd-8a0b11fa26b4 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.931245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee731cbf-def8-413e-a0fd-8a0b11fa26b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.931530 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee731cbf-def8-413e-a0fd-8a0b11fa26b4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.938494 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee731cbf-def8-413e-a0fd-8a0b11fa26b4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:26.939940 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee731cbf-def8-413e-a0fd-8a0b11fa26b4 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:26.956106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-ee731cbf-def8-413e-a0fd-8a0b11fa26b4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 18:37:26.956106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:26.956106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:26.956106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:26.956106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:26.956106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:26.956106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:26.956106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:26.956106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:26.956106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:26.956106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:26.956106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:26.956106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:26.956106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:26.956106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:26.956106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:26.957065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:26.957065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:26.957065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:26.957065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:26.957065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:26.957065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:26.957065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:26.957065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:26.957065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:26.957065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:26.957065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:26.957065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:26.957065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:26.957065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:26.957065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:26.957065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:26.957065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:26.957065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:26.957980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:26.957980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:26.957980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:26.957980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:26.957980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:26.957980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:26.957980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:26.957980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:26.957980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 18:37:26.957980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:26.958498 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:26.958569 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 246/501] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:26.960862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371d5d1-86c5-472d-9895-2d0e855b21f3 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.961153 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371d5d1-86c5-472d-9895-2d0e855b21f3 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.961435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371d5d1-86c5-472d-9895-2d0e855b21f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.978051 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60e138-1f05-4611-852e-4ba30d487158 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:26.979165 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b371d5d1-86c5-472d-9895-2d0e855b21f3 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:26.980366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b371d5d1-86c5-472d-9895-2d0e855b21f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:27.010518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549aa0ac-07a1-4a0b-b878-b2e05cb80fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.011192 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549aa0ac-07a1-4a0b-b878-b2e05cb80fc1 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.011479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549aa0ac-07a1-4a0b-b878-b2e05cb80fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.011759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549aa0ac-07a1-4a0b-b878-b2e05cb80fc1 None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.012638 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549aa0ac-07a1-4a0b-b878-b2e05cb80fc1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:27.012956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549aa0ac-07a1-4a0b-b878-b2e05cb80fc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:27.014417 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549aa0ac-07a1-4a0b-b878-b2e05cb80fc1 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:27.041588 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:27.046789 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 247/502] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:27.048550 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371d5d1-86c5-472d-9895-2d0e855b21f3 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.050608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 256/503] 10.222.0.93 () {56 vars in 1137 bytes} [Thu Jun 16 18:37:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:27.051427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549aa0ac-07a1-4a0b-b878-b2e05cb80fc1 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.163142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549aa0ac-07a1-4a0b-b878-b2e05cb80fc1 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.170761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371d5d1-86c5-472d-9895-2d0e855b21f3 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.196076 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08f299-ea35-405d-9784-62a8ff6ebc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.196895 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08f299-ea35-405d-9784-62a8ff6ebc8f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.197180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08f299-ea35-405d-9784-62a8ff6ebc8f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.197451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08f299-ea35-405d-9784-62a8ff6ebc8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.204236 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:27.204351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0ece8-7fd4-4d83-948f-0a074d417c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.205129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0ece8-7fd4-4d83-948f-0a074d417c21 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.205415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0ece8-7fd4-4d83-948f-0a074d417c21 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.205698 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0ece8-7fd4-4d83-948f-0a074d417c21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.207744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08f299-ea35-405d-9784-62a8ff6ebc8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:27.209250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08f299-ea35-405d-9784-62a8ff6ebc8f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:27.215724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0ece8-7fd4-4d83-948f-0a074d417c21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:27.217206 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0ece8-7fd4-4d83-948f-0a074d417c21 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:27.226284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-ee08f299-ea35-405d-9784-62a8ff6ebc8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:27.226284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:27.226284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:27.226284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:27.226284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:27.226284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:27.226284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:27.226284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:27.226284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:27.226284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:27.226284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:27.226284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:27.226284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:27.226284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:27.226284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:27.227201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:27.227201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:27.227201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:27.227201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:27.227201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:27.227201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:27.227201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:27.227201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:27.227201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:27.227201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:27.227201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:27.227201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:27.227201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:27.227201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:27.227201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:27.227201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:27.227201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:27.228037 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:27.228037 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:27.228037 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:27.228037 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:27.228037 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 257/504] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:27.228322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08f299-ea35-405d-9784-62a8ff6ebc8f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.234725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-c1a0ece8-7fd4-4d83-948f-0a074d417c21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:27.234725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:27.234725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:27.234725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:27.234725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:27.234725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:27.234725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:27.234725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:27.234725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:27.234725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:27.234725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:27.234725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:27.234725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:27.234725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:27.234725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:27.235584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:27.235584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:27.235584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:27.235584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:27.235584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:27.235584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:27.235584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:27.235584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:27.235584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:27.235584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:27.235584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:27.235584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:27.235584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:27.235584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:27.235584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:27.235584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:27.235584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:27.236459 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:27.236459 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:27.236459 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:27.236459 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:27.236459 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 248/505] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:27.236742 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0ece8-7fd4-4d83-948f-0a074d417c21 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.290127 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:27.332968 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08f299-ea35-405d-9784-62a8ff6ebc8f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.339534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0ece8-7fd4-4d83-948f-0a074d417c21 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.367103 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceef47-3aa0-4b76-bd2a-39db9c70ca5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.367804 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceef47-3aa0-4b76-bd2a-39db9c70ca5f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.368091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceef47-3aa0-4b76-bd2a-39db9c70ca5f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.368372 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceef47-3aa0-4b76-bd2a-39db9c70ca5f None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.369236 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ceef47-3aa0-4b76-bd2a-39db9c70ca5f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:27.369550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ceef47-3aa0-4b76-bd2a-39db9c70ca5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:27.370985 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ceef47-3aa0-4b76-bd2a-39db9c70ca5f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:27.373652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b154a-e378-406b-9256-8d228e1d73e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.374336 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b154a-e378-406b-9256-8d228e1d73e2 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.374623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b154a-e378-406b-9256-8d228e1d73e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.374904 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b154a-e378-406b-9256-8d228e1d73e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.387468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 258/506] 10.222.0.93 () {56 vars in 1137 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:27.388279 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceef47-3aa0-4b76-bd2a-39db9c70ca5f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.436295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:27.445274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b154a-e378-406b-9256-8d228e1d73e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:27.446791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b154a-e378-406b-9256-8d228e1d73e2 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:27.485852 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceef47-3aa0-4b76-bd2a-39db9c70ca5f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.494162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:27.520899 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c025d-6a33-4d3f-aef5-bc414a124544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.521695 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c025d-6a33-4d3f-aef5-bc414a124544 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.521982 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c025d-6a33-4d3f-aef5-bc414a124544 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.522259 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c025d-6a33-4d3f-aef5-bc414a124544 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.532615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c025d-6a33-4d3f-aef5-bc414a124544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:27.540285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-b46c025d-6a33-4d3f-aef5-bc414a124544 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:27.540285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:27.540285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:27.540285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:27.540285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:27.540285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:27.540285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:27.540285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:27.540285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:27.540285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:27.540285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:27.540285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:27.540285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:27.540285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:27.540285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:27.540285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:27.541379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:27.541379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:27.541379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:27.541379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:27.541379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:27.541379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:27.541379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:27.541379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:27.541379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:27.541379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:27.541379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:27.541379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:27.541379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:27.541379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:27.541379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:27.541379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:27.542416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:27.542416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:27.542416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:27.542416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:27.542416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:27.542416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:27.542416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:27.542416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:27.542416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:27.542416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:27.542416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:27.542416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:27.542416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 259/507] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:27.542416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c025d-6a33-4d3f-aef5-bc414a124544 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.546776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 249/508] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:27.548735 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b154a-e378-406b-9256-8d228e1d73e2 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.641768 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c025d-6a33-4d3f-aef5-bc414a124544 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.645296 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b154a-e378-406b-9256-8d228e1d73e2 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.650266 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:27.673739 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3de22-2abc-4cfd-8438-8109f769cd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.674398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3de22-2abc-4cfd-8438-8109f769cd7b None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.674681 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3de22-2abc-4cfd-8438-8109f769cd7b None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.674962 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3de22-2abc-4cfd-8438-8109f769cd7b None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.675670 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3de22-2abc-4cfd-8438-8109f769cd7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:27.675975 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3de22-2abc-4cfd-8438-8109f769cd7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:27.677365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3de22-2abc-4cfd-8438-8109f769cd7b None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:27.679542 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129003e-d7d1-41c9-a05b-42e5b2621d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.680204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129003e-d7d1-41c9-a05b-42e5b2621d35 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.680522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129003e-d7d1-41c9-a05b-42e5b2621d35 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.680802 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129003e-d7d1-41c9-a05b-42e5b2621d35 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.681523 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129003e-d7d1-41c9-a05b-42e5b2621d35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:27.681831 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129003e-d7d1-41c9-a05b-42e5b2621d35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:27.683194 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129003e-d7d1-41c9-a05b-42e5b2621d35 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:27.690611 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 260/509] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:27.691454 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3de22-2abc-4cfd-8438-8109f769cd7b None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.695069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 250/510] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:27.695870 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129003e-d7d1-41c9-a05b-42e5b2621d35 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.708815 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:27.793227 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129003e-d7d1-41c9-a05b-42e5b2621d35 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.793418 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3de22-2abc-4cfd-8438-8109f769cd7b None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.826580 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392f2dd-e582-4e55-90f5-e43f34409a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.826749 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3761fd-8b96-436e-8029-aad0ae585270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.827266 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3761fd-8b96-436e-8029-aad0ae585270 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.827371 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392f2dd-e582-4e55-90f5-e43f34409a1f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.827548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392f2dd-e582-4e55-90f5-e43f34409a1f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.827647 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3761fd-8b96-436e-8029-aad0ae585270 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.827824 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392f2dd-e582-4e55-90f5-e43f34409a1f None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.827932 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3761fd-8b96-436e-8029-aad0ae585270 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.828598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392f2dd-e582-4e55-90f5-e43f34409a1f None admin] RBAC: Adding query filter params (name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:27.828905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392f2dd-e582-4e55-90f5-e43f34409a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:27.830274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392f2dd-e582-4e55-90f5-e43f34409a1f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:27.838362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 251/511] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:27.839137 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392f2dd-e582-4e55-90f5-e43f34409a1f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.862861 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:27.894902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3761fd-8b96-436e-8029-aad0ae585270 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:27.896358 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3761fd-8b96-436e-8029-aad0ae585270 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:27.908654 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:27.937155 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392f2dd-e582-4e55-90f5-e43f34409a1f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.970839 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8355e-6141-4430-bcd2-0c4647cb29ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.971564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8355e-6141-4430-bcd2-0c4647cb29ef None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.971846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8355e-6141-4430-bcd2-0c4647cb29ef None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.972124 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8355e-6141-4430-bcd2-0c4647cb29ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.982501 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8355e-6141-4430-bcd2-0c4647cb29ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:27.984553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8355e-6141-4430-bcd2-0c4647cb29ef None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:27.992988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 261/512] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:27.993817 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3761fd-8b96-436e-8029-aad0ae585270 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:28.005261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-16f8355e-6141-4430-bcd2-0c4647cb29ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:28.005261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:28.005261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:28.005261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:28.005261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:28.005261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:28.005261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:28.005261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:28.005261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:28.005261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:28.005261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:28.005261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:28.005261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:28.005261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:28.005261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:28.006139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:28.006139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:28.006139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:28.006139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:28.006139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:28.006139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:28.006139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:28.006139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:28.006139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:28.006139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:28.006139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:28.006139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:28.006139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:28.006139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:28.006139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:28.006139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:28.006139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:28.007072 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:28.007072 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:28.007072 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:28.007072 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:28.008572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 252/513] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:28.009520 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8355e-6141-4430-bcd2-0c4647cb29ef None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:28.060806 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.092163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3761fd-8b96-436e-8029-aad0ae585270 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:28.107275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8355e-6141-4430-bcd2-0c4647cb29ef None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:28.126663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c333b2-19c9-4d01-bf42-6d8c6172c43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:28.127625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c333b2-19c9-4d01-bf42-6d8c6172c43d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.127914 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c333b2-19c9-4d01-bf42-6d8c6172c43d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.128190 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c333b2-19c9-4d01-bf42-6d8c6172c43d None admin] PATH_INFO: `/v3/users/nova` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.130021 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.135815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c333b2-19c9-4d01-bf42-6d8c6172c43d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:28.137310 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c333b2-19c9-4d01-bf42-6d8c6172c43d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:28.140918 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e678e-bdfe-4808-a01d-95293497c683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:28.141586 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e678e-bdfe-4808-a01d-95293497c683 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.141870 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e678e-bdfe-4808-a01d-95293497c683 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.142144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e678e-bdfe-4808-a01d-95293497c683 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.142858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e678e-bdfe-4808-a01d-95293497c683 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:28.144297 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e678e-bdfe-4808-a01d-95293497c683 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:28.151626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-d1c333b2-19c9-4d01-bf42-6d8c6172c43d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:28.151626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:28.151626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:28.151626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:28.151626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:28.151626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:28.151626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:28.151626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:28.151626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:28.151626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:28.151626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:28.151626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:28.151626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:28.151626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:28.151626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:28.151626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:28.152625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:28.152625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:28.152625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:28.152625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:28.152625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:28.152625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:28.152625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:28.152625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:28.152625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:28.152625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:28.152625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:28.152625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:28.152625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:28.152625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:28.152625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:28.152625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:28.152625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:28.152625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:28.153770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:28.153770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:28.153770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:28.153770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:28.153770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:28.153770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:28.153770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:28.153770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:28.153770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:28.153770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:28.153770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 262/514] 10.222.0.93 () {56 vars in 1093 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:28.153770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c333b2-19c9-4d01-bf42-6d8c6172c43d None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:28.224187 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 253/515] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Jun 16 18:37:28 2022] POST /identity/v3/users => generated 247 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:28.225350 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e678e-bdfe-4808-a01d-95293497c683 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:28.261076 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c333b2-19c9-4d01-bf42-6d8c6172c43d None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:28.296777 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.305216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a51473-72fe-4fa6-ad8a-63174a8aa07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:28.306038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a51473-72fe-4fa6-ad8a-63174a8aa07a None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.306328 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a51473-72fe-4fa6-ad8a-63174a8aa07a None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.306645 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a51473-72fe-4fa6-ad8a-63174a8aa07a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.321398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a51473-72fe-4fa6-ad8a-63174a8aa07a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:28.322892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a51473-72fe-4fa6-ad8a-63174a8aa07a None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:28.343825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-24a51473-72fe-4fa6-ad8a-63174a8aa07a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:28.343825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:28.343825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:28.343825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:28.343825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:28.343825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:28.343825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:28.343825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:28.343825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:28.343825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:28.343825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:28.343825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:28.343825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:28.343825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:28.343825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:28.345246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:28.345246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:28.345246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:28.345246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:28.345246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:28.345246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:28.345246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:28.345246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:28.345246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:28.345246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:28.345246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:28.345246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:28.345246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:28.345246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:28.345246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:28.345246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:28.345246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:28.346281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:28.346281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:28.346281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:28.346281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:28.351218 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e678e-bdfe-4808-a01d-95293497c683 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:28.352618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 263/516] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:28.354056 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a51473-72fe-4fa6-ad8a-63174a8aa07a None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:28.457977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b23e16-5d13-4a05-963a-043a33ecb452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:28.458781 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b23e16-5d13-4a05-963a-043a33ecb452 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.459060 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b23e16-5d13-4a05-963a-043a33ecb452 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.459332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b23e16-5d13-4a05-963a-043a33ecb452 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.471417 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b23e16-5d13-4a05-963a-043a33ecb452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:28.473069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b23e16-5d13-4a05-963a-043a33ecb452 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:28.490684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-18b23e16-5d13-4a05-963a-043a33ecb452 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:28.490684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:28.490684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:28.490684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:28.490684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:28.490684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:28.490684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:28.490684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:28.490684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:28.490684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:28.490684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:28.490684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:28.490684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:28.490684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:28.490684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:28.491583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:28.491583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:28.491583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:28.491583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:28.491583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:28.491583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:28.491583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:28.491583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:28.491583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:28.491583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:28.491583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:28.491583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:28.491583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:28.491583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:28.491583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:28.491583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:28.491583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:28.492909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:28.492909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:28.492909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:28.492909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:28.492909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 254/517] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:28.492909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b23e16-5d13-4a05-963a-043a33ecb452 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:28.526270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.531457 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a51473-72fe-4fa6-ad8a-63174a8aa07a None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:28.570785 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00512350-6413-428b-8bfc-ac35f475edd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:28.571914 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00512350-6413-428b-8bfc-ac35f475edd9 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.572397 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00512350-6413-428b-8bfc-ac35f475edd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.572921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00512350-6413-428b-8bfc-ac35f475edd9 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.577814 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00512350-6413-428b-8bfc-ac35f475edd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:28.577814 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00512350-6413-428b-8bfc-ac35f475edd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:28.577814 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00512350-6413-428b-8bfc-ac35f475edd9 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:28.589191 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 264/518] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:28.590249 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00512350-6413-428b-8bfc-ac35f475edd9 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:28.606409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b23e16-5d13-4a05-963a-043a33ecb452 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:28.633775 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.645893 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a9e02-68d0-4019-8bb4-4555a8256d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:28.646585 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a9e02-68d0-4019-8bb4-4555a8256d48 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.646873 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a9e02-68d0-4019-8bb4-4555a8256d48 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.647162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a9e02-68d0-4019-8bb4-4555a8256d48 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.649194 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a9e02-68d0-4019-8bb4-4555a8256d48 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:28.649194 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a9e02-68d0-4019-8bb4-4555a8256d48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:28.649898 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a9e02-68d0-4019-8bb4-4555a8256d48 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:28.689260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 255/519] 10.222.0.93 () {56 vars in 1133 bytes} [Thu Jun 16 18:37:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:28.690136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a9e02-68d0-4019-8bb4-4555a8256d48 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:28.698862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00512350-6413-428b-8bfc-ac35f475edd9 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:28.744918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c17dbe-210d-42f3-bfd9-873c91aa783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:28.745515 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c17dbe-210d-42f3-bfd9-873c91aa783d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.745804 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c17dbe-210d-42f3-bfd9-873c91aa783d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.746082 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c17dbe-210d-42f3-bfd9-873c91aa783d None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.747074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c17dbe-210d-42f3-bfd9-873c91aa783d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:28.747549 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c17dbe-210d-42f3-bfd9-873c91aa783d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:28.750333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c17dbe-210d-42f3-bfd9-873c91aa783d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:28.764018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 265/520] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:28.765330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c17dbe-210d-42f3-bfd9-873c91aa783d None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:28.804502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.814447 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a9e02-68d0-4019-8bb4-4555a8256d48 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:28.852021 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc282f6-658f-44b5-bdee-88fec08b0f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:28.852721 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc282f6-658f-44b5-bdee-88fec08b0f1e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.853010 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc282f6-658f-44b5-bdee-88fec08b0f1e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.853287 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc282f6-658f-44b5-bdee-88fec08b0f1e None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.854020 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc282f6-658f-44b5-bdee-88fec08b0f1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:28.854330 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc282f6-658f-44b5-bdee-88fec08b0f1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:28.855721 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc282f6-658f-44b5-bdee-88fec08b0f1e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:28.867378 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 256/521] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:28.868180 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc282f6-658f-44b5-bdee-88fec08b0f1e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:28.889121 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.893231 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c17dbe-210d-42f3-bfd9-873c91aa783d None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:28.929160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0609c0-9694-451d-ac49-05c009758e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:28.929967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0609c0-9694-451d-ac49-05c009758e07 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.930261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0609c0-9694-451d-ac49-05c009758e07 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.930550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0609c0-9694-451d-ac49-05c009758e07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.937937 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0609c0-9694-451d-ac49-05c009758e07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:28.939432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0609c0-9694-451d-ac49-05c009758e07 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:28.953691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-9e0609c0-9694-451d-ac49-05c009758e07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:28.953691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:28.953691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:28.953691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:28.953691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:28.953691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:28.953691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:28.953691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:28.953691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:28.953691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:28.953691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:28.953691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:28.953691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:28.953691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:28.953691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:28.954750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:28.954750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:28.954750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:28.954750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:28.954750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:28.954750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:28.954750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:28.954750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:28.954750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:28.954750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:28.954750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:28.954750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:28.954750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:28.954750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:28.954750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:28.954750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:28.954750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:28.955600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:28.955600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:28.955600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:28.955600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:28.955600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:28.955600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:28.955600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:28.955600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:28.955600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 266/522] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:28.956069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0609c0-9694-451d-ac49-05c009758e07 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:28.976764 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc282f6-658f-44b5-bdee-88fec08b0f1e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.013362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5994e61-4ae5-43dd-a1fe-d576b65422b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.014013 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5994e61-4ae5-43dd-a1fe-d576b65422b8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.014339 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5994e61-4ae5-43dd-a1fe-d576b65422b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.014620 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5994e61-4ae5-43dd-a1fe-d576b65422b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:29.034397 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:29.061194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0609c0-9694-451d-ac49-05c009758e07 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.085011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5994e61-4ae5-43dd-a1fe-d576b65422b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:29.086488 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5994e61-4ae5-43dd-a1fe-d576b65422b8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:29.097902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1daf5a-49bf-4fee-9c91-931f979bf8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.098832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1daf5a-49bf-4fee-9c91-931f979bf8ee None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.099161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1daf5a-49bf-4fee-9c91-931f979bf8ee None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.099443 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1daf5a-49bf-4fee-9c91-931f979bf8ee None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:29.107355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1daf5a-49bf-4fee-9c91-931f979bf8ee None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:29.109339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1daf5a-49bf-4fee-9c91-931f979bf8ee None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:29.126250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-5c1daf5a-49bf-4fee-9c91-931f979bf8ee None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 18:37:29.126250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:29.126250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:29.126250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:29.126250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:29.126250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:29.126250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:29.126250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:29.126250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:29.126250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:29.126250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:29.126250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:29.126250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:29.126250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:29.126250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:29.126250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:29.127661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:29.127661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:29.127661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:29.127661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:29.127661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:29.127661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:29.127661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:29.127661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:29.127661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:29.127661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:29.127661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:29.127661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:29.127661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:29.127661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:29.127661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:29.127661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:29.127661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:29.127661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:29.128608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:29.128608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:29.128608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:29.128608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:29.128608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:29.128608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:29.128608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:29.128608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:29.128608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 18:37:29.128608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:29.128608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 267/523] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:29.129445 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1daf5a-49bf-4fee-9c91-931f979bf8ee None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:29.163598 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:29.210646 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 257/524] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:29.210646 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5994e61-4ae5-43dd-a1fe-d576b65422b8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:29.254958 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1daf5a-49bf-4fee-9c91-931f979bf8ee None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.270734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:29.290125 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5de741-2cf3-4d60-a67e-d0dcde7583b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.290929 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5de741-2cf3-4d60-a67e-d0dcde7583b5 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.291204 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5de741-2cf3-4d60-a67e-d0dcde7583b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.299380 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5de741-2cf3-4d60-a67e-d0dcde7583b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:29.299380 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5de741-2cf3-4d60-a67e-d0dcde7583b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:29.300304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5de741-2cf3-4d60-a67e-d0dcde7583b5 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:29.314001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-ff5de741-2cf3-4d60-a67e-d0dcde7583b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:29.314001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:29.314001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:29.314001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:29.314001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:29.314001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:29.314001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:29.314001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:29.314001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:29.314001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:29.314001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:29.314001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:29.314001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:29.314001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:29.314001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:29.314894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:29.314894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:29.314894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:29.314894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:29.314894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:29.314894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:29.314894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:29.314894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:29.314894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:29.314894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:29.314894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:29.314894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:29.314894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:29.314894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:29.314894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:29.314894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:29.314894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:29.315820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:29.315820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:29.315820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:29.315820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:29.315820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:29.315820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:29.315820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:29.315820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:29.315820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 268/525] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:29.316283 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5de741-2cf3-4d60-a67e-d0dcde7583b5 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:29.326561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5994e61-4ae5-43dd-a1fe-d576b65422b8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.368855 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613fb3b-9793-4076-97ae-73371af7f27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.369791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613fb3b-9793-4076-97ae-73371af7f27c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.370087 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613fb3b-9793-4076-97ae-73371af7f27c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.370361 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613fb3b-9793-4076-97ae-73371af7f27c None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:29.371144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613fb3b-9793-4076-97ae-73371af7f27c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:29.371448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613fb3b-9793-4076-97ae-73371af7f27c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:29.373450 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613fb3b-9793-4076-97ae-73371af7f27c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:29.402183 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 258/526] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:29.402183 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613fb3b-9793-4076-97ae-73371af7f27c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:29.403400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:29.421249 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5de741-2cf3-4d60-a67e-d0dcde7583b5 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.456793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e69eb3-23e6-460f-9a3a-1070341b1fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.457634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e69eb3-23e6-460f-9a3a-1070341b1fe6 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.457925 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e69eb3-23e6-460f-9a3a-1070341b1fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.458208 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e69eb3-23e6-460f-9a3a-1070341b1fe6 None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:29.459065 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e69eb3-23e6-460f-9a3a-1070341b1fe6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:29.459384 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e69eb3-23e6-460f-9a3a-1070341b1fe6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:29.460910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e69eb3-23e6-460f-9a3a-1070341b1fe6 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:29.478975 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 269/527] 10.222.0.93 () {56 vars in 1139 bytes} [Thu Jun 16 18:37:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:29.479620 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e69eb3-23e6-460f-9a3a-1070341b1fe6 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:29.525929 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613fb3b-9793-4076-97ae-73371af7f27c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.538671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:29.563766 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775f5ec-4650-4701-b7e2-ae7dddb41eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.564809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775f5ec-4650-4701-b7e2-ae7dddb41eb3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.565209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775f5ec-4650-4701-b7e2-ae7dddb41eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.565488 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775f5ec-4650-4701-b7e2-ae7dddb41eb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:29.576886 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775f5ec-4650-4701-b7e2-ae7dddb41eb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:29.578354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775f5ec-4650-4701-b7e2-ae7dddb41eb3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:29.590868 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e69eb3-23e6-460f-9a3a-1070341b1fe6 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.597053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-b775f5ec-4650-4701-b7e2-ae7dddb41eb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:29.597053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:29.597053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:29.597053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:29.597053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:29.597053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:29.597053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:29.597053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:29.597053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:29.597053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:29.597053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:29.597053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:29.597053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:29.597053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:29.597053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:29.597915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:29.597915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:29.597915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:29.597915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:29.597915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:29.597915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:29.597915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:29.597915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:29.597915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:29.597915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:29.597915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:29.597915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:29.597915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:29.597915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:29.597915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:29.597915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:29.597915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:29.598803 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:29.598803 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:29.598803 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:29.598803 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:29.598803 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 259/528] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:29.599497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775f5ec-4650-4701-b7e2-ae7dddb41eb3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:29.632292 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e272f-3004-41f4-b0dd-8d12011511db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.632988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e272f-3004-41f4-b0dd-8d12011511db None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.633281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e272f-3004-41f4-b0dd-8d12011511db None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.633565 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e272f-3004-41f4-b0dd-8d12011511db None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:29.634355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e272f-3004-41f4-b0dd-8d12011511db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:29.634671 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e272f-3004-41f4-b0dd-8d12011511db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:29.636124 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e272f-3004-41f4-b0dd-8d12011511db None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:29.647258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:29.654443 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 270/529] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:29.655865 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e272f-3004-41f4-b0dd-8d12011511db None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:29.710041 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775f5ec-4650-4701-b7e2-ae7dddb41eb3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.746307 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abec43-bf98-4610-bbb8-2a0d9057371d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.747195 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abec43-bf98-4610-bbb8-2a0d9057371d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.747480 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abec43-bf98-4610-bbb8-2a0d9057371d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.747762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abec43-bf98-4610-bbb8-2a0d9057371d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:29.748641 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abec43-bf98-4610-bbb8-2a0d9057371d None admin] RBAC: Adding query filter params (role.id=06f67743387f476cade2623aa7e5c5d2, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=00c13f10b14449cea284eb629a316d83) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:29.748961 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abec43-bf98-4610-bbb8-2a0d9057371d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:29.750398 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abec43-bf98-4610-bbb8-2a0d9057371d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:29.756357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 260/530] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:29 2022] GET /identity/v3/role_assignments?user.id=00c13f10b14449cea284eb629a316d83&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=06f67743387f476cade2623aa7e5c5d2 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:29.757167 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abec43-bf98-4610-bbb8-2a0d9057371d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:29.765489 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e272f-3004-41f4-b0dd-8d12011511db None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.800101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:29.814666 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458b30f-5aab-4cbf-9c67-156256f83c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.815350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458b30f-5aab-4cbf-9c67-156256f83c11 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.815639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458b30f-5aab-4cbf-9c67-156256f83c11 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.815923 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458b30f-5aab-4cbf-9c67-156256f83c11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:29.897787 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:29.902040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458b30f-5aab-4cbf-9c67-156256f83c11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:29.903597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458b30f-5aab-4cbf-9c67-156256f83c11 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:29.912725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abec43-bf98-4610-bbb8-2a0d9057371d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.959599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fb7c8-e1bb-40b8-80cf-253b4df021b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.960604 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fb7c8-e1bb-40b8-80cf-253b4df021b6 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.961632 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fb7c8-e1bb-40b8-80cf-253b4df021b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.962122 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fb7c8-e1bb-40b8-80cf-253b4df021b6 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:29.963305 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fb7c8-e1bb-40b8-80cf-253b4df021b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:29.964058 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fb7c8-e1bb-40b8-80cf-253b4df021b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:29.966343 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fb7c8-e1bb-40b8-80cf-253b4df021b6 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:29.984821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 261/531] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:29.986211 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fb7c8-e1bb-40b8-80cf-253b4df021b6 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:30.024704 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 271/532] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:30.025589 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458b30f-5aab-4cbf-9c67-156256f83c11 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:30.103761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:30.124783 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fb7c8-e1bb-40b8-80cf-253b4df021b6 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:30.142565 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:30.147800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458b30f-5aab-4cbf-9c67-156256f83c11 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:30.161624 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41668016-7e37-4851-9913-a44b71be7dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:30.162290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41668016-7e37-4851-9913-a44b71be7dcc None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.162577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41668016-7e37-4851-9913-a44b71be7dcc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.162856 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41668016-7e37-4851-9913-a44b71be7dcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.163714 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41668016-7e37-4851-9913-a44b71be7dcc None admin] RBAC: Adding query filter params (role.id=06f67743387f476cade2623aa7e5c5d2, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=3862d73c187e403fb1e1ef4e1984cee7) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:30.166721 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41668016-7e37-4851-9913-a44b71be7dcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:30.166721 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41668016-7e37-4851-9913-a44b71be7dcc None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:30.173441 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 262/533] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:29 2022] GET /identity/v3/role_assignments?user.id=3862d73c187e403fb1e1ef4e1984cee7&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=06f67743387f476cade2623aa7e5c5d2 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:30.174414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41668016-7e37-4851-9913-a44b71be7dcc None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:30.194823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a009e33-13a6-4d97-8399-d684c0ac9111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:30.195637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a009e33-13a6-4d97-8399-d684c0ac9111 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.195924 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a009e33-13a6-4d97-8399-d684c0ac9111 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.196260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a009e33-13a6-4d97-8399-d684c0ac9111 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.204920 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a009e33-13a6-4d97-8399-d684c0ac9111 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:30.206392 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a009e33-13a6-4d97-8399-d684c0ac9111 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:30.239338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-1a009e33-13a6-4d97-8399-d684c0ac9111 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:30.239338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:30.239338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:30.239338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:30.239338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:30.239338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:30.239338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:30.239338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:30.239338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:30.239338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:30.239338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:30.239338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:30.239338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:30.239338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:30.239338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:30.240261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:30.240261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:30.240261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:30.240261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:30.240261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:30.240261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:30.240261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:30.240261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:30.240261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:30.240261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:30.240261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:30.240261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:30.240261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:30.240261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:30.240261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:30.240261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:30.240261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:30.241158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:30.241158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:30.241158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:30.241158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:30.241158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:30.241158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:30.241158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:30.241158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:30.241158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 272/534] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:30.253532 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a009e33-13a6-4d97-8399-d684c0ac9111 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:30.381578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41668016-7e37-4851-9913-a44b71be7dcc None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:30.399290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a009e33-13a6-4d97-8399-d684c0ac9111 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:30.432416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9b6d3-1fee-45e4-a0fb-0e0fff291622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:30.433244 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9b6d3-1fee-45e4-a0fb-0e0fff291622 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.433534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9b6d3-1fee-45e4-a0fb-0e0fff291622 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.433813 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9b6d3-1fee-45e4-a0fb-0e0fff291622 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.436673 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b7f50-fa61-4159-80e0-a9e29ae68d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:30.437343 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b7f50-fa61-4159-80e0-a9e29ae68d0d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.437630 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b7f50-fa61-4159-80e0-a9e29ae68d0d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.437912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b7f50-fa61-4159-80e0-a9e29ae68d0d None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.438707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b7f50-fa61-4159-80e0-a9e29ae68d0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:30.439021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b7f50-fa61-4159-80e0-a9e29ae68d0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:30.440615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b7f50-fa61-4159-80e0-a9e29ae68d0d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:30.444514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9b6d3-1fee-45e4-a0fb-0e0fff291622 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:30.446132 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9b6d3-1fee-45e4-a0fb-0e0fff291622 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:30.454309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 273/535] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:30.459176 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e40d2-6419-4019-8ce0-02f719881b3a None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.459176 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e40d2-6419-4019-8ce0-02f719881b3a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.459176 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e40d2-6419-4019-8ce0-02f719881b3a None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.461725 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 274/536] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:30.462653 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e40d2-6419-4019-8ce0-02f719881b3a None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:30.472786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-26b9b6d3-1fee-45e4-a0fb-0e0fff291622 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:30.472786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:30.472786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:30.472786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:30.472786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:30.472786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:30.472786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:30.472786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:30.472786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:30.472786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:30.472786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:30.472786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:30.472786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:30.472786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:30.472786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:30.473734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:30.473734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:30.473734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:30.473734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:30.473734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:30.473734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:30.473734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:30.473734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:30.473734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:30.473734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:30.473734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:30.473734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:30.473734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:30.473734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:30.473734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:30.473734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:30.473734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:30.474600 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:30.474600 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:30.474600 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:30.474600 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:30.477170 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 263/537] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:30.478722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177a77b-0f72-4ecd-a42b-26af5d84c472 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.479286 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177a77b-0f72-4ecd-a42b-26af5d84c472 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.479752 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177a77b-0f72-4ecd-a42b-26af5d84c472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.482879 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:30.486791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:30.502604 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f177a77b-0f72-4ecd-a42b-26af5d84c472 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:30.504091 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f177a77b-0f72-4ecd-a42b-26af5d84c472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:30.572356 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e40d2-6419-4019-8ce0-02f719881b3a None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:30.586858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 264/538] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:30.587790 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177a77b-0f72-4ecd-a42b-26af5d84c472 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:30.628817 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045ce0f-e3a1-4c8a-9ad7-3e063488ebb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:30.629485 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045ce0f-e3a1-4c8a-9ad7-3e063488ebb7 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.629776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045ce0f-e3a1-4c8a-9ad7-3e063488ebb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.630091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045ce0f-e3a1-4c8a-9ad7-3e063488ebb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.631000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045ce0f-e3a1-4c8a-9ad7-3e063488ebb7 None admin] RBAC: Adding query filter params (role.id=06f67743387f476cade2623aa7e5c5d2, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=3503ec98bea14693a17a84e686586bad) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:30.631317 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045ce0f-e3a1-4c8a-9ad7-3e063488ebb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:30.632969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045ce0f-e3a1-4c8a-9ad7-3e063488ebb7 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:30.644729 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 275/539] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:30 2022] GET /identity/v3/role_assignments?user.id=3503ec98bea14693a17a84e686586bad&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=06f67743387f476cade2623aa7e5c5d2 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:30.646125 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045ce0f-e3a1-4c8a-9ad7-3e063488ebb7 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:30.711092 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177a77b-0f72-4ecd-a42b-26af5d84c472 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:30.740141 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:30.746195 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:30.751353 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c6711-e459-40c5-9498-0163e809cf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:30.755710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c6711-e459-40c5-9498-0163e809cf17 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.755710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c6711-e459-40c5-9498-0163e809cf17 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.755710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c6711-e459-40c5-9498-0163e809cf17 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.755710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c6711-e459-40c5-9498-0163e809cf17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:30.755710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c6711-e459-40c5-9498-0163e809cf17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:30.755710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c6711-e459-40c5-9498-0163e809cf17 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:30.760633 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045ce0f-e3a1-4c8a-9ad7-3e063488ebb7 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:30.768006 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 265/540] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:30.773354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c6711-e459-40c5-9498-0163e809cf17 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:30.800709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b52a2-7135-499d-bb36-f73e577205ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:30.801710 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b52a2-7135-499d-bb36-f73e577205ad None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.801997 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b52a2-7135-499d-bb36-f73e577205ad None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.802662 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b52a2-7135-499d-bb36-f73e577205ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.819001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b52a2-7135-499d-bb36-f73e577205ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:30.830299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-109b52a2-7135-499d-bb36-f73e577205ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:30.830299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:30.830299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:30.830299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:30.830299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:30.830299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:30.830299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:30.830299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:30.830299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:30.830299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:30.830299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:30.830299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:30.830299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:30.830299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:30.830299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:30.830299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:30.832379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:30.832379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:30.832379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:30.832379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:30.832379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:30.832379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:30.832379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:30.832379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:30.832379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:30.832379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:30.832379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:30.832379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:30.832379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:30.832379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:30.832379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:30.832379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:30.834336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:30.834336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:30.834336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:30.834336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:30.834336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:30.834336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:30.834336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:30.834336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:30.834336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:30.834336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:30.834336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:30.834336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:30.834336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 276/541] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:30.842083 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b52a2-7135-499d-bb36-f73e577205ad None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:30.902385 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c6711-e459-40c5-9498-0163e809cf17 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:30.950939 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8c667-0383-42c6-a793-4ef96e52ab85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:30.952304 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8c667-0383-42c6-a793-4ef96e52ab85 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.952621 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8c667-0383-42c6-a793-4ef96e52ab85 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.952934 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8c667-0383-42c6-a793-4ef96e52ab85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.963929 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8c667-0383-42c6-a793-4ef96e52ab85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:30.966217 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8c667-0383-42c6-a793-4ef96e52ab85 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:30.993236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-4be8c667-0383-42c6-a793-4ef96e52ab85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:30.993236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:30.993236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:30.993236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:30.993236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:30.993236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:30.993236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:30.993236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:30.993236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:30.993236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:30.993236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:30.993236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:30.993236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:30.993236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:30.993236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:30.994144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:30.994144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:30.994144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:30.994144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:30.994144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:30.994144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:30.994144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:30.994144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:30.994144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:30.994144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:30.994144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:30.994144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:30.994144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:30.994144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:30.994144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:30.994144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:30.994144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:30.995002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:30.995002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:30.995002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:30.995002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:30.995002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:30.995002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:30.995002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:30.995002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:31.005978 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 266/542] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:31.012060 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8c667-0383-42c6-a793-4ef96e52ab85 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:31.034547 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b52a2-7135-499d-bb36-f73e577205ad None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:31.104631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8fd0f-a017-4c08-b741-54e3c83930e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:31.106422 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8fd0f-a017-4c08-b741-54e3c83930e8 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:31.107093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8fd0f-a017-4c08-b741-54e3c83930e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:31.108691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8fd0f-a017-4c08-b741-54e3c83930e8 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:31.109903 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8fd0f-a017-4c08-b741-54e3c83930e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:31.111258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8fd0f-a017-4c08-b741-54e3c83930e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:31.115522 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8fd0f-a017-4c08-b741-54e3c83930e8 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:31.117739 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:31.130759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 277/543] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:31.137827 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8fd0f-a017-4c08-b741-54e3c83930e8 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:31.157116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:31.222205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8c667-0383-42c6-a793-4ef96e52ab85 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:31.296681 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8fd0f-a017-4c08-b741-54e3c83930e8 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:31.297660 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c548b8-163d-496e-93bf-9427b80a14f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:31.298658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c548b8-163d-496e-93bf-9427b80a14f6 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:31.299219 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c548b8-163d-496e-93bf-9427b80a14f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:31.299495 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c548b8-163d-496e-93bf-9427b80a14f6 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:31.300290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c548b8-163d-496e-93bf-9427b80a14f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:31.300637 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c548b8-163d-496e-93bf-9427b80a14f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:31.302080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c548b8-163d-496e-93bf-9427b80a14f6 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:31.326219 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 267/544] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:31.332046 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c548b8-163d-496e-93bf-9427b80a14f6 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:31.335006 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92a52a-0fcd-4c34-8d9a-34729493cd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:31.336167 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92a52a-0fcd-4c34-8d9a-34729493cd95 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:31.336741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92a52a-0fcd-4c34-8d9a-34729493cd95 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:31.337214 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92a52a-0fcd-4c34-8d9a-34729493cd95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:31.350238 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92a52a-0fcd-4c34-8d9a-34729493cd95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:31.352051 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92a52a-0fcd-4c34-8d9a-34729493cd95 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:31.372562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-df92a52a-0fcd-4c34-8d9a-34729493cd95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:31.372562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:31.372562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:31.372562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:31.372562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:31.372562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:31.372562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:31.372562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:31.372562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:31.372562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:31.372562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:31.372562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:31.372562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:31.372562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:31.372562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:31.373497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:31.373497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:31.373497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:31.373497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:31.373497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:31.373497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:31.373497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:31.373497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:31.373497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:31.373497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:31.373497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:31.373497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:31.373497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:31.373497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:31.373497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:31.373497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:31.373497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:31.374333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:31.374333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:31.374333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:31.374333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:31.380891 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 278/545] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:31.382484 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92a52a-0fcd-4c34-8d9a-34729493cd95 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:31.445453 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:31.496873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92a52a-0fcd-4c34-8d9a-34729493cd95 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:31.542658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c548b8-163d-496e-93bf-9427b80a14f6 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:31.562381 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899d126-acc2-4546-a6b4-10fe2e232cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:31.563116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899d126-acc2-4546-a6b4-10fe2e232cc9 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:31.563397 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899d126-acc2-4546-a6b4-10fe2e232cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:31.563862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899d126-acc2-4546-a6b4-10fe2e232cc9 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:31.564619 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899d126-acc2-4546-a6b4-10fe2e232cc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:31.564934 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899d126-acc2-4546-a6b4-10fe2e232cc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:31.566304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899d126-acc2-4546-a6b4-10fe2e232cc9 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:31.570288 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:31.580956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 279/546] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:31.586440 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899d126-acc2-4546-a6b4-10fe2e232cc9 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:31.626208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababf13a-54d2-48a8-a9df-9d1267276d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:31.626884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababf13a-54d2-48a8-a9df-9d1267276d23 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:31.627396 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababf13a-54d2-48a8-a9df-9d1267276d23 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:31.627550 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababf13a-54d2-48a8-a9df-9d1267276d23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:31.628264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababf13a-54d2-48a8-a9df-9d1267276d23 None admin] RBAC: Adding query filter params (role.id=06f67743387f476cade2623aa7e5c5d2, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=753728a82bdb406892015f8373932ff1) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:31.628605 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababf13a-54d2-48a8-a9df-9d1267276d23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:31.630070 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababf13a-54d2-48a8-a9df-9d1267276d23 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:31.644000 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 268/547] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:31 2022] GET /identity/v3/role_assignments?user.id=753728a82bdb406892015f8373932ff1&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=06f67743387f476cade2623aa7e5c5d2 => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:31.711617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899d126-acc2-4546-a6b4-10fe2e232cc9 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:31.730255 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:31.755233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dc161-3caa-45c0-9dc7-0b0249e9819c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:31.756068 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dc161-3caa-45c0-9dc7-0b0249e9819c None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:31.756357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dc161-3caa-45c0-9dc7-0b0249e9819c None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:31.756663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dc161-3caa-45c0-9dc7-0b0249e9819c None admin] PATH_INFO: `/v3/users/swift` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:31.769785 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dc161-3caa-45c0-9dc7-0b0249e9819c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:31.771295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dc161-3caa-45c0-9dc7-0b0249e9819c None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:31.795339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-aa8dc161-3caa-45c0-9dc7-0b0249e9819c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:31.795339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:31.795339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:31.795339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:31.795339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:31.795339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:31.795339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:31.795339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:31.795339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:31.795339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:31.795339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:31.795339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:31.795339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:31.795339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:31.795339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:31.795339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:31.796405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:31.796405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:31.796405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:31.796405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:31.796405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:31.796405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:31.796405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:31.796405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:31.796405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:31.796405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:31.796405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:31.796405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:31.796405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:31.796405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:31.796405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:31.796405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:31.796405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:31.796405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:31.798106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:31.798106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:31.798106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:31.798106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:31.798106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:31.798106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:31.798106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:31.798106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:31.798106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:31.798106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:31.798106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 280/548] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:31.805610 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababf13a-54d2-48a8-a9df-9d1267276d23 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:31.951281 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababf13a-54d2-48a8-a9df-9d1267276d23 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:31.997304 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f2b1e-b05a-4a9c-84cb-4031795fae30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:31.997924 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f2b1e-b05a-4a9c-84cb-4031795fae30 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:31.998747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f2b1e-b05a-4a9c-84cb-4031795fae30 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:31.999027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f2b1e-b05a-4a9c-84cb-4031795fae30 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:31.999867 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f2b1e-b05a-4a9c-84cb-4031795fae30 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:32.000179 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f2b1e-b05a-4a9c-84cb-4031795fae30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:32.001868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f2b1e-b05a-4a9c-84cb-4031795fae30 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:32.024339 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 269/549] 10.222.0.93 () {56 vars in 1135 bytes} [Thu Jun 16 18:37:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:32.031307 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dc161-3caa-45c0-9dc7-0b0249e9819c None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:32.142185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dc161-3caa-45c0-9dc7-0b0249e9819c None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:32.176403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763481ae-09be-41d7-9a8b-e5665c596540 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:32.177042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763481ae-09be-41d7-9a8b-e5665c596540 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:32.177519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763481ae-09be-41d7-9a8b-e5665c596540 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:32.178653 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d7ca7-6a71-42df-8cdc-e75c514fb1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:32.179311 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d7ca7-6a71-42df-8cdc-e75c514fb1eb None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:32.179597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d7ca7-6a71-42df-8cdc-e75c514fb1eb None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:32.179936 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d7ca7-6a71-42df-8cdc-e75c514fb1eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:32.181409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 270/550] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:37:32.186776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b5a22-ff2e-4581-8f07-7cd6d6690bae None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:32.187059 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b5a22-ff2e-4581-8f07-7cd6d6690bae None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:32.187338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b5a22-ff2e-4581-8f07-7cd6d6690bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:32.205187 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-876b5a22-ff2e-4581-8f07-7cd6d6690bae None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:32.206815 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-876b5a22-ff2e-4581-8f07-7cd6d6690bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:32.231976 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:32.246308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:32.256002 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d7ca7-6a71-42df-8cdc-e75c514fb1eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:32.260496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d7ca7-6a71-42df-8cdc-e75c514fb1eb None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:32.337876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 271/551] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:32.366328 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b5a22-ff2e-4581-8f07-7cd6d6690bae None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:32.453862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 281/552] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:32.472455 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d7ca7-6a71-42df-8cdc-e75c514fb1eb None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:32.552601 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:32.584962 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d7ca7-6a71-42df-8cdc-e75c514fb1eb None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:32.643958 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9beb3-c888-4049-9f85-06e538d0a1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:32.645226 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9beb3-c888-4049-9f85-06e538d0a1de None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:32.645724 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9beb3-c888-4049-9f85-06e538d0a1de None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:32.647701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9beb3-c888-4049-9f85-06e538d0a1de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:32.669873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9beb3-c888-4049-9f85-06e538d0a1de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:32.671926 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9beb3-c888-4049-9f85-06e538d0a1de None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:32.679203 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b5a22-ff2e-4581-8f07-7cd6d6690bae None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:32.712857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-43b9beb3-c888-4049-9f85-06e538d0a1de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:32.712857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:32.712857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:32.712857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:32.712857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:32.712857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:32.712857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:32.712857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:32.712857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:32.712857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:32.712857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:32.712857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:32.712857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:32.712857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:32.712857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:32.714122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:32.714122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:32.714122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:32.714122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:32.714122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:32.714122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:32.714122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:32.714122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:32.714122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:32.714122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:32.714122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:32.714122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:32.714122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:32.714122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:32.714122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:32.714122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:32.714122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:32.715072 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:32.715072 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:32.715072 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:32.715072 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:32.724315 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 282/553] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:32.725487 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9beb3-c888-4049-9f85-06e538d0a1de None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:32.758258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b7f9e-9f34-4c00-93c4-22b0f88aab7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:32.760702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b7f9e-9f34-4c00-93c4-22b0f88aab7e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:32.762852 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b7f9e-9f34-4c00-93c4-22b0f88aab7e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:32.764172 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b7f9e-9f34-4c00-93c4-22b0f88aab7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:32.793998 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b7f9e-9f34-4c00-93c4-22b0f88aab7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:32.818416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-4d6b7f9e-9f34-4c00-93c4-22b0f88aab7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:32.818416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:32.818416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:32.818416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:32.818416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:32.818416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:32.818416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:32.818416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:32.818416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:32.818416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:32.818416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:32.818416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:32.818416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:32.818416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:32.818416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:32.818416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:32.819357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:32.819357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:32.819357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:32.819357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:32.819357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:32.819357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:32.819357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:32.819357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:32.819357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:32.819357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:32.819357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:32.819357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:32.819357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:32.819357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:32.819357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:32.819357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:32.820177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:32.820177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:32.820177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:32.820177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:32.820177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:32.820177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:32.820177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:32.820177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:32.820177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:32.820177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:32.820177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:32.820177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:32.825034 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 272/554] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 459 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:32.831016 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b7f9e-9f34-4c00-93c4-22b0f88aab7e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:32.891365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:32.923445 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9beb3-c888-4049-9f85-06e538d0a1de None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:32.976164 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:32.996298 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f915034-737b-4ce0-a8d3-c70ddca9b2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:32.997055 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f915034-737b-4ce0-a8d3-c70ddca9b2f5 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:32.997346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f915034-737b-4ce0-a8d3-c70ddca9b2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:32.997623 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f915034-737b-4ce0-a8d3-c70ddca9b2f5 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:32.998391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f915034-737b-4ce0-a8d3-c70ddca9b2f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:32.998702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f915034-737b-4ce0-a8d3-c70ddca9b2f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:33.000803 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f915034-737b-4ce0-a8d3-c70ddca9b2f5 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:33.022475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 283/555] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:33.024035 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98775f-5240-4788-b9f1-623fd743b6a3 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.024332 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98775f-5240-4788-b9f1-623fd743b6a3 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.024649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98775f-5240-4788-b9f1-623fd743b6a3 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.030478 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 284/556] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:33.031957 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98775f-5240-4788-b9f1-623fd743b6a3 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:33.050370 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b7f9e-9f34-4c00-93c4-22b0f88aab7e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:33.092204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bf9a3-039d-4b69-b55b-c1729bdf9607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:33.092834 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bf9a3-039d-4b69-b55b-c1729bdf9607 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.093381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bf9a3-039d-4b69-b55b-c1729bdf9607 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.093662 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bf9a3-039d-4b69-b55b-c1729bdf9607 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.094425 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1bf9a3-039d-4b69-b55b-c1729bdf9607 None admin] RBAC: Adding query filter params (name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:33.094736 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1bf9a3-039d-4b69-b55b-c1729bdf9607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:33.096404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1bf9a3-039d-4b69-b55b-c1729bdf9607 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:33.106483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 273/557] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:33.107923 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead8d32-fbe1-4a66-b83f-97ccfce31af1 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.108214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead8d32-fbe1-4a66-b83f-97ccfce31af1 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.108571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead8d32-fbe1-4a66-b83f-97ccfce31af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.127159 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-cead8d32-fbe1-4a66-b83f-97ccfce31af1 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:33.128468 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cead8d32-fbe1-4a66-b83f-97ccfce31af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:33.146320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98775f-5240-4788-b9f1-623fd743b6a3 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:33.184878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb69762-9ae0-4ea1-8156-20b9c5cd2336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:33.186641 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb69762-9ae0-4ea1-8156-20b9c5cd2336 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.187122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb69762-9ae0-4ea1-8156-20b9c5cd2336 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.187595 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb69762-9ae0-4ea1-8156-20b9c5cd2336 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.195106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb69762-9ae0-4ea1-8156-20b9c5cd2336 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:33.196918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb69762-9ae0-4ea1-8156-20b9c5cd2336 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:33.212242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-fdb69762-9ae0-4ea1-8156-20b9c5cd2336 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:33.212242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:33.212242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:33.212242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:33.212242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:33.212242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:33.212242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:33.212242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:33.212242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:33.212242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:33.212242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:33.212242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:33.212242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:33.212242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:33.212242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:33.213765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:33.213765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:33.213765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:33.213765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:33.213765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:33.213765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:33.213765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:33.213765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:33.213765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:33.213765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:33.213765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:33.213765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:33.213765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:33.213765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:33.213765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:33.213765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:33.213765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:33.214646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:33.214646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:33.214646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:33.214646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:33.214646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:33.214646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:33.214646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:33.214646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:33.216704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 274/558] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:33.217330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 285/559] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:33.217627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead8d32-fbe1-4a66-b83f-97ccfce31af1 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:33.224999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb69762-9ae0-4ea1-8156-20b9c5cd2336 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:33.255403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:33.295510 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:33.365198 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb69762-9ae0-4ea1-8156-20b9c5cd2336 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:33.365710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead8d32-fbe1-4a66-b83f-97ccfce31af1 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:33.411753 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f12e36-12f2-4369-b1b9-0514c921e9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:33.412481 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f12e36-12f2-4369-b1b9-0514c921e9cf None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.412771 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f12e36-12f2-4369-b1b9-0514c921e9cf None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.413096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f12e36-12f2-4369-b1b9-0514c921e9cf None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.413866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f12e36-12f2-4369-b1b9-0514c921e9cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:33.414181 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f12e36-12f2-4369-b1b9-0514c921e9cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:33.415253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1e30f-95ad-4996-91db-53546030cc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:33.415671 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f12e36-12f2-4369-b1b9-0514c921e9cf None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:33.416570 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1e30f-95ad-4996-91db-53546030cc20 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.417056 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1e30f-95ad-4996-91db-53546030cc20 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.417841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1e30f-95ad-4996-91db-53546030cc20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.431943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1e30f-95ad-4996-91db-53546030cc20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:33.433906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1e30f-95ad-4996-91db-53546030cc20 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:33.436520 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 286/560] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:33.437669 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f12e36-12f2-4369-b1b9-0514c921e9cf None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:33.458042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-ffe1e30f-95ad-4996-91db-53546030cc20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:33.458042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:33.458042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:33.458042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:33.458042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:33.458042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:33.458042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:33.458042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:33.458042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:33.458042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:33.458042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:33.458042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:33.458042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:33.458042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:33.458042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:33.458994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:33.458994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:33.458994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:33.458994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:33.458994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:33.458994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:33.458994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:33.458994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:33.458994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:33.458994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:33.458994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:33.458994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:33.458994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:33.458994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:33.458994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:33.458994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:33.458994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:33.459862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:33.459862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:33.459862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:33.459862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:33.461908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 275/561] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:33.467068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1e30f-95ad-4996-91db-53546030cc20 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:33.537222 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:33.554369 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f12e36-12f2-4369-b1b9-0514c921e9cf None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:33.565004 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:33.571384 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1e30f-95ad-4996-91db-53546030cc20 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:33.590388 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e5e80-5da2-40b7-86d1-4f821fe2d5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:33.591184 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e5e80-5da2-40b7-86d1-4f821fe2d5ed None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.592007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e5e80-5da2-40b7-86d1-4f821fe2d5ed None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.592285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e5e80-5da2-40b7-86d1-4f821fe2d5ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.603557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e5e80-5da2-40b7-86d1-4f821fe2d5ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:33.607860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18cb41-9f7b-48bc-b4d9-6b6aca9cb38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:33.608544 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18cb41-9f7b-48bc-b4d9-6b6aca9cb38a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.608833 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18cb41-9f7b-48bc-b4d9-6b6aca9cb38a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.609110 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18cb41-9f7b-48bc-b4d9-6b6aca9cb38a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.610212 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18cb41-9f7b-48bc-b4d9-6b6aca9cb38a None admin] RBAC: Adding query filter params (role.id=06f67743387f476cade2623aa7e5c5d2, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=b45db002889846eda5b2a3e6917fcbe1) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:33.610525 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18cb41-9f7b-48bc-b4d9-6b6aca9cb38a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:33.611793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-7f2e5e80-5da2-40b7-86d1-4f821fe2d5ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:33.611793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:33.611793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:33.611793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:33.611793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:33.611793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:33.611793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:33.611793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:33.611793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:33.611793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:33.611793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:33.611793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:33.611793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:33.611793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:33.611793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:33.611793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:33.613101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:33.613101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:33.613101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:33.613101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:33.613101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:33.613101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:33.613101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:33.613101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:33.613101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:33.613101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:33.613101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:33.613101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:33.613101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:33.613101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:33.613101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:33.613101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:33.614016 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:33.614016 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:33.614016 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:33.614016 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:33.614016 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:33.614016 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:33.614016 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:33.614016 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:33.614016 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:33.614016 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:33.614016 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:33.614016 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:33.614663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18cb41-9f7b-48bc-b4d9-6b6aca9cb38a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:33.621899 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 287/562] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:33.621899 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e5e80-5da2-40b7-86d1-4f821fe2d5ed None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:33.632466 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 276/563] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:33 2022] GET /identity/v3/role_assignments?user.id=b45db002889846eda5b2a3e6917fcbe1&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=06f67743387f476cade2623aa7e5c5d2 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:33.632466 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d4268-a668-4e1a-9513-325d995ed2f6 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.632466 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d4268-a668-4e1a-9513-325d995ed2f6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.632466 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d4268-a668-4e1a-9513-325d995ed2f6 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.632906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 277/564] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:33.633609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d4268-a668-4e1a-9513-325d995ed2f6 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:33.741127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e5e80-5da2-40b7-86d1-4f821fe2d5ed None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:33.765172 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d4268-a668-4e1a-9513-325d995ed2f6 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:33.785235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20649e6-6476-406f-8740-3292cc5162da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:33.786093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20649e6-6476-406f-8740-3292cc5162da None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.786375 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20649e6-6476-406f-8740-3292cc5162da None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.786651 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20649e6-6476-406f-8740-3292cc5162da None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.787400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20649e6-6476-406f-8740-3292cc5162da None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:33.787710 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20649e6-6476-406f-8740-3292cc5162da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:33.789142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20649e6-6476-406f-8740-3292cc5162da None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:33.800336 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:33.808756 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e674e0-f339-4f2b-9dae-901405796682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:33.808756 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e674e0-f339-4f2b-9dae-901405796682 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.808756 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e674e0-f339-4f2b-9dae-901405796682 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.808756 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e674e0-f339-4f2b-9dae-901405796682 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.811020 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e674e0-f339-4f2b-9dae-901405796682 None admin] RBAC: Adding query filter params (name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:33.811020 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e674e0-f339-4f2b-9dae-901405796682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:33.811175 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 288/565] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:33.811269 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e674e0-f339-4f2b-9dae-901405796682 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:33.812103 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafd2b8-96d4-4f2c-b39f-124c873a1737 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.812554 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafd2b8-96d4-4f2c-b39f-124c873a1737 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.812976 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafd2b8-96d4-4f2c-b39f-124c873a1737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.820607 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 278/566] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:33.821919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e674e0-f339-4f2b-9dae-901405796682 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:33.831197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-7fafd2b8-96d4-4f2c-b39f-124c873a1737 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:33.832394 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-7fafd2b8-96d4-4f2c-b39f-124c873a1737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:33.859554 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:33.916615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 289/567] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:33.917807 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafd2b8-96d4-4f2c-b39f-124c873a1737 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:33.939272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e674e0-f339-4f2b-9dae-901405796682 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:33.979092 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e03402-b766-41ef-b837-dd6415182f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:33.979901 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e03402-b766-41ef-b837-dd6415182f6c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.980184 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e03402-b766-41ef-b837-dd6415182f6c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.980618 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e03402-b766-41ef-b837-dd6415182f6c None admin] PATH_INFO: `/v3/users/glance` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.988738 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e03402-b766-41ef-b837-dd6415182f6c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:33.990274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e03402-b766-41ef-b837-dd6415182f6c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:34.006245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-e8e03402-b766-41ef-b837-dd6415182f6c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 18:37:34.006245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:34.006245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:34.006245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:34.006245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:34.006245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:34.006245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:34.006245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:34.006245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:34.006245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:34.006245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:34.006245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:34.006245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:34.006245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:34.006245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:34.006245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:34.007278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:34.007278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:34.007278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:34.007278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:34.007278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:34.007278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:34.007278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:34.007278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:34.007278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:34.007278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:34.007278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:34.007278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:34.007278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:34.007278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:34.007278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:34.007278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:34.007278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:34.007278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:34.008264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:34.008264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:34.008264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:34.008264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:34.008264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:34.008264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:34.008264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:34.008264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:34.008264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 18:37:34.008264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:34.011918 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 279/568] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:34.012816 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e03402-b766-41ef-b837-dd6415182f6c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:34.051461 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafd2b8-96d4-4f2c-b39f-124c873a1737 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:34.073283 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:34.091222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31245634-4332-4906-b36d-603e68a54899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:34.092501 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31245634-4332-4906-b36d-603e68a54899 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.093258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31245634-4332-4906-b36d-603e68a54899 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.093731 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31245634-4332-4906-b36d-603e68a54899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.107465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31245634-4332-4906-b36d-603e68a54899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:34.109886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31245634-4332-4906-b36d-603e68a54899 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:34.126825 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e03402-b766-41ef-b837-dd6415182f6c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:34.130809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-31245634-4332-4906-b36d-603e68a54899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:34.130809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:34.130809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:34.130809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:34.130809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:34.130809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:34.130809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:34.130809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:34.130809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:34.130809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:34.130809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:34.130809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:34.130809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:34.130809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:34.130809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:34.131702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:34.131702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:34.131702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:34.131702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:34.131702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:34.131702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:34.131702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:34.131702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:34.131702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:34.131702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:34.131702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:34.131702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:34.131702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:34.131702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:34.131702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:34.131702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:34.131702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:34.132985 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:34.132985 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:34.132985 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:34.132985 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:34.135055 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 290/569] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:34.136112 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31245634-4332-4906-b36d-603e68a54899 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:34.150516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:34.164908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1110cf0-b85d-406b-bee5-d0d96b97c8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:34.167314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1110cf0-b85d-406b-bee5-d0d96b97c8ab None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.167691 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1110cf0-b85d-406b-bee5-d0d96b97c8ab None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.168181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1110cf0-b85d-406b-bee5-d0d96b97c8ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.180124 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1110cf0-b85d-406b-bee5-d0d96b97c8ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:34.188323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-b1110cf0-b85d-406b-bee5-d0d96b97c8ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:34.188323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:34.188323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:34.188323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:34.188323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:34.188323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:34.188323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:34.188323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:34.188323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:34.188323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:34.188323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:34.188323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:34.188323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:34.188323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:34.188323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:34.188323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:34.189291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:34.189291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:34.189291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:34.189291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:34.189291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:34.189291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:34.189291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:34.189291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:34.189291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:34.189291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:34.189291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:34.189291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:34.189291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:34.189291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:34.189291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:34.189291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:34.190126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:34.190126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:34.190126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:34.190126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:34.190126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:34.190126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:34.190126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:34.190126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:34.190126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:34.190126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:34.190126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:34.190126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:34.190126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 280/570] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:34.190844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1110cf0-b85d-406b-bee5-d0d96b97c8ab None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:34.252807 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31245634-4332-4906-b36d-603e68a54899 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:34.291437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fed93-da44-43e9-b3bb-7cce575c6c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:34.292267 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fed93-da44-43e9-b3bb-7cce575c6c98 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.292582 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fed93-da44-43e9-b3bb-7cce575c6c98 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.293185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fed93-da44-43e9-b3bb-7cce575c6c98 None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.294887 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fed93-da44-43e9-b3bb-7cce575c6c98 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:34.295201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fed93-da44-43e9-b3bb-7cce575c6c98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:34.297387 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fed93-da44-43e9-b3bb-7cce575c6c98 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:34.301704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1110cf0-b85d-406b-bee5-d0d96b97c8ab None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:34.315586 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:34.327536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 291/571] 10.222.0.93 () {56 vars in 1137 bytes} [Thu Jun 16 18:37:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:34.327536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3648-d56d-41e6-bdbb-dcc600119cf8 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.327536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3648-d56d-41e6-bdbb-dcc600119cf8 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.327536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3648-d56d-41e6-bdbb-dcc600119cf8 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.327536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 292/572] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:34.327536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f3648-d56d-41e6-bdbb-dcc600119cf8 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:34.335294 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e2e92-9342-4b2f-8105-a3ed5ef63ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:34.335965 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e2e92-9342-4b2f-8105-a3ed5ef63ca1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.336853 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e2e92-9342-4b2f-8105-a3ed5ef63ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.336853 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e2e92-9342-4b2f-8105-a3ed5ef63ca1 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.337292 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e2e92-9342-4b2f-8105-a3ed5ef63ca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:34.337595 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e2e92-9342-4b2f-8105-a3ed5ef63ca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:34.338961 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e2e92-9342-4b2f-8105-a3ed5ef63ca1 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:34.350954 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 281/573] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:34.352608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2366038-1e50-4937-84f4-53424935a7ea None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.352959 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2366038-1e50-4937-84f4-53424935a7ea None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.353302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2366038-1e50-4937-84f4-53424935a7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.370674 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f2366038-1e50-4937-84f4-53424935a7ea None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:34.371874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f2366038-1e50-4937-84f4-53424935a7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:34.405004 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:34.441310 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f3648-d56d-41e6-bdbb-dcc600119cf8 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:34.445937 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 282/574] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:34.446825 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2366038-1e50-4937-84f4-53424935a7ea None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:34.485155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61e44b-e88f-403c-b703-e2c0ddd10ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:34.485829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61e44b-e88f-403c-b703-e2c0ddd10ea1 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.486111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61e44b-e88f-403c-b703-e2c0ddd10ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.486386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61e44b-e88f-403c-b703-e2c0ddd10ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.487134 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61e44b-e88f-403c-b703-e2c0ddd10ea1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:34.487440 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61e44b-e88f-403c-b703-e2c0ddd10ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:34.488890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61e44b-e88f-403c-b703-e2c0ddd10ea1 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:34.497102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 293/575] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:34.502572 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61e44b-e88f-403c-b703-e2c0ddd10ea1 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:34.560690 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2366038-1e50-4937-84f4-53424935a7ea None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:34.563375 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:34.596880 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50618a8d-d349-43b2-97eb-60eb0751b251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:34.597653 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50618a8d-d349-43b2-97eb-60eb0751b251 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.597939 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50618a8d-d349-43b2-97eb-60eb0751b251 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.598218 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50618a8d-d349-43b2-97eb-60eb0751b251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.609174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50618a8d-d349-43b2-97eb-60eb0751b251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:34.610651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50618a8d-d349-43b2-97eb-60eb0751b251 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:34.612698 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61e44b-e88f-403c-b703-e2c0ddd10ea1 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:34.627702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-50618a8d-d349-43b2-97eb-60eb0751b251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:34.627702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:34.627702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:34.627702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:34.627702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:34.627702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:34.627702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:34.627702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:34.627702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:34.627702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:34.627702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:34.627702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:34.627702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:34.627702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:34.627702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:34.628874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:34.628874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:34.628874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:34.628874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:34.628874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:34.628874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:34.628874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:34.628874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:34.628874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:34.628874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:34.628874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:34.628874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:34.628874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:34.628874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:34.628874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:34.628874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:34.628874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:34.629783 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:34.629783 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:34.629783 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:34.629783 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:34.629783 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 283/576] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:34.629783 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50618a8d-d349-43b2-97eb-60eb0751b251 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:34.646388 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:34.653391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d7103-6ce9-411d-9624-29e44305d3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:34.654698 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d7103-6ce9-411d-9624-29e44305d3d3 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.654986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d7103-6ce9-411d-9624-29e44305d3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.655260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d7103-6ce9-411d-9624-29e44305d3d3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.662995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d7103-6ce9-411d-9624-29e44305d3d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:34.664460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d7103-6ce9-411d-9624-29e44305d3d3 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:34.678892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-314d7103-6ce9-411d-9624-29e44305d3d3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 18:37:34.678892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:34.678892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:34.678892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:34.678892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:34.678892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:34.678892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:34.678892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:34.678892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:34.678892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:34.678892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:34.678892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:34.678892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:34.678892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:34.678892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:34.678892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:34.679829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:34.679829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:34.679829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:34.679829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:34.679829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:34.679829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:34.679829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:34.679829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:34.679829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:34.679829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:34.679829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:34.679829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:34.679829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:34.679829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:34.679829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:34.679829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:34.679829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:34.679829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:34.681160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:34.681160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:34.681160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:34.681160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:34.681160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:34.681160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:34.681160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:34.681160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:34.681160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 18:37:34.681160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:34.681160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 294/577] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:34.681160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d7103-6ce9-411d-9624-29e44305d3d3 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:34.738525 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50618a8d-d349-43b2-97eb-60eb0751b251 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:34.774946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283d948-54da-465a-bbc9-8c778e0f682c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:34.776472 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283d948-54da-465a-bbc9-8c778e0f682c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.776856 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283d948-54da-465a-bbc9-8c778e0f682c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.777358 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283d948-54da-465a-bbc9-8c778e0f682c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.789634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d7103-6ce9-411d-9624-29e44305d3d3 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:34.790186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283d948-54da-465a-bbc9-8c778e0f682c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:34.798442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-5283d948-54da-465a-bbc9-8c778e0f682c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:34.798442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:34.798442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:34.798442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:34.798442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:34.798442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:34.798442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:34.798442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:34.798442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:34.798442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:34.798442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:34.798442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:34.798442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:34.798442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:34.798442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:34.798442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:34.799551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:34.799551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:34.799551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:34.799551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:34.799551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:34.799551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:34.799551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:34.799551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:34.799551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:34.799551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:34.799551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:34.799551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:34.799551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:34.799551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:34.799551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:34.799551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:34.800599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:34.800599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:34.800599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:34.800599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:34.800599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:34.800599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:34.800599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:34.800599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:34.800599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:34.800599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:34.800599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:34.800599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:34.801736 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 284/578] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:34.801988 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283d948-54da-465a-bbc9-8c778e0f682c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:34.824018 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:34.830842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a244603-51fd-480a-a25c-890043bdfe5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:34.831903 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a244603-51fd-480a-a25c-890043bdfe5a None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.832368 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a244603-51fd-480a-a25c-890043bdfe5a None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.832741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a244603-51fd-480a-a25c-890043bdfe5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.844400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a244603-51fd-480a-a25c-890043bdfe5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:34.845887 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a244603-51fd-480a-a25c-890043bdfe5a None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:34.863212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-3a244603-51fd-480a-a25c-890043bdfe5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:34.863212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:34.863212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:34.863212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:34.863212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:34.863212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:34.863212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:34.863212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:34.863212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:34.863212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:34.863212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:34.863212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:34.863212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:34.863212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:34.863212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:34.864102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:34.864102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:34.864102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:34.864102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:34.864102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:34.864102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:34.864102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:34.864102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:34.864102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:34.864102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:34.864102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:34.864102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:34.864102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:34.864102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:34.864102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:34.864102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:34.864102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:34.865072 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:34.865072 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:34.865072 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:34.865072 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:34.865072 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 295/579] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:34.865779 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a244603-51fd-480a-a25c-890043bdfe5a None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:34.914934 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:34.919746 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283d948-54da-465a-bbc9-8c778e0f682c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:34.954454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823c0f9-4995-4ba9-a66a-ce8a218d0ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:34.955099 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823c0f9-4995-4ba9-a66a-ce8a218d0ebc None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.955381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823c0f9-4995-4ba9-a66a-ce8a218d0ebc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.955677 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823c0f9-4995-4ba9-a66a-ce8a218d0ebc None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.956369 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823c0f9-4995-4ba9-a66a-ce8a218d0ebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:34.956699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823c0f9-4995-4ba9-a66a-ce8a218d0ebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:34.958062 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823c0f9-4995-4ba9-a66a-ce8a218d0ebc None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:34.975781 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 285/580] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:34.975781 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823c0f9-4995-4ba9-a66a-ce8a218d0ebc None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:34.976052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a244603-51fd-480a-a25c-890043bdfe5a None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:35.007906 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0a5ef-56be-4347-bd50-b8e7bff4793f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:35.008622 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0a5ef-56be-4347-bd50-b8e7bff4793f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:35.008911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0a5ef-56be-4347-bd50-b8e7bff4793f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:35.009188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0a5ef-56be-4347-bd50-b8e7bff4793f None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:35.010022 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0a5ef-56be-4347-bd50-b8e7bff4793f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:35.010339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0a5ef-56be-4347-bd50-b8e7bff4793f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:35.011953 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0a5ef-56be-4347-bd50-b8e7bff4793f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:35.034436 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 296/581] 10.222.0.93 () {56 vars in 1137 bytes} [Thu Jun 16 18:37:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:35.034436 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0a5ef-56be-4347-bd50-b8e7bff4793f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:35.058844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:35.082080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823c0f9-4995-4ba9-a66a-ce8a218d0ebc None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:35.115296 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df75e38-2971-4367-830e-6e529f0593c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:35.116114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df75e38-2971-4367-830e-6e529f0593c6 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:35.116491 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df75e38-2971-4367-830e-6e529f0593c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:35.116836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df75e38-2971-4367-830e-6e529f0593c6 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:35.117675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df75e38-2971-4367-830e-6e529f0593c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:35.118053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df75e38-2971-4367-830e-6e529f0593c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:35.119419 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df75e38-2971-4367-830e-6e529f0593c6 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:35.126252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0a5ef-56be-4347-bd50-b8e7bff4793f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:35.131595 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 286/582] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:35.131595 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df75e38-2971-4367-830e-6e529f0593c6 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:35.164192 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da9202-9c3a-44e5-bdc2-f032fb256b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:35.164967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da9202-9c3a-44e5-bdc2-f032fb256b29 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:35.165378 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da9202-9c3a-44e5-bdc2-f032fb256b29 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:35.165740 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da9202-9c3a-44e5-bdc2-f032fb256b29 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:35.166527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da9202-9c3a-44e5-bdc2-f032fb256b29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:35.166901 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da9202-9c3a-44e5-bdc2-f032fb256b29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:35.168333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da9202-9c3a-44e5-bdc2-f032fb256b29 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:35.187896 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 297/583] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:35.187896 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da9202-9c3a-44e5-bdc2-f032fb256b29 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:35.237312 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df75e38-2971-4367-830e-6e529f0593c6 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:35.274576 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840318c-323e-4327-b53d-d91cb408960b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:35.275468 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840318c-323e-4327-b53d-d91cb408960b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:35.275755 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840318c-323e-4327-b53d-d91cb408960b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:35.276028 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840318c-323e-4327-b53d-d91cb408960b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:35.283694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840318c-323e-4327-b53d-d91cb408960b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:35.285159 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840318c-323e-4327-b53d-d91cb408960b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:35.295882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da9202-9c3a-44e5-bdc2-f032fb256b29 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:35.299235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-8840318c-323e-4327-b53d-d91cb408960b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:35.299235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:35.299235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:35.299235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:35.299235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:35.299235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:35.299235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:35.299235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:35.299235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:35.299235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:35.299235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:35.299235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:35.299235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:35.299235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:35.299235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:35.300316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:35.300316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:35.300316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:35.300316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:35.300316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:35.300316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:35.300316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:35.300316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:35.300316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:35.300316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:35.300316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:35.300316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:35.300316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:35.300316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:35.300316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:35.300316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:35.300316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:35.301666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:35.301666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:35.301666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:35.301666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:35.301666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:35.301666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:35.301666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:35.301666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:35.306005 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 287/584] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:35.306005 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840318c-323e-4327-b53d-d91cb408960b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:35.315534 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:35.337314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:35.338730 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550281b-3299-4f36-95b7-d124adb08ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:35.339528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550281b-3299-4f36-95b7-d124adb08ee2 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:35.339813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550281b-3299-4f36-95b7-d124adb08ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:35.340091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550281b-3299-4f36-95b7-d124adb08ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:35.351888 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550281b-3299-4f36-95b7-d124adb08ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:35.353403 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550281b-3299-4f36-95b7-d124adb08ee2 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:35.371084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-2550281b-3299-4f36-95b7-d124adb08ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:35.371084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:35.371084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:35.371084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:35.371084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:35.371084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:35.371084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:35.371084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:35.371084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:35.371084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:35.371084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:35.371084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:35.371084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:35.371084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:35.371084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:35.372030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:35.372030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:35.372030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:35.372030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:35.372030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:35.372030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:35.372030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:35.372030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:35.372030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:35.372030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:35.372030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:35.372030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:35.372030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:35.372030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:35.372030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:35.372030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:35.372030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:35.373656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:35.373656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:35.373656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:35.373656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:35.373656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 298/585] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:35.378953 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550281b-3299-4f36-95b7-d124adb08ee2 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:35.395033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:35.412129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840318c-323e-4327-b53d-d91cb408960b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:35.447823 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2702646-fb3f-4fc6-aeb9-940f1f245791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:35.448744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2702646-fb3f-4fc6-aeb9-940f1f245791 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:35.449099 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2702646-fb3f-4fc6-aeb9-940f1f245791 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:35.449472 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2702646-fb3f-4fc6-aeb9-940f1f245791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:35.460411 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2702646-fb3f-4fc6-aeb9-940f1f245791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:35.461991 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2702646-fb3f-4fc6-aeb9-940f1f245791 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:35.479964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-a2702646-fb3f-4fc6-aeb9-940f1f245791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:35.479964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:35.479964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:35.479964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:35.479964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:35.479964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:35.479964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:35.479964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:35.479964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:35.479964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:35.479964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:35.479964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:35.479964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:35.479964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:35.479964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:35.481160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:35.481160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:35.481160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:35.481160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:35.481160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:35.481160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:35.481160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:35.481160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:35.481160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:35.481160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:35.481160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:35.481160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:35.481160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:35.481160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:35.481160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:35.481160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:35.481160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:35.482282 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:35.482282 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:35.482282 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:35.482282 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:35.483112 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 288/586] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:35.487704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2702646-fb3f-4fc6-aeb9-940f1f245791 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:35.493252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550281b-3299-4f36-95b7-d124adb08ee2 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:35.529053 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c43e9-6eba-4e7b-854b-28d7ff2d7c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:35.529771 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c43e9-6eba-4e7b-854b-28d7ff2d7c19 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:35.530055 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c43e9-6eba-4e7b-854b-28d7ff2d7c19 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:35.530323 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c43e9-6eba-4e7b-854b-28d7ff2d7c19 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:35.537343 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c43e9-6eba-4e7b-854b-28d7ff2d7c19 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:35.538800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c43e9-6eba-4e7b-854b-28d7ff2d7c19 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:35.539796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:35.553683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-779c43e9-6eba-4e7b-854b-28d7ff2d7c19 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:35.553683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:35.553683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:35.553683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:35.553683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:35.553683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:35.553683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:35.553683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:35.553683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:35.553683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:35.553683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:35.553683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:35.553683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:35.553683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:35.553683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:35.553683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:35.555464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:35.555464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:35.555464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:35.555464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:35.555464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:35.555464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:35.555464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:35.555464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:35.555464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:35.555464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:35.555464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:35.555464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:35.555464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:35.555464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:35.555464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:35.555464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:35.555464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:35.555464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:35.556677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:35.556677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:35.556677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:35.556677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:35.556677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:35.556677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:35.556677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:35.556677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:35.556677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:35.556677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:35.556677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 299/587] 10.222.0.93 () {56 vars in 1093 bytes} [Thu Jun 16 18:37:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:35.556677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c43e9-6eba-4e7b-854b-28d7ff2d7c19 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:35.595134 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2702646-fb3f-4fc6-aeb9-940f1f245791 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:35.631632 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08f587-405b-4cf0-86ed-931dd5609c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:35.632298 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08f587-405b-4cf0-86ed-931dd5609c18 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:35.632652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08f587-405b-4cf0-86ed-931dd5609c18 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:35.632932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08f587-405b-4cf0-86ed-931dd5609c18 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:35.633914 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08f587-405b-4cf0-86ed-931dd5609c18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:35.634199 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:35.634972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08f587-405b-4cf0-86ed-931dd5609c18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:35.636279 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08f587-405b-4cf0-86ed-931dd5609c18 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:35.653311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 289/588] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:35.653311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08f587-405b-4cf0-86ed-931dd5609c18 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:35.672549 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c43e9-6eba-4e7b-854b-28d7ff2d7c19 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:35.708549 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d1f06-6144-4bf5-9511-26d46f730f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:35.709328 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d1f06-6144-4bf5-9511-26d46f730f8f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:35.709613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d1f06-6144-4bf5-9511-26d46f730f8f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:35.709892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d1f06-6144-4bf5-9511-26d46f730f8f None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:35.710618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d1f06-6144-4bf5-9511-26d46f730f8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:35.710928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d1f06-6144-4bf5-9511-26d46f730f8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:35.712646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d1f06-6144-4bf5-9511-26d46f730f8f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:35.729318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 300/589] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:35.729318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d1f06-6144-4bf5-9511-26d46f730f8f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:35.758409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08f587-405b-4cf0-86ed-931dd5609c18 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:35.769473 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:35.796492 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd229c-31b8-434a-8528-7a08ea7f12f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:35.797148 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd229c-31b8-434a-8528-7a08ea7f12f0 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:35.797371 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd229c-31b8-434a-8528-7a08ea7f12f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:35.797653 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd229c-31b8-434a-8528-7a08ea7f12f0 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:35.798397 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd229c-31b8-434a-8528-7a08ea7f12f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:35.798753 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd229c-31b8-434a-8528-7a08ea7f12f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:35.800157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd229c-31b8-434a-8528-7a08ea7f12f0 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:35.819868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 290/590] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:35.819868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd229c-31b8-434a-8528-7a08ea7f12f0 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:35.840097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d1f06-6144-4bf5-9511-26d46f730f8f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:35.870908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:35.876245 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a7322-fabd-45d7-a936-ca20aefb0880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:35.876947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a7322-fabd-45d7-a936-ca20aefb0880 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:35.877234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a7322-fabd-45d7-a936-ca20aefb0880 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:35.877515 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a7322-fabd-45d7-a936-ca20aefb0880 None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:35.878346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a7322-fabd-45d7-a936-ca20aefb0880 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:35.878666 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a7322-fabd-45d7-a936-ca20aefb0880 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:35.880089 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a7322-fabd-45d7-a936-ca20aefb0880 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:35.896985 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 301/591] 10.222.0.93 () {56 vars in 1133 bytes} [Thu Jun 16 18:37:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:35.897702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a7322-fabd-45d7-a936-ca20aefb0880 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:35.920056 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd229c-31b8-434a-8528-7a08ea7f12f0 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:35.953721 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779d4c0-9e8b-47f9-a566-b9f63e854006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:35.954610 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779d4c0-9e8b-47f9-a566-b9f63e854006 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:35.954890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779d4c0-9e8b-47f9-a566-b9f63e854006 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:35.955164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779d4c0-9e8b-47f9-a566-b9f63e854006 None admin] PATH_INFO: `/v3/projects/d6d43f779d67418baf199556b8e497c7/users/00c13f10b14449cea284eb629a316d83/roles/06f67743387f476cade2623aa7e5c5d2` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:35.969415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779d4c0-9e8b-47f9-a566-b9f63e854006 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6d43f779d67418baf199556b8e497c7, user_id=00c13f10b14449cea284eb629a316d83, role_id=06f67743387f476cade2623aa7e5c5d2)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:35.970861 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779d4c0-9e8b-47f9-a566-b9f63e854006 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:35.996282 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a7322-fabd-45d7-a936-ca20aefb0880 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:36.029690 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33f409-074c-4171-87b3-f5b214a84a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:36.030486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33f409-074c-4171-87b3-f5b214a84a22 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:36.030771 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33f409-074c-4171-87b3-f5b214a84a22 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:36.031110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33f409-074c-4171-87b3-f5b214a84a22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:36.039064 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33f409-074c-4171-87b3-f5b214a84a22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:36.040526 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33f409-074c-4171-87b3-f5b214a84a22 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:36.054577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-6a33f409-074c-4171-87b3-f5b214a84a22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:36.054577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:36.054577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:36.054577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:36.054577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:36.054577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:36.054577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:36.054577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:36.054577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:36.054577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:36.054577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:36.054577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:36.054577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:36.054577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:36.054577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:36.056113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:36.056113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:36.056113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:36.056113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:36.056113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:36.056113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:36.056113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:36.056113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:36.056113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:36.056113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:36.056113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:36.056113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:36.056113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:36.056113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:36.056113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:36.056113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:36.056113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:36.057110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:36.057110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:36.057110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:36.057110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:36.057110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:36.057110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:36.057110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:36.057110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:36.057110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 302/592] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:36.057110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33f409-074c-4171-87b3-f5b214a84a22 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:36.090251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 291/593] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:37:35 2022] PUT /identity/v3/projects/d6d43f779d67418baf199556b8e497c7/users/00c13f10b14449cea284eb629a316d83/roles/06f67743387f476cade2623aa7e5c5d2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:36.113351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddceb9d-4308-408e-a0d2-696133570ed0 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:36.113351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddceb9d-4308-408e-a0d2-696133570ed0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:36.113351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddceb9d-4308-408e-a0d2-696133570ed0 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:36.113351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 292/594] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:36.113351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddceb9d-4308-408e-a0d2-696133570ed0 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:36.113785 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:36.125041 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:36.167905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33f409-074c-4171-87b3-f5b214a84a22 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:36.205296 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd23aa-ffac-4785-8821-dd3b84936820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:36.206120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd23aa-ffac-4785-8821-dd3b84936820 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:36.206445 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd23aa-ffac-4785-8821-dd3b84936820 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:36.206728 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd23aa-ffac-4785-8821-dd3b84936820 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:36.209840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddceb9d-4308-408e-a0d2-696133570ed0 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:36.216699 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd23aa-ffac-4785-8821-dd3b84936820 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:36.218442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd23aa-ffac-4785-8821-dd3b84936820 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:36.234513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-69fd23aa-ffac-4785-8821-dd3b84936820 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 18:37:36.234513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:36.234513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:36.234513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:36.234513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:36.234513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:36.234513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:36.234513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:36.234513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:36.234513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:36.234513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:36.234513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:36.234513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:36.234513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:36.234513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:36.234513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:36.235583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:36.235583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:36.235583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:36.235583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:36.235583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:36.235583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:36.235583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:36.235583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:36.235583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:36.235583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:36.235583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:36.235583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:36.235583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:36.235583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:36.235583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:36.235583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:36.235583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:36.235583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:36.237013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:36.237013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:36.237013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:36.237013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:36.237013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:36.237013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:36.237013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:36.237013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:36.237013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 18:37:36.237013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:36.237013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 303/595] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:36.237013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd23aa-ffac-4785-8821-dd3b84936820 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:36.266077 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb2916-fba9-47c0-bc0e-fcb2a6067a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:36.267874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb2916-fba9-47c0-bc0e-fcb2a6067a6d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:36.267874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb2916-fba9-47c0-bc0e-fcb2a6067a6d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:36.267874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb2916-fba9-47c0-bc0e-fcb2a6067a6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:36.279879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb2916-fba9-47c0-bc0e-fcb2a6067a6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:36.281490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb2916-fba9-47c0-bc0e-fcb2a6067a6d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:36.304467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-56cb2916-fba9-47c0-bc0e-fcb2a6067a6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:36.304467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:36.304467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:36.304467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:36.304467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:36.304467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:36.304467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:36.304467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:36.304467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:36.304467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:36.304467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:36.304467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:36.304467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:36.304467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:36.304467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:36.308890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:36.308890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:36.308890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:36.308890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:36.308890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:36.308890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:36.308890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:36.308890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:36.308890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:36.308890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:36.308890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:36.308890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:36.308890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:36.308890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:36.308890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:36.308890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:36.308890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:36.309836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:36.309836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:36.309836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:36.309836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:36.309836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 293/596] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:36.309836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab898c2-47b8-4b74-a252-144c024cdb5d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:36.309836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab898c2-47b8-4b74-a252-144c024cdb5d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:36.309836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab898c2-47b8-4b74-a252-144c024cdb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:36.327015 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5ab898c2-47b8-4b74-a252-144c024cdb5d None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:36.328211 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5ab898c2-47b8-4b74-a252-144c024cdb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:36.358880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd23aa-ffac-4785-8821-dd3b84936820 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:36.372303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:36.399525 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 294/597] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:36.399829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b8e71-841a-43e1-b0d4-cf3f1e3be7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:36.400465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b8e71-841a-43e1-b0d4-cf3f1e3be7a3 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:36.400754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b8e71-841a-43e1-b0d4-cf3f1e3be7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:36.401033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b8e71-841a-43e1-b0d4-cf3f1e3be7a3 None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:36.401633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab898c2-47b8-4b74-a252-144c024cdb5d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:36.401823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b8e71-841a-43e1-b0d4-cf3f1e3be7a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:36.402137 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b8e71-841a-43e1-b0d4-cf3f1e3be7a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:36.404264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b8e71-841a-43e1-b0d4-cf3f1e3be7a3 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:36.405347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:36.424862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 304/598] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:36.426185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b8e71-841a-43e1-b0d4-cf3f1e3be7a3 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:36.507165 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab898c2-47b8-4b74-a252-144c024cdb5d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:36.530295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b8e71-841a-43e1-b0d4-cf3f1e3be7a3 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:36.542779 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a5557-a0bc-441c-a874-c3f45279047d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:36.543460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a5557-a0bc-441c-a874-c3f45279047d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:36.543776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a5557-a0bc-441c-a874-c3f45279047d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:36.544109 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a5557-a0bc-441c-a874-c3f45279047d None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:36.544938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a5557-a0bc-441c-a874-c3f45279047d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:36.545255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a5557-a0bc-441c-a874-c3f45279047d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:36.546706 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a5557-a0bc-441c-a874-c3f45279047d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:36.565921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112fd46-e935-495c-a640-20a53b291c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:36.565921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112fd46-e935-495c-a640-20a53b291c44 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:36.565921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112fd46-e935-495c-a640-20a53b291c44 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:36.565921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112fd46-e935-495c-a640-20a53b291c44 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:36.566312 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112fd46-e935-495c-a640-20a53b291c44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:36.566455 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112fd46-e935-495c-a640-20a53b291c44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:36.567736 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112fd46-e935-495c-a640-20a53b291c44 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:36.568850 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 295/599] 10.222.0.93 () {56 vars in 1139 bytes} [Thu Jun 16 18:37:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:36.569657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a5557-a0bc-441c-a874-c3f45279047d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:36.584225 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 305/600] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:36.584225 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112fd46-e935-495c-a640-20a53b291c44 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:36.615883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:36.638857 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:36.679052 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a5557-a0bc-441c-a874-c3f45279047d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:36.688863 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112fd46-e935-495c-a640-20a53b291c44 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:36.716253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf677f4-9936-4b4d-bfa4-672272ab24cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:36.717485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf677f4-9936-4b4d-bfa4-672272ab24cb None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:36.717781 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf677f4-9936-4b4d-bfa4-672272ab24cb None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:36.718060 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf677f4-9936-4b4d-bfa4-672272ab24cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:36.724359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0bbf1-1dd3-4b63-99f8-7007eb5bccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:36.725276 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0bbf1-1dd3-4b63-99f8-7007eb5bccd2 None admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:36.725565 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0bbf1-1dd3-4b63-99f8-7007eb5bccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:36.725843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0bbf1-1dd3-4b63-99f8-7007eb5bccd2 None admin] PATH_INFO: `/v3/projects/d6d43f779d67418baf199556b8e497c7/users/3862d73c187e403fb1e1ef4e1984cee7/roles/06f67743387f476cade2623aa7e5c5d2` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:36.730506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf677f4-9936-4b4d-bfa4-672272ab24cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:36.738941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-3bf677f4-9936-4b4d-bfa4-672272ab24cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:36.738941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:36.738941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:36.738941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:36.738941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:36.738941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:36.738941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:36.738941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:36.738941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:36.738941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:36.738941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:36.738941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:36.738941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:36.738941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:36.738941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:36.738941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:36.739890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:36.739890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:36.739890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:36.739890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:36.739890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:36.739890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:36.739890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:36.739890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:36.739890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:36.739890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:36.739890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:36.739890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:36.739890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:36.739890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:36.739890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:36.739890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:36.740770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:36.740770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:36.740770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:36.740770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:36.740770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:36.740770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:36.740770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:36.740770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:36.740770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:36.740770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:36.740770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:36.740770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:36.746868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 296/601] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:36.746868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf677f4-9936-4b4d-bfa4-672272ab24cb None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:36.747406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0bbf1-1dd3-4b63-99f8-7007eb5bccd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6d43f779d67418baf199556b8e497c7, user_id=3862d73c187e403fb1e1ef4e1984cee7, role_id=06f67743387f476cade2623aa7e5c5d2)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:36.749149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0bbf1-1dd3-4b63-99f8-7007eb5bccd2 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:36.821962 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 306/602] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:37:36 2022] PUT /identity/v3/projects/d6d43f779d67418baf199556b8e497c7/users/3862d73c187e403fb1e1ef4e1984cee7/roles/06f67743387f476cade2623aa7e5c5d2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:36.823139 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0bbf1-1dd3-4b63-99f8-7007eb5bccd2 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:36.863554 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf677f4-9936-4b4d-bfa4-672272ab24cb None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:36.891108 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:36.908807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2aeec-da94-4017-9af5-921f7174e46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:36.910021 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2aeec-da94-4017-9af5-921f7174e46a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:36.910638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2aeec-da94-4017-9af5-921f7174e46a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:36.911105 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2aeec-da94-4017-9af5-921f7174e46a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:36.926027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2aeec-da94-4017-9af5-921f7174e46a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:36.927922 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2aeec-da94-4017-9af5-921f7174e46a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:36.944375 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:36.951372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-6ed2aeec-da94-4017-9af5-921f7174e46a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:36.951372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:36.951372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:36.951372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:36.951372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:36.951372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:36.951372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:36.951372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:36.951372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:36.951372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:36.951372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:36.951372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:36.951372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:36.951372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:36.951372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:36.952342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:36.952342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:36.952342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:36.952342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:36.952342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:36.952342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:36.952342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:36.952342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:36.952342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:36.952342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:36.952342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:36.952342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:36.952342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:36.952342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:36.952342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:36.952342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:36.952342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:36.953317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:36.953317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:36.953317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:36.953317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:36.955690 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 297/603] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:36.956865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2aeec-da94-4017-9af5-921f7174e46a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:36.966606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0bbf1-1dd3-4b63-99f8-7007eb5bccd2 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:37.020789 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557984ae-6f9d-485c-93c2-37ac1ba1aa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:37.021602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557984ae-6f9d-485c-93c2-37ac1ba1aa1a None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:37.023977 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557984ae-6f9d-485c-93c2-37ac1ba1aa1a None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:37.024267 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557984ae-6f9d-485c-93c2-37ac1ba1aa1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:37.033672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557984ae-6f9d-485c-93c2-37ac1ba1aa1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:37.035138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557984ae-6f9d-485c-93c2-37ac1ba1aa1a None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:37.050003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-557984ae-6f9d-485c-93c2-37ac1ba1aa1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:37.050003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:37.050003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:37.050003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:37.050003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:37.050003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:37.050003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:37.050003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:37.050003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:37.050003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:37.050003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:37.050003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:37.050003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:37.050003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:37.050003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:37.051133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:37.051133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:37.051133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:37.051133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:37.051133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:37.051133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:37.051133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:37.051133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:37.051133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:37.051133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:37.051133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:37.051133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:37.051133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:37.051133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:37.051133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:37.051133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:37.051133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:37.052120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:37.052120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:37.052120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:37.052120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:37.052120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:37.052120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:37.052120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:37.052120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:37.052120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 307/604] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:37.054052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557984ae-6f9d-485c-93c2-37ac1ba1aa1a None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:37.085772 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2aeec-da94-4017-9af5-921f7174e46a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:37.133410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731bc63-2de4-4bef-901a-731d6d2b9bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:37.134188 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731bc63-2de4-4bef-901a-731d6d2b9bd7 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:37.134549 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731bc63-2de4-4bef-901a-731d6d2b9bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:37.134903 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731bc63-2de4-4bef-901a-731d6d2b9bd7 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:37.135740 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731bc63-2de4-4bef-901a-731d6d2b9bd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:37.136127 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731bc63-2de4-4bef-901a-731d6d2b9bd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:37.138700 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731bc63-2de4-4bef-901a-731d6d2b9bd7 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:37.150501 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 298/605] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:37.152981 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731bc63-2de4-4bef-901a-731d6d2b9bd7 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:37.169451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557984ae-6f9d-485c-93c2-37ac1ba1aa1a None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:37.204812 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:37.219577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4d953-7713-484d-a079-c7b6b854e648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:37.222011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4d953-7713-484d-a079-c7b6b854e648 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:37.222011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4d953-7713-484d-a079-c7b6b854e648 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:37.222011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4d953-7713-484d-a079-c7b6b854e648 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:37.222902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4d953-7713-484d-a079-c7b6b854e648 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:37.223291 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4d953-7713-484d-a079-c7b6b854e648 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:37.225221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4d953-7713-484d-a079-c7b6b854e648 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:37.235896 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:37.240268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 308/606] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:37.241224 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4d953-7713-484d-a079-c7b6b854e648 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:37.284707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731bc63-2de4-4bef-901a-731d6d2b9bd7 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:37.339806 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735dd4b-6929-4ac8-9268-bd6027ec6ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:37.341098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735dd4b-6929-4ac8-9268-bd6027ec6ebc None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:37.341466 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735dd4b-6929-4ac8-9268-bd6027ec6ebc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:37.341822 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735dd4b-6929-4ac8-9268-bd6027ec6ebc None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:37.343439 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735dd4b-6929-4ac8-9268-bd6027ec6ebc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:37.343831 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735dd4b-6929-4ac8-9268-bd6027ec6ebc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:37.346109 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735dd4b-6929-4ac8-9268-bd6027ec6ebc None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:37.363785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 299/607] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:37.364654 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735dd4b-6929-4ac8-9268-bd6027ec6ebc None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:37.377185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4d953-7713-484d-a079-c7b6b854e648 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:37.413089 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfc237-e2b5-4980-9d14-df7f5078ec9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:37.413936 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfc237-e2b5-4980-9d14-df7f5078ec9e None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:37.414224 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfc237-e2b5-4980-9d14-df7f5078ec9e None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:37.414506 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfc237-e2b5-4980-9d14-df7f5078ec9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:37.426106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfc237-e2b5-4980-9d14-df7f5078ec9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:37.427686 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfc237-e2b5-4980-9d14-df7f5078ec9e None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:37.446333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-95dfc237-e2b5-4980-9d14-df7f5078ec9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:37.446333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:37.446333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:37.446333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:37.446333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:37.446333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:37.446333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:37.446333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:37.446333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:37.446333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:37.446333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:37.446333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:37.446333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:37.446333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:37.446333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:37.447386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:37.447386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:37.447386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:37.447386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:37.447386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:37.447386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:37.447386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:37.447386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:37.447386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:37.447386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:37.447386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:37.447386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:37.447386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:37.447386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:37.447386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:37.447386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:37.447386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:37.448317 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:37.448317 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:37.448317 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:37.448317 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:37.448317 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 309/608] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:37.452456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfc237-e2b5-4980-9d14-df7f5078ec9e None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:37.491083 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:37.498310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735dd4b-6929-4ac8-9268-bd6027ec6ebc None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:37.520287 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:37.533696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c6d6d-6992-463f-8196-d5c801ed725c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:37.534768 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c6d6d-6992-463f-8196-d5c801ed725c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:37.535055 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c6d6d-6992-463f-8196-d5c801ed725c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:37.535334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c6d6d-6992-463f-8196-d5c801ed725c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:37.544967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c6d6d-6992-463f-8196-d5c801ed725c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:37.546451 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c6d6d-6992-463f-8196-d5c801ed725c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:37.564409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-a30c6d6d-6992-463f-8196-d5c801ed725c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:37.564409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:37.564409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:37.564409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:37.564409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:37.564409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:37.564409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:37.564409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:37.564409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:37.564409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:37.564409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:37.564409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:37.564409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:37.564409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:37.564409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:37.569564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:37.569564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:37.569564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:37.569564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:37.569564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:37.569564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:37.569564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:37.569564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:37.569564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:37.569564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:37.569564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:37.569564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:37.569564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:37.569564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:37.569564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:37.569564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:37.569564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:37.570474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:37.570474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:37.570474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:37.570474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:37.570474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:37.570474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:37.570474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:37.570474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:37.570474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 300/609] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:37.570474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c6d6d-6992-463f-8196-d5c801ed725c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:37.581741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfc237-e2b5-4980-9d14-df7f5078ec9e None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:37.626688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409708ad-9285-4707-9223-79df75ac1f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:37.627795 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409708ad-9285-4707-9223-79df75ac1f4e None admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:37.628087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409708ad-9285-4707-9223-79df75ac1f4e None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:37.628371 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409708ad-9285-4707-9223-79df75ac1f4e None admin] PATH_INFO: `/v3/projects/d6d43f779d67418baf199556b8e497c7/users/3503ec98bea14693a17a84e686586bad/roles/06f67743387f476cade2623aa7e5c5d2` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:37.648797 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409708ad-9285-4707-9223-79df75ac1f4e None admin] RBAC: Authorizing `identity:create_grant(project_id=d6d43f779d67418baf199556b8e497c7, user_id=3503ec98bea14693a17a84e686586bad, role_id=06f67743387f476cade2623aa7e5c5d2)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:37.650982 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409708ad-9285-4707-9223-79df75ac1f4e None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:37.694886 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c6d6d-6992-463f-8196-d5c801ed725c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:37.730856 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963b360-ee35-4401-a29f-d47408a7afda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:37.732066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963b360-ee35-4401-a29f-d47408a7afda None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:37.732349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963b360-ee35-4401-a29f-d47408a7afda None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:37.732652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963b360-ee35-4401-a29f-d47408a7afda None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:37.733376 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963b360-ee35-4401-a29f-d47408a7afda None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:37.733689 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963b360-ee35-4401-a29f-d47408a7afda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:37.735061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963b360-ee35-4401-a29f-d47408a7afda None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:37.752469 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 301/610] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:37.752469 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963b360-ee35-4401-a29f-d47408a7afda None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:37.754008 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 310/611] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:37:37 2022] PUT /identity/v3/projects/d6d43f779d67418baf199556b8e497c7/users/3503ec98bea14693a17a84e686586bad/roles/06f67743387f476cade2623aa7e5c5d2 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:37.762752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409708ad-9285-4707-9223-79df75ac1f4e None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:37.774574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:37.892809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963b360-ee35-4401-a29f-d47408a7afda None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:37.936461 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795005cd-8983-4b25-88f0-81dcd9b66e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:37.936461 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795005cd-8983-4b25-88f0-81dcd9b66e01 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:37.936461 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795005cd-8983-4b25-88f0-81dcd9b66e01 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:37.936461 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795005cd-8983-4b25-88f0-81dcd9b66e01 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:37.936909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795005cd-8983-4b25-88f0-81dcd9b66e01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:37.936909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795005cd-8983-4b25-88f0-81dcd9b66e01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:37.936909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795005cd-8983-4b25-88f0-81dcd9b66e01 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:37.960546 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 302/612] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:37.963184 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409708ad-9285-4707-9223-79df75ac1f4e None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:37.969486 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795005cd-8983-4b25-88f0-81dcd9b66e01 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:37.977267 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:38.023678 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc112a-5dbd-4fb9-9dfa-1adfe359846c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:38.024519 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc112a-5dbd-4fb9-9dfa-1adfe359846c None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.024801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc112a-5dbd-4fb9-9dfa-1adfe359846c None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.025070 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc112a-5dbd-4fb9-9dfa-1adfe359846c None admin] PATH_INFO: `/v3/users/swift` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.036497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc112a-5dbd-4fb9-9dfa-1adfe359846c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:38.038372 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc112a-5dbd-4fb9-9dfa-1adfe359846c None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:38.058309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-eefc112a-5dbd-4fb9-9dfa-1adfe359846c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:38.058309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:38.058309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:38.058309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:38.058309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:38.058309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:38.058309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:38.058309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:38.058309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:38.058309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:38.058309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:38.058309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:38.058309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:38.058309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:38.058309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:38.058309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:38.059350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:38.059350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:38.059350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:38.059350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:38.059350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:38.059350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:38.059350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:38.059350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:38.059350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:38.059350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:38.059350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:38.059350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:38.059350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:38.059350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:38.059350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:38.059350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:38.059350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:38.059350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:38.060325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:38.060325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:38.060325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:38.060325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:38.060325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:38.060325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:38.060325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:38.060325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:38.060325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:38.060325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:38.060325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 311/613] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:38.067551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc112a-5dbd-4fb9-9dfa-1adfe359846c None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:38.104411 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:38.135645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795005cd-8983-4b25-88f0-81dcd9b66e01 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:38.172210 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8ea82-296a-482c-b255-4b479b195802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:38.173125 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8ea82-296a-482c-b255-4b479b195802 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.173409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8ea82-296a-482c-b255-4b479b195802 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.173686 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8ea82-296a-482c-b255-4b479b195802 None admin] PATH_INFO: `/v3/projects/d6d43f779d67418baf199556b8e497c7/users/753728a82bdb406892015f8373932ff1/roles/06f67743387f476cade2623aa7e5c5d2` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.205926 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8ea82-296a-482c-b255-4b479b195802 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6d43f779d67418baf199556b8e497c7, user_id=753728a82bdb406892015f8373932ff1, role_id=06f67743387f476cade2623aa7e5c5d2)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:38.207372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8ea82-296a-482c-b255-4b479b195802 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:38.222877 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc112a-5dbd-4fb9-9dfa-1adfe359846c None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:38.259777 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb8732-ad30-4954-9fea-1e536db208ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:38.260546 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb8732-ad30-4954-9fea-1e536db208ab None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.260834 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb8732-ad30-4954-9fea-1e536db208ab None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.261113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb8732-ad30-4954-9fea-1e536db208ab None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.261960 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb8732-ad30-4954-9fea-1e536db208ab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:38.262302 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb8732-ad30-4954-9fea-1e536db208ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:38.263740 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb8732-ad30-4954-9fea-1e536db208ab None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:38.283885 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 312/614] 10.222.0.93 () {56 vars in 1135 bytes} [Thu Jun 16 18:37:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:38.289786 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb8732-ad30-4954-9fea-1e536db208ab None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:38.306383 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 303/615] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:37:37 2022] PUT /identity/v3/projects/d6d43f779d67418baf199556b8e497c7/users/753728a82bdb406892015f8373932ff1/roles/06f67743387f476cade2623aa7e5c5d2 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:38.312848 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:38.401106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb8732-ad30-4954-9fea-1e536db208ab None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:38.440729 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60202863-9cfd-4693-b865-6cbf1107ea4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:38.441632 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60202863-9cfd-4693-b865-6cbf1107ea4f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.442022 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60202863-9cfd-4693-b865-6cbf1107ea4f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.442402 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60202863-9cfd-4693-b865-6cbf1107ea4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.454798 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60202863-9cfd-4693-b865-6cbf1107ea4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:38.456428 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60202863-9cfd-4693-b865-6cbf1107ea4f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:38.475853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-60202863-9cfd-4693-b865-6cbf1107ea4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:38.475853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:38.475853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:38.475853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:38.475853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:38.475853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:38.475853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:38.475853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:38.475853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:38.475853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:38.475853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:38.475853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:38.475853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:38.475853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:38.475853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:38.476994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:38.476994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:38.476994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:38.476994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:38.476994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:38.476994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:38.476994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:38.476994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:38.476994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:38.476994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:38.476994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:38.476994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:38.476994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:38.476994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:38.476994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:38.476994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:38.476994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:38.478094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:38.478094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:38.478094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:38.478094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:38.479702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 313/616] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:38.485621 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8ea82-296a-482c-b255-4b479b195802 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:38.547246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06124e0-cbb7-4fd2-bf89-b8d77d94f523 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.547246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06124e0-cbb7-4fd2-bf89-b8d77d94f523 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.547246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06124e0-cbb7-4fd2-bf89-b8d77d94f523 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.549510 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 314/617] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:37:38.557490 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d8a21-bdad-446e-b375-f544b039b619 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.557799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d8a21-bdad-446e-b375-f544b039b619 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.558056 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d8a21-bdad-446e-b375-f544b039b619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.578229 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-a93d8a21-bdad-446e-b375-f544b039b619 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:38.579452 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-a93d8a21-bdad-446e-b375-f544b039b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:38.641374 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8ea82-296a-482c-b255-4b479b195802 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:38.663552 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 315/618] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:37:38.677059 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:38.689827 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d8a21-bdad-446e-b375-f544b039b619 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:38.699221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a726c-3ff9-45c9-939d-be26921bfbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:38.699406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:38.703253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a726c-3ff9-45c9-939d-be26921bfbe5 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.703798 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a726c-3ff9-45c9-939d-be26921bfbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.704584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a726c-3ff9-45c9-939d-be26921bfbe5 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.706539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a726c-3ff9-45c9-939d-be26921bfbe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:38.707351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a726c-3ff9-45c9-939d-be26921bfbe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:38.709556 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a726c-3ff9-45c9-939d-be26921bfbe5 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:38.734042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 304/619] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:38.737919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a726c-3ff9-45c9-939d-be26921bfbe5 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:38.866253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d8a21-bdad-446e-b375-f544b039b619 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:38.885695 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a726c-3ff9-45c9-939d-be26921bfbe5 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:38.931407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec9821-0666-43f6-8e4b-fc59cc07538b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:38.933463 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec9821-0666-43f6-8e4b-fc59cc07538b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.934303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec9821-0666-43f6-8e4b-fc59cc07538b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.935855 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd69078-5cdf-4ebb-bbb4-dc8d6a135f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:38.936186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec9821-0666-43f6-8e4b-fc59cc07538b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.937221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd69078-5cdf-4ebb-bbb4-dc8d6a135f09 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.938283 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd69078-5cdf-4ebb-bbb4-dc8d6a135f09 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.938935 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd69078-5cdf-4ebb-bbb4-dc8d6a135f09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.951093 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec9821-0666-43f6-8e4b-fc59cc07538b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:38.953141 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec9821-0666-43f6-8e4b-fc59cc07538b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:38.965834 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd69078-5cdf-4ebb-bbb4-dc8d6a135f09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:38.974677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-2bd69078-5cdf-4ebb-bbb4-dc8d6a135f09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:38.974677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:38.974677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:38.974677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:38.974677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:38.974677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:38.974677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:38.974677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:38.974677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:38.974677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:38.974677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:38.974677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:38.974677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:38.974677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:38.974677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:38.974677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:38.975610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:38.975610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:38.975610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:38.975610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:38.975610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:38.975610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:38.975610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:38.975610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:38.975610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:38.975610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:38.975610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:38.975610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:38.975610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:38.975610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:38.975610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:38.975610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:38.976843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:38.976843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:38.976843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:38.976843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:38.976843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:38.976843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:38.976843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:38.976843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:38.976843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:38.976843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:38.976843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:38.976843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:38.979617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 316/620] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:38.992308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-ddec9821-0666-43f6-8e4b-fc59cc07538b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:38.992308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:38.992308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:38.992308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:38.992308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:38.992308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:38.992308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:38.992308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:38.992308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:38.992308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:38.992308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:38.992308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:38.992308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:38.992308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:38.992308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:38.993252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:38.993252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:38.993252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:38.993252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:38.993252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:38.993252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:38.993252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:38.993252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:38.993252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:38.993252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:38.993252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:38.993252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:38.993252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:38.993252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:38.993252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:38.993252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:38.993252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:38.994512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:38.994512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:38.994512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:38.994512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:38.994512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:38.994512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:38.994512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:38.994512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:38.994512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 305/621] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:38.996266 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd69078-5cdf-4ebb-bbb4-dc8d6a135f09 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:38.999162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec9821-0666-43f6-8e4b-fc59cc07538b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:39.100955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:39.135521 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:39.187318 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec9821-0666-43f6-8e4b-fc59cc07538b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:39.187582 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd69078-5cdf-4ebb-bbb4-dc8d6a135f09 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:39.232726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cb1db-970c-4806-ba2e-bc2356a61693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:39.233309 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cb1db-970c-4806-ba2e-bc2356a61693 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:39.233652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cb1db-970c-4806-ba2e-bc2356a61693 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:39.233761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82525f4-baa8-4a12-b802-c510a3631f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:39.234144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cb1db-970c-4806-ba2e-bc2356a61693 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:39.234374 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82525f4-baa8-4a12-b802-c510a3631f84 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:39.234752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82525f4-baa8-4a12-b802-c510a3631f84 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:39.235018 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27cb1db-970c-4806-ba2e-bc2356a61693 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:39.235121 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82525f4-baa8-4a12-b802-c510a3631f84 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:39.238225 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27cb1db-970c-4806-ba2e-bc2356a61693 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:39.238344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82525f4-baa8-4a12-b802-c510a3631f84 None admin] RBAC: Adding query filter params (name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:39.238344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82525f4-baa8-4a12-b802-c510a3631f84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:39.238474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27cb1db-970c-4806-ba2e-bc2356a61693 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:39.238543 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82525f4-baa8-4a12-b802-c510a3631f84 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:39.252525 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 317/622] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:39.254800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24b3a-2d78-4a9e-973c-de3f58ef1378 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:39.255089 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24b3a-2d78-4a9e-973c-de3f58ef1378 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:39.255369 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24b3a-2d78-4a9e-973c-de3f58ef1378 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:39.256963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 318/623] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:39.257654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24b3a-2d78-4a9e-973c-de3f58ef1378 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:39.259487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 306/624] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:39.265959 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47d8d2-34e4-4fec-9256-9ef78d163ee1 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:39.266515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47d8d2-34e4-4fec-9256-9ef78d163ee1 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:39.267003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47d8d2-34e4-4fec-9256-9ef78d163ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:39.288615 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-ee47d8d2-34e4-4fec-9256-9ef78d163ee1 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:39.290175 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ee47d8d2-34e4-4fec-9256-9ef78d163ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:39.380750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 307/625] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:39.381964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47d8d2-34e4-4fec-9256-9ef78d163ee1 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:39.391392 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24b3a-2d78-4a9e-973c-de3f58ef1378 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:39.421458 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:39.429227 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:39.445674 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd3678-aaed-491f-95b4-b342e7a76451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:39.447111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd3678-aaed-491f-95b4-b342e7a76451 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:39.447829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd3678-aaed-491f-95b4-b342e7a76451 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:39.448325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd3678-aaed-491f-95b4-b342e7a76451 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:39.463461 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd3678-aaed-491f-95b4-b342e7a76451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:39.467075 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd3678-aaed-491f-95b4-b342e7a76451 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:39.490764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-bebd3678-aaed-491f-95b4-b342e7a76451 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:39.490764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:39.490764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:39.490764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:39.490764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:39.490764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:39.490764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:39.490764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:39.490764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:39.490764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:39.490764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:39.490764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:39.490764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:39.490764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:39.490764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:39.491688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:39.491688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:39.491688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:39.491688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:39.491688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:39.491688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:39.491688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:39.491688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:39.491688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:39.491688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:39.491688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:39.491688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:39.491688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:39.491688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:39.491688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:39.491688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:39.491688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:39.492626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:39.492626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:39.492626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:39.492626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:39.498254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 319/626] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:39.498254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd3678-aaed-491f-95b4-b342e7a76451 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:39.505230 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47d8d2-34e4-4fec-9256-9ef78d163ee1 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:39.550610 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de847bf-d6ea-4ada-9054-28a3b0c54886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:39.552464 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de847bf-d6ea-4ada-9054-28a3b0c54886 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:39.553047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de847bf-d6ea-4ada-9054-28a3b0c54886 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:39.553478 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de847bf-d6ea-4ada-9054-28a3b0c54886 None admin] PATH_INFO: `/v3/projects/d6d43f779d67418baf199556b8e497c7/users/b45db002889846eda5b2a3e6917fcbe1/roles/06f67743387f476cade2623aa7e5c5d2` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:39.572790 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de847bf-d6ea-4ada-9054-28a3b0c54886 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6d43f779d67418baf199556b8e497c7, user_id=b45db002889846eda5b2a3e6917fcbe1, role_id=06f67743387f476cade2623aa7e5c5d2)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:39.575449 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de847bf-d6ea-4ada-9054-28a3b0c54886 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:39.600340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd3678-aaed-491f-95b4-b342e7a76451 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:39.636482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e1ad7-a09b-4065-927e-03c9c61f2601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:39.637893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e1ad7-a09b-4065-927e-03c9c61f2601 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:39.638217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e1ad7-a09b-4065-927e-03c9c61f2601 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:39.638497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e1ad7-a09b-4065-927e-03c9c61f2601 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:39.649226 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 308/627] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:37:39 2022] PUT /identity/v3/projects/d6d43f779d67418baf199556b8e497c7/users/b45db002889846eda5b2a3e6917fcbe1/roles/06f67743387f476cade2623aa7e5c5d2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:39.651185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de847bf-d6ea-4ada-9054-28a3b0c54886 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:39.656580 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e1ad7-a09b-4065-927e-03c9c61f2601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:39.665095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-929e1ad7-a09b-4065-927e-03c9c61f2601 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:39.665095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:39.665095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:39.665095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:39.665095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:39.665095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:39.665095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:39.665095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:39.665095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:39.665095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:39.665095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:39.665095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:39.665095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:39.665095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:39.665095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:39.665095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:39.666166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:39.666166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:39.666166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:39.666166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:39.666166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:39.666166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:39.666166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:39.666166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:39.666166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:39.666166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:39.666166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:39.666166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:39.666166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:39.666166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:39.666166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:39.666166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:39.667025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:39.667025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:39.667025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:39.667025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:39.667025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:39.667025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:39.667025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:39.667025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:39.667025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:39.667025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:39.667025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:39.667025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:39.667025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 320/628] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:39.672812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e1ad7-a09b-4065-927e-03c9c61f2601 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:39.737748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:39.768050 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:39.788045 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de847bf-d6ea-4ada-9054-28a3b0c54886 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:39.831349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142aef7-d1d7-4eb9-8163-88e941bd5568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:39.832071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142aef7-d1d7-4eb9-8163-88e941bd5568 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:39.832364 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142aef7-d1d7-4eb9-8163-88e941bd5568 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:39.832676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142aef7-d1d7-4eb9-8163-88e941bd5568 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:39.833433 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142aef7-d1d7-4eb9-8163-88e941bd5568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:39.834623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142aef7-d1d7-4eb9-8163-88e941bd5568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:39.836199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142aef7-d1d7-4eb9-8163-88e941bd5568 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:39.850600 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 309/629] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:39.855877 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142aef7-d1d7-4eb9-8163-88e941bd5568 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:39.860880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e1ad7-a09b-4065-927e-03c9c61f2601 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:39.901477 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a526f-bea2-4b0e-aef3-196e84f63d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:39.902579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a526f-bea2-4b0e-aef3-196e84f63d79 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:39.903090 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a526f-bea2-4b0e-aef3-196e84f63d79 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:39.903667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a526f-bea2-4b0e-aef3-196e84f63d79 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:39.904771 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a526f-bea2-4b0e-aef3-196e84f63d79 None admin] RBAC: Adding query filter params (name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:39.905284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a526f-bea2-4b0e-aef3-196e84f63d79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:39.906907 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a526f-bea2-4b0e-aef3-196e84f63d79 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:39.916839 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 321/630] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:39.922348 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a526f-bea2-4b0e-aef3-196e84f63d79 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:39.975279 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142aef7-d1d7-4eb9-8163-88e941bd5568 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:40.042592 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f4cf9-063f-43e4-9b18-9e2ac9fce613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:40.043152 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:40.043590 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f4cf9-063f-43e4-9b18-9e2ac9fce613 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.043753 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f4cf9-063f-43e4-9b18-9e2ac9fce613 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.043969 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f4cf9-063f-43e4-9b18-9e2ac9fce613 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.049446 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a526f-bea2-4b0e-aef3-196e84f63d79 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:40.056484 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f4cf9-063f-43e4-9b18-9e2ac9fce613 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:40.056484 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f4cf9-063f-43e4-9b18-9e2ac9fce613 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:40.069657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-bf5f4cf9-063f-43e4-9b18-9e2ac9fce613 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 18:37:40.069657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:40.069657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:40.069657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:40.069657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:40.069657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:40.069657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:40.069657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:40.069657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:40.069657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:40.069657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:40.069657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:40.069657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:40.069657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:40.069657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:40.069657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:40.070883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:40.070883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:40.070883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:40.070883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:40.070883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:40.070883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:40.070883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:40.070883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:40.070883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:40.070883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:40.070883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:40.070883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:40.070883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:40.070883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:40.070883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:40.070883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:40.070883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:40.070883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:40.071846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:40.071846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:40.071846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:40.071846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:40.071846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:40.071846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:40.071846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:40.071846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:40.071846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 18:37:40.071846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:40.071846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 310/631] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:40.077417 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f4cf9-063f-43e4-9b18-9e2ac9fce613 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:40.081233 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:40.097087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc791e0-d243-4958-9c28-a6689ce318cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:40.098507 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc791e0-d243-4958-9c28-a6689ce318cd None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.099008 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc791e0-d243-4958-9c28-a6689ce318cd None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.099505 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc791e0-d243-4958-9c28-a6689ce318cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.114482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc791e0-d243-4958-9c28-a6689ce318cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:40.116247 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc791e0-d243-4958-9c28-a6689ce318cd None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:40.143939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-9cc791e0-d243-4958-9c28-a6689ce318cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:40.143939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:40.143939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:40.143939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:40.143939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:40.143939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:40.143939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:40.143939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:40.143939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:40.143939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:40.143939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:40.143939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:40.143939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:40.143939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:40.143939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:40.144905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:40.144905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:40.144905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:40.144905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:40.144905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:40.144905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:40.144905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:40.144905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:40.144905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:40.144905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:40.144905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:40.144905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:40.144905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:40.144905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:40.144905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:40.144905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:40.144905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:40.145809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:40.145809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:40.145809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:40.145809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:40.148885 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 322/632] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:40.154327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc791e0-d243-4958-9c28-a6689ce318cd None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:40.246642 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f4cf9-063f-43e4-9b18-9e2ac9fce613 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:40.280175 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc791e0-d243-4958-9c28-a6689ce318cd None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:40.299399 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47060c-d19e-4bf1-9df6-eb06dc03e540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:40.300740 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47060c-d19e-4bf1-9df6-eb06dc03e540 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.301178 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47060c-d19e-4bf1-9df6-eb06dc03e540 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.301600 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47060c-d19e-4bf1-9df6-eb06dc03e540 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.302582 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47060c-d19e-4bf1-9df6-eb06dc03e540 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:40.303572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47060c-d19e-4bf1-9df6-eb06dc03e540 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:40.305452 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47060c-d19e-4bf1-9df6-eb06dc03e540 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:40.318946 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c133a75-14c3-4119-988b-73a75425e389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:40.318946 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c133a75-14c3-4119-988b-73a75425e389 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.319318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c133a75-14c3-4119-988b-73a75425e389 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.327154 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c133a75-14c3-4119-988b-73a75425e389 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.327154 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c133a75-14c3-4119-988b-73a75425e389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:40.327154 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c133a75-14c3-4119-988b-73a75425e389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:40.327154 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c133a75-14c3-4119-988b-73a75425e389 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:40.329523 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 311/633] 10.222.0.93 () {56 vars in 1137 bytes} [Thu Jun 16 18:37:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:40.331015 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a067c0-0b06-4a6a-b703-937644c623ef None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.331505 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a067c0-0b06-4a6a-b703-937644c623ef None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.331955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a067c0-0b06-4a6a-b703-937644c623ef None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.333656 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 312/634] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:40.335743 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a067c0-0b06-4a6a-b703-937644c623ef None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:40.342355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 323/635] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:40.348616 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38eb525-d56e-4c33-b7f0-e1f7d38d6656 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.349037 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38eb525-d56e-4c33-b7f0-e1f7d38d6656 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.349406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38eb525-d56e-4c33-b7f0-e1f7d38d6656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.366866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-b38eb525-d56e-4c33-b7f0-e1f7d38d6656 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:40.368536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b38eb525-d56e-4c33-b7f0-e1f7d38d6656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:40.372320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:40.417779 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:40.439974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 324/636] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:40.441199 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38eb525-d56e-4c33-b7f0-e1f7d38d6656 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:40.474716 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a067c0-0b06-4a6a-b703-937644c623ef None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:40.507901 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53357e-60bf-4adc-bfe6-a92b423a15ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:40.508614 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53357e-60bf-4adc-bfe6-a92b423a15ac None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.508897 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53357e-60bf-4adc-bfe6-a92b423a15ac None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.509183 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53357e-60bf-4adc-bfe6-a92b423a15ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.570779 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38eb525-d56e-4c33-b7f0-e1f7d38d6656 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:40.593908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53357e-60bf-4adc-bfe6-a92b423a15ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:40.595372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53357e-60bf-4adc-bfe6-a92b423a15ac None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:40.618213 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002f27e-2759-4766-968c-22d05b4dd767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:40.619028 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002f27e-2759-4766-968c-22d05b4dd767 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.619316 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002f27e-2759-4766-968c-22d05b4dd767 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.619600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002f27e-2759-4766-968c-22d05b4dd767 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.630444 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002f27e-2759-4766-968c-22d05b4dd767 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:40.632291 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002f27e-2759-4766-968c-22d05b4dd767 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:40.636232 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:40.651866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-0002f27e-2759-4766-968c-22d05b4dd767 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 18:37:40.651866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:40.651866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:40.651866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:40.651866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:40.651866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:40.651866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:40.651866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:40.651866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:40.651866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:40.651866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:40.651866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:40.651866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:40.651866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:40.651866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:40.651866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:40.654203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:40.654203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:40.654203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:40.654203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:40.654203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:40.654203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:40.654203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:40.654203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:40.654203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:40.654203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:40.654203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:40.654203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:40.654203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:40.654203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:40.654203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:40.654203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:40.654203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:40.654203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:40.655136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:40.655136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:40.655136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:40.655136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:40.655136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:40.655136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:40.655136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:40.655136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:40.655136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 18:37:40.655136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:40.655136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 325/637] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:40.655136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002f27e-2759-4766-968c-22d05b4dd767 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:40.673381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:40.719445 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 313/638] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:40.720505 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53357e-60bf-4adc-bfe6-a92b423a15ac None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:40.796809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002f27e-2759-4766-968c-22d05b4dd767 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:40.826034 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53357e-60bf-4adc-bfe6-a92b423a15ac None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:40.842140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d35b9-d9de-4335-a71b-e9e5cb5047bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:40.843157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d35b9-d9de-4335-a71b-e9e5cb5047bb None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.843452 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d35b9-d9de-4335-a71b-e9e5cb5047bb None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.843747 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d35b9-d9de-4335-a71b-e9e5cb5047bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.857452 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d35b9-d9de-4335-a71b-e9e5cb5047bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:40.860693 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743438a2-e6c7-42f5-8c5c-46981ea502ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:40.861473 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743438a2-e6c7-42f5-8c5c-46981ea502ac None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.861876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743438a2-e6c7-42f5-8c5c-46981ea502ac None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.862261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743438a2-e6c7-42f5-8c5c-46981ea502ac None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.863198 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743438a2-e6c7-42f5-8c5c-46981ea502ac None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:40.863610 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743438a2-e6c7-42f5-8c5c-46981ea502ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:40.865179 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743438a2-e6c7-42f5-8c5c-46981ea502ac None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:40.865709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-5f7d35b9-d9de-4335-a71b-e9e5cb5047bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:40.865709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:40.865709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:40.865709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:40.865709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:40.865709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:40.865709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:40.865709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:40.865709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:40.865709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:40.865709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:40.865709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:40.865709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:40.865709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:40.865709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:40.865709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:40.867128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:40.867128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:40.867128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:40.867128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:40.867128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:40.867128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:40.867128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:40.867128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:40.867128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:40.867128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:40.867128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:40.867128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:40.867128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:40.867128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:40.867128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:40.867128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:40.868816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:40.868816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:40.868816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:40.868816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:40.868816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:40.868816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:40.868816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:40.868816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:40.868816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:40.868816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:40.868816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:40.868816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:40.868816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 326/639] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:40.868816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d35b9-d9de-4335-a71b-e9e5cb5047bb None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:40.890599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 314/640] 10.222.0.93 () {56 vars in 1137 bytes} [Thu Jun 16 18:37:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:40.891625 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743438a2-e6c7-42f5-8c5c-46981ea502ac None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:40.932839 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:40.957979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:41.001109 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743438a2-e6c7-42f5-8c5c-46981ea502ac None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:41.002158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d35b9-d9de-4335-a71b-e9e5cb5047bb None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:41.036696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dd236-8403-4f88-b34d-2976ccdaf9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:41.037553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dd236-8403-4f88-b34d-2976ccdaf9fa None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.037921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dd236-8403-4f88-b34d-2976ccdaf9fa None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.038290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dd236-8403-4f88-b34d-2976ccdaf9fa None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.039227 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dd236-8403-4f88-b34d-2976ccdaf9fa None admin] RBAC: Adding query filter params (name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:41.039621 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dd236-8403-4f88-b34d-2976ccdaf9fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:41.040028 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f3f4f-fe6c-4e00-8330-32e31c3b1542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:41.040866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f3f4f-fe6c-4e00-8330-32e31c3b1542 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.041028 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dd236-8403-4f88-b34d-2976ccdaf9fa None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:41.041183 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f3f4f-fe6c-4e00-8330-32e31c3b1542 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.041449 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f3f4f-fe6c-4e00-8330-32e31c3b1542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.050131 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 315/641] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:41.050924 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dd236-8403-4f88-b34d-2976ccdaf9fa None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:41.060963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f3f4f-fe6c-4e00-8330-32e31c3b1542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:41.062873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f3f4f-fe6c-4e00-8330-32e31c3b1542 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:41.081260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-245f3f4f-fe6c-4e00-8330-32e31c3b1542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:41.081260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:41.081260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:41.081260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:41.081260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:41.081260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:41.081260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:41.081260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:41.081260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:41.081260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:41.081260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:41.081260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:41.081260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:41.081260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:41.081260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:41.082406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:41.082406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:41.082406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:41.082406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:41.082406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:41.082406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:41.082406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:41.082406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:41.082406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:41.082406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:41.082406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:41.082406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:41.082406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:41.082406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:41.082406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:41.082406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:41.082406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:41.083340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:41.083340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:41.083340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:41.083340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:41.083340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 327/642] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:41.084181 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b573704-c78b-4c2a-bd74-16d96cf8a5b0 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.084493 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b573704-c78b-4c2a-bd74-16d96cf8a5b0 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.084778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b573704-c78b-4c2a-bd74-16d96cf8a5b0 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.086179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 328/643] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:41.087102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b573704-c78b-4c2a-bd74-16d96cf8a5b0 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:41.149292 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:41.168751 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dd236-8403-4f88-b34d-2976ccdaf9fa None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:41.188695 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b573704-c78b-4c2a-bd74-16d96cf8a5b0 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:41.201557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:41.204664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dad8cb-2e9c-4efe-aff8-f8625d1d4c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:41.205480 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dad8cb-2e9c-4efe-aff8-f8625d1d4c14 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.205770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dad8cb-2e9c-4efe-aff8-f8625d1d4c14 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.206283 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dad8cb-2e9c-4efe-aff8-f8625d1d4c14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.222531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36462582-4f07-4f71-8e4a-1d07fca6df8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:41.223377 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36462582-4f07-4f71-8e4a-1d07fca6df8c None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.223663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36462582-4f07-4f71-8e4a-1d07fca6df8c None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.223936 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36462582-4f07-4f71-8e4a-1d07fca6df8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.234306 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36462582-4f07-4f71-8e4a-1d07fca6df8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:41.235764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36462582-4f07-4f71-8e4a-1d07fca6df8c None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:41.261393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-36462582-4f07-4f71-8e4a-1d07fca6df8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:41.261393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:41.261393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:41.261393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:41.261393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:41.261393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:41.261393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:41.261393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:41.261393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:41.261393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:41.261393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:41.261393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:41.261393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:41.261393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:41.261393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:41.262516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:41.262516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:41.262516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:41.262516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:41.262516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:41.262516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:41.262516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:41.262516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:41.262516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:41.262516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:41.262516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:41.262516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:41.262516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:41.262516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:41.262516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:41.262516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:41.262516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:41.263614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:41.263614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:41.263614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:41.263614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:41.269793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 329/644] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:41.269793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36462582-4f07-4f71-8e4a-1d07fca6df8c None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:41.291739 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dad8cb-2e9c-4efe-aff8-f8625d1d4c14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:41.293817 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dad8cb-2e9c-4efe-aff8-f8625d1d4c14 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:41.374593 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36462582-4f07-4f71-8e4a-1d07fca6df8c None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:41.383509 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:41.407892 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 316/645] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:41.409365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b334b-8ab9-4b45-9369-3fb358943f7a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.409661 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b334b-8ab9-4b45-9369-3fb358943f7a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.410054 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b334b-8ab9-4b45-9369-3fb358943f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.411329 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976533d6-42b7-46ba-9e24-b8142c27bf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:41.412045 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976533d6-42b7-46ba-9e24-b8142c27bf18 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.412329 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976533d6-42b7-46ba-9e24-b8142c27bf18 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.412643 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976533d6-42b7-46ba-9e24-b8142c27bf18 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.413396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976533d6-42b7-46ba-9e24-b8142c27bf18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:41.413702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976533d6-42b7-46ba-9e24-b8142c27bf18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:41.415188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976533d6-42b7-46ba-9e24-b8142c27bf18 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:41.427197 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-081b334b-8ab9-4b45-9369-3fb358943f7a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:41.432635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 330/646] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:41.432770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-081b334b-8ab9-4b45-9369-3fb358943f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:41.432864 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976533d6-42b7-46ba-9e24-b8142c27bf18 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:41.460351 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:41.499868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 317/647] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:41.505360 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b334b-8ab9-4b45-9369-3fb358943f7a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:41.544404 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976533d6-42b7-46ba-9e24-b8142c27bf18 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:41.579101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741a40d-0b24-4833-b929-8e5076abcba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:41.579763 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741a40d-0b24-4833-b929-8e5076abcba2 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.580051 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741a40d-0b24-4833-b929-8e5076abcba2 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.580326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741a40d-0b24-4833-b929-8e5076abcba2 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.581108 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741a40d-0b24-4833-b929-8e5076abcba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:41.581385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741a40d-0b24-4833-b929-8e5076abcba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:41.582762 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741a40d-0b24-4833-b929-8e5076abcba2 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:41.600099 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 331/648] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:41.600099 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741a40d-0b24-4833-b929-8e5076abcba2 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:41.617886 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b334b-8ab9-4b45-9369-3fb358943f7a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:41.632030 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:41.658671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70fbb5-9c3b-4ed1-b3c1-aa26198191ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:41.659475 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70fbb5-9c3b-4ed1-b3c1-aa26198191ba None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.659757 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70fbb5-9c3b-4ed1-b3c1-aa26198191ba None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.660039 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70fbb5-9c3b-4ed1-b3c1-aa26198191ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.670992 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70fbb5-9c3b-4ed1-b3c1-aa26198191ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:41.672829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70fbb5-9c3b-4ed1-b3c1-aa26198191ba None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:41.692934 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:41.696161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-1f70fbb5-9c3b-4ed1-b3c1-aa26198191ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:41.696161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:41.696161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:41.696161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:41.696161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:41.696161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:41.696161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:41.696161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:41.696161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:41.696161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:41.696161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:41.696161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:41.696161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:41.696161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:41.696161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:41.697263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:41.697263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:41.697263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:41.697263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:41.697263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:41.697263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:41.697263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:41.697263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:41.697263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:41.697263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:41.697263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:41.697263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:41.697263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:41.697263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:41.697263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:41.697263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:41.697263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:41.698705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:41.698705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:41.698705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:41.698705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:41.698705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 318/649] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:41.698705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70fbb5-9c3b-4ed1-b3c1-aa26198191ba None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:41.715830 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741a40d-0b24-4833-b929-8e5076abcba2 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:41.755543 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bc66f-b6c5-4b15-b1f0-454c263edd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:41.756338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bc66f-b6c5-4b15-b1f0-454c263edd93 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.756645 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bc66f-b6c5-4b15-b1f0-454c263edd93 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.756917 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bc66f-b6c5-4b15-b1f0-454c263edd93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.764296 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bc66f-b6c5-4b15-b1f0-454c263edd93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:41.765781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bc66f-b6c5-4b15-b1f0-454c263edd93 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:41.780471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-4c2bc66f-b6c5-4b15-b1f0-454c263edd93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:41.780471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:41.780471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:41.780471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:41.780471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:41.780471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:41.780471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:41.780471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:41.780471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:41.780471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:41.780471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:41.780471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:41.780471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:41.780471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:41.780471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:41.781398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:41.781398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:41.781398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:41.781398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:41.781398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:41.781398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:41.781398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:41.781398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:41.781398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:41.781398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:41.781398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:41.781398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:41.781398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:41.781398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:41.781398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:41.781398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:41.781398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:41.787686 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:41.787686 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:41.787686 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:41.787686 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:41.787686 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:41.787686 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:41.787686 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:41.787686 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:41.787686 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 332/650] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:41.787686 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bc66f-b6c5-4b15-b1f0-454c263edd93 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:41.811626 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70fbb5-9c3b-4ed1-b3c1-aa26198191ba None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:41.851980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab68791-a2e1-43ec-9e8c-6e3b37eb0ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:41.852977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab68791-a2e1-43ec-9e8c-6e3b37eb0ae1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.853277 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab68791-a2e1-43ec-9e8c-6e3b37eb0ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.853533 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab68791-a2e1-43ec-9e8c-6e3b37eb0ae1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.864920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab68791-a2e1-43ec-9e8c-6e3b37eb0ae1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:41.872465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-7ab68791-a2e1-43ec-9e8c-6e3b37eb0ae1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:41.872465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:41.872465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:41.872465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:41.872465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:41.872465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:41.872465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:41.872465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:41.872465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:41.872465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:41.872465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:41.872465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:41.872465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:41.872465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:41.872465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:41.872465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:41.873444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:41.873444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:41.873444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:41.873444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:41.873444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:41.873444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:41.873444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:41.873444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:41.873444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:41.873444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:41.873444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:41.873444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:41.873444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:41.873444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:41.873444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:41.873444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:41.874290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:41.874290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:41.874290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:41.874290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:41.874290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:41.874290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:41.874290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:41.874290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:41.874290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:41.874290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:41.874290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:41.874290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:41.874290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 319/651] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:41.874983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab68791-a2e1-43ec-9e8c-6e3b37eb0ae1 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:41.894006 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bc66f-b6c5-4b15-b1f0-454c263edd93 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:41.902595 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:41.929078 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadee7d9-1fb3-489d-bc49-5809d921cba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:41.929880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadee7d9-1fb3-489d-bc49-5809d921cba9 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.930167 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadee7d9-1fb3-489d-bc49-5809d921cba9 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.930443 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadee7d9-1fb3-489d-bc49-5809d921cba9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.938230 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadee7d9-1fb3-489d-bc49-5809d921cba9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:41.939671 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadee7d9-1fb3-489d-bc49-5809d921cba9 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:41.954663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-fadee7d9-1fb3-489d-bc49-5809d921cba9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:41.954663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:41.954663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:41.954663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:41.954663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:41.954663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:41.954663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:41.954663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:41.954663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:41.954663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:41.954663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:41.954663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:41.954663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:41.954663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:41.954663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:41.954663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:41.955618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:41.955618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:41.955618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:41.955618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:41.955618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:41.955618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:41.955618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:41.955618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:41.955618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:41.955618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:41.955618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:41.955618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:41.955618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:41.955618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:41.955618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:41.955618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:41.955618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:41.955618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:41.957000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:41.957000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:41.957000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:41.957000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:41.957000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:41.957000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:41.957000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:41.957000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:41.957000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:41.957000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:41.957000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 333/652] 10.222.0.93 () {56 vars in 1093 bytes} [Thu Jun 16 18:37:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:41.957000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadee7d9-1fb3-489d-bc49-5809d921cba9 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:41.961386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:41.988286 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab68791-a2e1-43ec-9e8c-6e3b37eb0ae1 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:42.026734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cccbb7-69dd-40d0-aea0-1ba36da87390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:42.027944 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cccbb7-69dd-40d0-aea0-1ba36da87390 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.028236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cccbb7-69dd-40d0-aea0-1ba36da87390 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.028541 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cccbb7-69dd-40d0-aea0-1ba36da87390 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.029290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cccbb7-69dd-40d0-aea0-1ba36da87390 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:42.029571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cccbb7-69dd-40d0-aea0-1ba36da87390 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:42.030932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cccbb7-69dd-40d0-aea0-1ba36da87390 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:42.046968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 320/653] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:42.046968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cccbb7-69dd-40d0-aea0-1ba36da87390 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:42.067829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadee7d9-1fb3-489d-bc49-5809d921cba9 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:42.101023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11305043-8afb-4174-bbab-d018285d1d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:42.101684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11305043-8afb-4174-bbab-d018285d1d63 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.101969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11305043-8afb-4174-bbab-d018285d1d63 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.102251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11305043-8afb-4174-bbab-d018285d1d63 None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.103036 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11305043-8afb-4174-bbab-d018285d1d63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:42.103355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11305043-8afb-4174-bbab-d018285d1d63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:42.104831 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11305043-8afb-4174-bbab-d018285d1d63 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:42.117229 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 334/654] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:42.118015 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11305043-8afb-4174-bbab-d018285d1d63 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:42.130489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:42.146143 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cccbb7-69dd-40d0-aea0-1ba36da87390 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:42.178255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d88d6-b256-4366-9edf-ad9187faec31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:42.178926 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d88d6-b256-4366-9edf-ad9187faec31 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.179030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:42.179217 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d88d6-b256-4366-9edf-ad9187faec31 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.179503 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d88d6-b256-4366-9edf-ad9187faec31 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.180255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d88d6-b256-4366-9edf-ad9187faec31 None admin] RBAC: Adding query filter params (name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:42.180587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d88d6-b256-4366-9edf-ad9187faec31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:42.181964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d88d6-b256-4366-9edf-ad9187faec31 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:42.190290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 321/655] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:42.191079 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d88d6-b256-4366-9edf-ad9187faec31 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:42.217789 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11305043-8afb-4174-bbab-d018285d1d63 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:42.251228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe6a07-63d7-49a1-aa5e-3475986d9c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:42.251908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe6a07-63d7-49a1-aa5e-3475986d9c0b None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.252195 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe6a07-63d7-49a1-aa5e-3475986d9c0b None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.252503 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe6a07-63d7-49a1-aa5e-3475986d9c0b None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.253345 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe6a07-63d7-49a1-aa5e-3475986d9c0b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:42.253661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe6a07-63d7-49a1-aa5e-3475986d9c0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:42.255101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe6a07-63d7-49a1-aa5e-3475986d9c0b None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:42.276036 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 335/656] 10.222.0.93 () {56 vars in 1133 bytes} [Thu Jun 16 18:37:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:42.277474 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea032530-5d21-442f-965a-b975ad7c34a1 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.277768 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea032530-5d21-442f-965a-b975ad7c34a1 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.278049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea032530-5d21-442f-965a-b975ad7c34a1 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.279461 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 336/657] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:42.280019 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea032530-5d21-442f-965a-b975ad7c34a1 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:42.297881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d88d6-b256-4366-9edf-ad9187faec31 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:42.331397 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66ea00-9c68-45ea-8f7f-ded224bb32c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:42.332187 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66ea00-9c68-45ea-8f7f-ded224bb32c9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.332534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66ea00-9c68-45ea-8f7f-ded224bb32c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.332793 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66ea00-9c68-45ea-8f7f-ded224bb32c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.339388 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66ea00-9c68-45ea-8f7f-ded224bb32c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:42.340866 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66ea00-9c68-45ea-8f7f-ded224bb32c9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:42.355362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-1b66ea00-9c68-45ea-8f7f-ded224bb32c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:42.355362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:42.355362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:42.355362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:42.355362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:42.355362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:42.355362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:42.355362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:42.355362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:42.355362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:42.355362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:42.355362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:42.355362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:42.355362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:42.355362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:42.356490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:42.356490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:42.356490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:42.356490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:42.356490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:42.356490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:42.356490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:42.356490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:42.356490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:42.356490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:42.356490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:42.356490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:42.356490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:42.356490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:42.356490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:42.356490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:42.356490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:42.357428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:42.357428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:42.357428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:42.357428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:42.357428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:42.357428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:42.357428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:42.357428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:42.357428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 322/658] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:42.357919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66ea00-9c68-45ea-8f7f-ded224bb32c9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:42.366071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:42.383448 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea032530-5d21-442f-965a-b975ad7c34a1 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:42.406655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:42.417890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf14578-a961-4394-b9f0-9cb0dad95044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:42.418542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf14578-a961-4394-b9f0-9cb0dad95044 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.418823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf14578-a961-4394-b9f0-9cb0dad95044 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.419097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf14578-a961-4394-b9f0-9cb0dad95044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.419923 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf14578-a961-4394-b9f0-9cb0dad95044 None admin] RBAC: Adding query filter params (role.id=06f67743387f476cade2623aa7e5c5d2, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=00c13f10b14449cea284eb629a316d83) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:42.420230 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf14578-a961-4394-b9f0-9cb0dad95044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:42.421682 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf14578-a961-4394-b9f0-9cb0dad95044 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:42.427354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 337/659] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:42 2022] GET /identity/v3/role_assignments?user.id=00c13f10b14449cea284eb629a316d83&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=06f67743387f476cade2623aa7e5c5d2 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:42.432633 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf14578-a961-4394-b9f0-9cb0dad95044 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:42.472130 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66ea00-9c68-45ea-8f7f-ded224bb32c9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:42.516787 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de643a-0d10-4c1a-842f-6d6e995ae7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:42.517738 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de643a-0d10-4c1a-842f-6d6e995ae7b6 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.518087 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de643a-0d10-4c1a-842f-6d6e995ae7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.518437 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de643a-0d10-4c1a-842f-6d6e995ae7b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.530452 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de643a-0d10-4c1a-842f-6d6e995ae7b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:42.532039 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de643a-0d10-4c1a-842f-6d6e995ae7b6 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:42.549456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf14578-a961-4394-b9f0-9cb0dad95044 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:42.552862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-75de643a-0d10-4c1a-842f-6d6e995ae7b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:42.552862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:42.552862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:42.552862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:42.552862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:42.552862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:42.552862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:42.552862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:42.552862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:42.552862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:42.552862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:42.552862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:42.552862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:42.552862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:42.552862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:42.553925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:42.553925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:42.553925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:42.553925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:42.553925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:42.553925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:42.553925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:42.553925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:42.553925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:42.553925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:42.553925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:42.553925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:42.553925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:42.553925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:42.553925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:42.553925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:42.553925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:42.555007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:42.555007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:42.555007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:42.555007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:42.556183 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 323/660] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:42.557605 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099aa2c-d6b3-4b51-8b11-052023bf37a9 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.558042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099aa2c-d6b3-4b51-8b11-052023bf37a9 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.558939 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099aa2c-d6b3-4b51-8b11-052023bf37a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.580085 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-3099aa2c-d6b3-4b51-8b11-052023bf37a9 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:42.581515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3099aa2c-d6b3-4b51-8b11-052023bf37a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:42.595913 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d37ef-073f-4d6c-a2c8-00008e4c7375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:42.596609 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d37ef-073f-4d6c-a2c8-00008e4c7375 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.597053 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d37ef-073f-4d6c-a2c8-00008e4c7375 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.597327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d37ef-073f-4d6c-a2c8-00008e4c7375 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.641431 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:42.655771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 324/661] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:42.656970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099aa2c-d6b3-4b51-8b11-052023bf37a9 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:42.664789 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:42.674813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d37ef-073f-4d6c-a2c8-00008e4c7375 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:42.676287 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d37ef-073f-4d6c-a2c8-00008e4c7375 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:42.769386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099aa2c-d6b3-4b51-8b11-052023bf37a9 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:42.786524 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 338/662] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:42.787725 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d37ef-073f-4d6c-a2c8-00008e4c7375 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:42.807745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791b648-ff7a-4ffa-91c9-e0173d05e6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:42.808501 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791b648-ff7a-4ffa-91c9-e0173d05e6e3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.808891 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791b648-ff7a-4ffa-91c9-e0173d05e6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.809175 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791b648-ff7a-4ffa-91c9-e0173d05e6e3 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.809976 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791b648-ff7a-4ffa-91c9-e0173d05e6e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:42.810290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791b648-ff7a-4ffa-91c9-e0173d05e6e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:42.811746 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791b648-ff7a-4ffa-91c9-e0173d05e6e3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:42.824771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 325/663] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:42.825567 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791b648-ff7a-4ffa-91c9-e0173d05e6e3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:42.878562 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:42.890427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:42.906581 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d37ef-073f-4d6c-a2c8-00008e4c7375 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:42.930006 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791b648-ff7a-4ffa-91c9-e0173d05e6e3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:42.945380 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a7157-e15c-4b33-a948-c38ed4db9d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:42.946057 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a7157-e15c-4b33-a948-c38ed4db9d34 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.946346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a7157-e15c-4b33-a948-c38ed4db9d34 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.946651 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a7157-e15c-4b33-a948-c38ed4db9d34 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.947349 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a7157-e15c-4b33-a948-c38ed4db9d34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:42.947660 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a7157-e15c-4b33-a948-c38ed4db9d34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:42.949205 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a7157-e15c-4b33-a948-c38ed4db9d34 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:42.961839 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 339/664] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:42.962882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a7157-e15c-4b33-a948-c38ed4db9d34 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:42.969409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562f0b2-f455-4499-98cb-69a1c4db4e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:42.970285 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562f0b2-f455-4499-98cb-69a1c4db4e1f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.970575 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562f0b2-f455-4499-98cb-69a1c4db4e1f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.970911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562f0b2-f455-4499-98cb-69a1c4db4e1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.982745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562f0b2-f455-4499-98cb-69a1c4db4e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:42.990506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-7562f0b2-f455-4499-98cb-69a1c4db4e1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:42.990506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:42.990506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:42.990506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:42.990506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:42.990506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:42.990506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:42.990506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:42.990506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:42.990506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:42.990506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:42.990506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:42.990506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:42.990506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:42.990506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:42.990506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:42.991460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:42.991460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:42.991460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:42.991460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:42.991460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:42.991460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:42.991460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:42.991460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:42.991460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:42.991460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:42.991460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:42.991460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:42.991460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:42.991460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:42.991460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:42.991460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:42.992302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:42.992302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:42.992302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:42.992302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:42.992302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:42.992302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:42.992302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:42.992302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:42.992302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:42.992302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:42.992302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:42.992302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:42.992302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 326/665] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:42.995426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562f0b2-f455-4499-98cb-69a1c4db4e1f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:43.078889 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a7157-e15c-4b33-a948-c38ed4db9d34 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:43.102032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562f0b2-f455-4499-98cb-69a1c4db4e1f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:43.111816 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:43.118324 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad2d70-ee4b-4071-9c06-1d88ecece81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:43.123893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad2d70-ee4b-4071-9c06-1d88ecece81d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:43.123893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad2d70-ee4b-4071-9c06-1d88ecece81d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:43.123893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad2d70-ee4b-4071-9c06-1d88ecece81d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:43.130366 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad2d70-ee4b-4071-9c06-1d88ecece81d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:43.131811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad2d70-ee4b-4071-9c06-1d88ecece81d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:43.138060 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a65f6-14ad-445d-9325-0f528be7dfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:43.138707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a65f6-14ad-445d-9325-0f528be7dfad None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:43.138999 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a65f6-14ad-445d-9325-0f528be7dfad None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:43.139331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a65f6-14ad-445d-9325-0f528be7dfad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:43.139873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:43.140169 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a65f6-14ad-445d-9325-0f528be7dfad None admin] RBAC: Adding query filter params (role.id=06f67743387f476cade2623aa7e5c5d2, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=3862d73c187e403fb1e1ef4e1984cee7) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:43.140924 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a65f6-14ad-445d-9325-0f528be7dfad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:43.143762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a65f6-14ad-445d-9325-0f528be7dfad None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:43.156699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 327/666] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:42 2022] GET /identity/v3/role_assignments?user.id=3862d73c187e403fb1e1ef4e1984cee7&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=06f67743387f476cade2623aa7e5c5d2 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:43.157331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-46ad2d70-ee4b-4071-9c06-1d88ecece81d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:43.157331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:43.157331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:43.157331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:43.157331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:43.157331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:43.157331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:43.157331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:43.157331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:43.157331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:43.157331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:43.157331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:43.157331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:43.157331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:43.157331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:43.158376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:43.158376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:43.158376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:43.158376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:43.158376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:43.158376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:43.158376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:43.158376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:43.158376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:43.158376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:43.158376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:43.158376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:43.158376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:43.158376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:43.158376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:43.158376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:43.158376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:43.159474 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:43.159474 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:43.159474 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:43.159474 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:43.159760 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a65f6-14ad-445d-9325-0f528be7dfad None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:43.159844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 340/667] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:43.159844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad2d70-ee4b-4071-9c06-1d88ecece81d None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:43.303288 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a65f6-14ad-445d-9325-0f528be7dfad None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:43.314690 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad2d70-ee4b-4071-9c06-1d88ecece81d None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:43.355086 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f12838-2ea4-4d9f-b7dc-637b47925a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:43.355900 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f12838-2ea4-4d9f-b7dc-637b47925a57 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:43.356188 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f12838-2ea4-4d9f-b7dc-637b47925a57 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:43.357072 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f12838-2ea4-4d9f-b7dc-637b47925a57 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:43.358148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccab2c-673b-4920-9282-592d07bc40e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:43.358449 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccab2c-673b-4920-9282-592d07bc40e6 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:43.358890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccab2c-673b-4920-9282-592d07bc40e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:43.362995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccab2c-673b-4920-9282-592d07bc40e6 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:43.362995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ccab2c-673b-4920-9282-592d07bc40e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:43.362995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ccab2c-673b-4920-9282-592d07bc40e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:43.362995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ccab2c-673b-4920-9282-592d07bc40e6 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:43.365356 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f12838-2ea4-4d9f-b7dc-637b47925a57 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:43.366802 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f12838-2ea4-4d9f-b7dc-637b47925a57 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:43.375773 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 341/668] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:43.376768 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccab2c-673b-4920-9282-592d07bc40e6 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:43.384315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-83f12838-2ea4-4d9f-b7dc-637b47925a57 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 18:37:43.384315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:43.384315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:43.384315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:43.384315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:43.384315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:43.384315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:43.384315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:43.384315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:43.384315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:43.384315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:43.384315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:43.384315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:43.384315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:43.384315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:43.384315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:43.385349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:43.385349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:43.385349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:43.385349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:43.385349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:43.385349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:43.385349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:43.385349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:43.385349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:43.385349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:43.385349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:43.385349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:43.385349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:43.385349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:43.385349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:43.385349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:43.385349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:43.385349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:43.387107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:43.387107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:43.387107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:43.387107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:43.387107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:43.387107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:43.387107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:43.387107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:43.387107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 18:37:43.387107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:43.387107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 328/669] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:43.388800 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f12838-2ea4-4d9f-b7dc-637b47925a57 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:43.436592 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:43.455739 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:43.500238 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccab2c-673b-4920-9282-592d07bc40e6 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:43.527780 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f12838-2ea4-4d9f-b7dc-637b47925a57 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:43.544710 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9261b-1d7a-4a56-a0bd-3fcbfb526d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:43.545393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9261b-1d7a-4a56-a0bd-3fcbfb526d37 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:43.545678 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9261b-1d7a-4a56-a0bd-3fcbfb526d37 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:43.545956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9261b-1d7a-4a56-a0bd-3fcbfb526d37 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:43.546953 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9261b-1d7a-4a56-a0bd-3fcbfb526d37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:43.547265 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9261b-1d7a-4a56-a0bd-3fcbfb526d37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:43.549153 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9261b-1d7a-4a56-a0bd-3fcbfb526d37 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:43.570592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 342/670] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:43.570592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9261b-1d7a-4a56-a0bd-3fcbfb526d37 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:43.571373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e6f22-89c8-4f14-8971-c1458de7f013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:43.572479 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e6f22-89c8-4f14-8971-c1458de7f013 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:43.573141 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e6f22-89c8-4f14-8971-c1458de7f013 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:43.574248 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e6f22-89c8-4f14-8971-c1458de7f013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:43.586895 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e6f22-89c8-4f14-8971-c1458de7f013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:43.588939 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e6f22-89c8-4f14-8971-c1458de7f013 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:43.608111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-837e6f22-89c8-4f14-8971-c1458de7f013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:43.608111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:43.608111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:43.608111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:43.608111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:43.608111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:43.608111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:43.608111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:43.608111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:43.608111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:43.608111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:43.608111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:43.608111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:43.608111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:43.608111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:43.609104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:43.609104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:43.609104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:43.609104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:43.609104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:43.609104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:43.609104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:43.609104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:43.609104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:43.609104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:43.609104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:43.609104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:43.609104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:43.609104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:43.609104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:43.609104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:43.609104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:43.610027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:43.610027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:43.610027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:43.610027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:43.616779 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 329/671] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:43.617861 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e6f22-89c8-4f14-8971-c1458de7f013 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:43.695567 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9261b-1d7a-4a56-a0bd-3fcbfb526d37 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:43.712054 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:43.717679 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:43.730918 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e6f22-89c8-4f14-8971-c1458de7f013 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:43.732919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60633517-8785-483e-9772-3aa06ca8fea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:43.733697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60633517-8785-483e-9772-3aa06ca8fea5 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:43.734062 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60633517-8785-483e-9772-3aa06ca8fea5 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:43.734415 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60633517-8785-483e-9772-3aa06ca8fea5 None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:43.735334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60633517-8785-483e-9772-3aa06ca8fea5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:43.735715 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60633517-8785-483e-9772-3aa06ca8fea5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:43.737266 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60633517-8785-483e-9772-3aa06ca8fea5 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:43.760301 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 343/672] 10.222.0.93 () {56 vars in 1139 bytes} [Thu Jun 16 18:37:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:43.761923 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60633517-8785-483e-9772-3aa06ca8fea5 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:43.767484 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0caa4a4-52f1-44ba-9c65-b5d854b2373a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:43.768305 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0caa4a4-52f1-44ba-9c65-b5d854b2373a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:43.768634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0caa4a4-52f1-44ba-9c65-b5d854b2373a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:43.768917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0caa4a4-52f1-44ba-9c65-b5d854b2373a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:43.777890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0caa4a4-52f1-44ba-9c65-b5d854b2373a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:43.779524 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0caa4a4-52f1-44ba-9c65-b5d854b2373a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:43.795454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-a0caa4a4-52f1-44ba-9c65-b5d854b2373a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:43.795454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:43.795454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:43.795454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:43.795454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:43.795454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:43.795454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:43.795454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:43.795454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:43.795454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:43.795454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:43.795454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:43.795454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:43.795454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:43.795454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:43.796409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:43.796409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:43.796409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:43.796409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:43.796409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:43.796409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:43.796409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:43.796409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:43.796409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:43.796409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:43.796409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:43.796409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:43.796409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:43.796409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:43.796409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:43.796409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:43.796409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:43.797342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:43.797342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:43.797342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:43.797342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:43.797342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:43.797342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:43.797342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:43.797342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:43.797342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 330/673] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:43.798381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0caa4a4-52f1-44ba-9c65-b5d854b2373a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:43.870853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60633517-8785-483e-9772-3aa06ca8fea5 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:43.906862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7c684-baa0-4010-b0ca-26ca9c84f469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:43.907542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7c684-baa0-4010-b0ca-26ca9c84f469 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:43.907832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7c684-baa0-4010-b0ca-26ca9c84f469 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:43.908115 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7c684-baa0-4010-b0ca-26ca9c84f469 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:43.908759 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0caa4a4-52f1-44ba-9c65-b5d854b2373a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:43.908938 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7c684-baa0-4010-b0ca-26ca9c84f469 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:43.909182 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7c684-baa0-4010-b0ca-26ca9c84f469 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:43.910561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7c684-baa0-4010-b0ca-26ca9c84f469 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:43.923035 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 344/674] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:43.923944 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7c684-baa0-4010-b0ca-26ca9c84f469 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:43.945653 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e0641-10b7-44ad-9650-5d930e3acd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:43.946411 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e0641-10b7-44ad-9650-5d930e3acd43 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:43.946706 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e0641-10b7-44ad-9650-5d930e3acd43 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:43.946982 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e0641-10b7-44ad-9650-5d930e3acd43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:43.964513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:43.972831 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:44.021586 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e0641-10b7-44ad-9650-5d930e3acd43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:44.023274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e0641-10b7-44ad-9650-5d930e3acd43 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:44.026028 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7c684-baa0-4010-b0ca-26ca9c84f469 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:44.061963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a306f36-bac7-4468-b7f4-2ed082e28890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:44.062563 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a306f36-bac7-4468-b7f4-2ed082e28890 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.062852 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a306f36-bac7-4468-b7f4-2ed082e28890 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.063131 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a306f36-bac7-4468-b7f4-2ed082e28890 None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.063921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a306f36-bac7-4468-b7f4-2ed082e28890 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:44.064231 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a306f36-bac7-4468-b7f4-2ed082e28890 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:44.065706 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a306f36-bac7-4468-b7f4-2ed082e28890 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:44.077876 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 345/675] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:44.078741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a306f36-bac7-4468-b7f4-2ed082e28890 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:44.131313 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 331/676] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:44.132195 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e0641-10b7-44ad-9650-5d930e3acd43 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:44.180813 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:44.184052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:44.187705 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a306f36-bac7-4468-b7f4-2ed082e28890 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:44.222404 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad68e3-6c95-4d23-a229-bde0c3287a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:44.223219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad68e3-6c95-4d23-a229-bde0c3287a81 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.223508 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad68e3-6c95-4d23-a229-bde0c3287a81 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.223788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad68e3-6c95-4d23-a229-bde0c3287a81 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.232071 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad68e3-6c95-4d23-a229-bde0c3287a81 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:44.233600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad68e3-6c95-4d23-a229-bde0c3287a81 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:44.238440 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e0641-10b7-44ad-9650-5d930e3acd43 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:44.251639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-a6ad68e3-6c95-4d23-a229-bde0c3287a81 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:44.251639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:44.251639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:44.251639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:44.251639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:44.251639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:44.251639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:44.251639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:44.251639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:44.251639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:44.251639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:44.251639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:44.251639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:44.251639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:44.251639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:44.251639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:44.252893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:44.252893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:44.252893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:44.252893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:44.252893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:44.252893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:44.252893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:44.252893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:44.252893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:44.252893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:44.252893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:44.252893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:44.252893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:44.252893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:44.252893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:44.252893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:44.252893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:44.252893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:44.254050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:44.254050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:44.254050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:44.254050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:44.254050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:44.254050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:44.254050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:44.254050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:44.254050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:44.254050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:44.256819 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 346/677] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:44.257818 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad68e3-6c95-4d23-a229-bde0c3287a81 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:44.281997 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6468e-8385-4a96-bc86-e521cb6a9539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:44.282960 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6468e-8385-4a96-bc86-e521cb6a9539 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.283386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6468e-8385-4a96-bc86-e521cb6a9539 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.283834 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6468e-8385-4a96-bc86-e521cb6a9539 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.284866 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6468e-8385-4a96-bc86-e521cb6a9539 None admin] RBAC: Adding query filter params (role.id=06f67743387f476cade2623aa7e5c5d2, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=3503ec98bea14693a17a84e686586bad) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:44.285327 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6468e-8385-4a96-bc86-e521cb6a9539 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:44.287137 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6468e-8385-4a96-bc86-e521cb6a9539 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:44.294112 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 332/678] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:44 2022] GET /identity/v3/role_assignments?user.id=3503ec98bea14693a17a84e686586bad&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=06f67743387f476cade2623aa7e5c5d2 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:44.295104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6468e-8385-4a96-bc86-e521cb6a9539 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:44.378817 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad68e3-6c95-4d23-a229-bde0c3287a81 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:44.414943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6468e-8385-4a96-bc86-e521cb6a9539 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:44.424246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97cd3a-98ae-47c7-add3-f28cd6689e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:44.425266 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97cd3a-98ae-47c7-add3-f28cd6689e44 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.425652 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97cd3a-98ae-47c7-add3-f28cd6689e44 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.426033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97cd3a-98ae-47c7-add3-f28cd6689e44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.428852 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:44.438754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97cd3a-98ae-47c7-add3-f28cd6689e44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:44.440915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97cd3a-98ae-47c7-add3-f28cd6689e44 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:44.456717 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd9820-2809-451d-8c7b-c6a8a59152eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:44.457657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd9820-2809-451d-8c7b-c6a8a59152eb None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.458094 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd9820-2809-451d-8c7b-c6a8a59152eb None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.458523 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd9820-2809-451d-8c7b-c6a8a59152eb None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.459526 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd9820-2809-451d-8c7b-c6a8a59152eb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:44.484285 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd9820-2809-451d-8c7b-c6a8a59152eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:44.484285 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd9820-2809-451d-8c7b-c6a8a59152eb None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:44.484529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-bb97cd3a-98ae-47c7-add3-f28cd6689e44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:44.484529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:44.484529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:44.484529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:44.484529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:44.484529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:44.484529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:44.484529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:44.484529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:44.484529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:44.484529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:44.484529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:44.484529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:44.484529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:44.484529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:44.485383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:44.485383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:44.485383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:44.485383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:44.485383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:44.485383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:44.485383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:44.485383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:44.485383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:44.485383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:44.485383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:44.485383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:44.485383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:44.485383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:44.485383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:44.485383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:44.485383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:44.486275 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:44.486275 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:44.486275 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:44.486275 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:44.486275 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 347/679] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:44.486275 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97cd3a-98ae-47c7-add3-f28cd6689e44 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:44.486627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 333/680] 10.222.0.93 () {56 vars in 1135 bytes} [Thu Jun 16 18:37:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:44.486698 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:44.488162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd9820-2809-451d-8c7b-c6a8a59152eb None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:44.601344 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd9820-2809-451d-8c7b-c6a8a59152eb None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:44.609179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97cd3a-98ae-47c7-add3-f28cd6689e44 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:44.644691 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d954e1-24e2-4390-863c-d1624750175c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:44.645274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d954e1-24e2-4390-863c-d1624750175c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.645561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d954e1-24e2-4390-863c-d1624750175c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.645840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d954e1-24e2-4390-863c-d1624750175c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.658732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ceb59b-2cf2-4b2b-b164-004503212517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:44.660301 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ceb59b-2cf2-4b2b-b164-004503212517 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.660765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ceb59b-2cf2-4b2b-b164-004503212517 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.661187 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ceb59b-2cf2-4b2b-b164-004503212517 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.662798 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ceb59b-2cf2-4b2b-b164-004503212517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:44.663266 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ceb59b-2cf2-4b2b-b164-004503212517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:44.665344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ceb59b-2cf2-4b2b-b164-004503212517 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:44.683334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 348/681] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:44.685704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:44.688936 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ceb59b-2cf2-4b2b-b164-004503212517 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:44.728181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d954e1-24e2-4390-863c-d1624750175c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:44.730852 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d954e1-24e2-4390-863c-d1624750175c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:44.778559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:44.831472 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ceb59b-2cf2-4b2b-b164-004503212517 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:44.873412 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc83663-0f0b-4dad-8168-c77a9acacca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:44.874198 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc83663-0f0b-4dad-8168-c77a9acacca9 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.874682 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc83663-0f0b-4dad-8168-c77a9acacca9 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.874800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc83663-0f0b-4dad-8168-c77a9acacca9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.879444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 334/682] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:44.885132 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d954e1-24e2-4390-863c-d1624750175c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:44.887101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc83663-0f0b-4dad-8168-c77a9acacca9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:44.888635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc83663-0f0b-4dad-8168-c77a9acacca9 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:44.905637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-1cc83663-0f0b-4dad-8168-c77a9acacca9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:44.905637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:44.905637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:44.905637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:44.905637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:44.905637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:44.905637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:44.905637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:44.905637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:44.905637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:44.905637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:44.905637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:44.905637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:44.905637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:44.905637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:44.906757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:44.906757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:44.906757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:44.906757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:44.906757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:44.906757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:44.906757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:44.906757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:44.906757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:44.906757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:44.906757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:44.906757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:44.906757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:44.906757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:44.906757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:44.906757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:44.906757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:44.907751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:44.907751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:44.907751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:44.907751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:44.907751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:44.907751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:44.907751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:44.907751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:44.907751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 349/683] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:44.918116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc83663-0f0b-4dad-8168-c77a9acacca9 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:44.967172 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:45.013354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d954e1-24e2-4390-863c-d1624750175c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:45.065915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55017bc5-7790-411e-bab8-36807cdd0ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:45.067058 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55017bc5-7790-411e-bab8-36807cdd0ad0 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.067349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55017bc5-7790-411e-bab8-36807cdd0ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.067732 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55017bc5-7790-411e-bab8-36807cdd0ad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.079899 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc83663-0f0b-4dad-8168-c77a9acacca9 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:45.085972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55017bc5-7790-411e-bab8-36807cdd0ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:45.087527 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55017bc5-7790-411e-bab8-36807cdd0ad0 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:45.110253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-55017bc5-7790-411e-bab8-36807cdd0ad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:45.110253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:45.110253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:45.110253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:45.110253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:45.110253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:45.110253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:45.110253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:45.110253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:45.110253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:45.110253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:45.110253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:45.110253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:45.110253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:45.110253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:45.111205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:45.111205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:45.111205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:45.111205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:45.111205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:45.111205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:45.111205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:45.111205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:45.111205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:45.111205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:45.111205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:45.111205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:45.111205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:45.111205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:45.111205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:45.111205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:45.111205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:45.112123 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:45.112123 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:45.112123 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:45.112123 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:45.116007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 335/684] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:45.116622 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:45.118252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5f952-8328-4ba9-a95d-6118f8181896 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.118504 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5f952-8328-4ba9-a95d-6118f8181896 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.118833 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5f952-8328-4ba9-a95d-6118f8181896 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.122322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 336/685] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:45.123161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5f952-8328-4ba9-a95d-6118f8181896 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:45.128885 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908e8f0-6469-4c89-b05d-0341cf4ec645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:45.128885 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908e8f0-6469-4c89-b05d-0341cf4ec645 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.128885 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908e8f0-6469-4c89-b05d-0341cf4ec645 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.128885 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908e8f0-6469-4c89-b05d-0341cf4ec645 None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.129217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908e8f0-6469-4c89-b05d-0341cf4ec645 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:45.129217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908e8f0-6469-4c89-b05d-0341cf4ec645 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:45.129217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908e8f0-6469-4c89-b05d-0341cf4ec645 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:45.143056 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 350/686] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:45.144721 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5b91a-27bd-4156-a023-de46e44a7309 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.145252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5b91a-27bd-4156-a023-de46e44a7309 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.145811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5b91a-27bd-4156-a023-de46e44a7309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.172322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-cfc5b91a-27bd-4156-a023-de46e44a7309 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:45.174369 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-cfc5b91a-27bd-4156-a023-de46e44a7309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:45.255173 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 351/687] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:45.256827 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5b91a-27bd-4156-a023-de46e44a7309 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:45.285481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5f952-8328-4ba9-a95d-6118f8181896 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:45.324874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:45.337577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825576e-4b09-47d1-863c-c2f6a83b7169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:45.339218 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825576e-4b09-47d1-863c-c2f6a83b7169 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.339510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825576e-4b09-47d1-863c-c2f6a83b7169 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.339792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825576e-4b09-47d1-863c-c2f6a83b7169 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.341075 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825576e-4b09-47d1-863c-c2f6a83b7169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:45.341395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825576e-4b09-47d1-863c-c2f6a83b7169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:45.343459 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825576e-4b09-47d1-863c-c2f6a83b7169 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:45.360587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 337/688] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:45.361899 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825576e-4b09-47d1-863c-c2f6a83b7169 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:45.400538 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5b91a-27bd-4156-a023-de46e44a7309 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:45.427525 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:45.443518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998a660-57e8-412b-834d-279fb6835696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:45.444982 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998a660-57e8-412b-834d-279fb6835696 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.445549 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998a660-57e8-412b-834d-279fb6835696 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.446023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998a660-57e8-412b-834d-279fb6835696 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.447546 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998a660-57e8-412b-834d-279fb6835696 None admin] RBAC: Adding query filter params (role.id=06f67743387f476cade2623aa7e5c5d2, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=753728a82bdb406892015f8373932ff1) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:45.448410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998a660-57e8-412b-834d-279fb6835696 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:45.450479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998a660-57e8-412b-834d-279fb6835696 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:45.459327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 352/689] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:45 2022] GET /identity/v3/role_assignments?user.id=753728a82bdb406892015f8373932ff1&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=06f67743387f476cade2623aa7e5c5d2 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:45.460608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998a660-57e8-412b-834d-279fb6835696 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:45.500720 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825576e-4b09-47d1-863c-c2f6a83b7169 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:45.562937 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602370c1-178d-4eb6-8590-0c1f027d4b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:45.564036 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602370c1-178d-4eb6-8590-0c1f027d4b7a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.564323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602370c1-178d-4eb6-8590-0c1f027d4b7a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.564896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602370c1-178d-4eb6-8590-0c1f027d4b7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.579954 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602370c1-178d-4eb6-8590-0c1f027d4b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:45.581725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602370c1-178d-4eb6-8590-0c1f027d4b7a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:45.601446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-602370c1-178d-4eb6-8590-0c1f027d4b7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:45.601446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:45.601446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:45.601446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:45.601446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:45.601446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:45.601446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:45.601446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:45.601446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:45.601446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:45.601446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:45.601446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:45.601446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:45.601446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:45.601446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:45.602663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:45.602663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:45.602663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:45.602663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:45.602663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:45.602663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:45.602663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:45.602663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:45.602663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:45.602663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:45.602663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:45.602663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:45.602663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:45.602663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:45.602663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:45.602663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:45.602663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:45.603826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:45.603826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:45.603826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:45.603826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:45.608463 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 338/690] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:45.608463 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f3db-7992-4980-8e57-7d805ec1b258 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.608463 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f3db-7992-4980-8e57-7d805ec1b258 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.608463 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f3db-7992-4980-8e57-7d805ec1b258 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.613469 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 339/691] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:45.615129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17537c1e-8c55-494c-812c-c61f4600fbae None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.615496 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17537c1e-8c55-494c-812c-c61f4600fbae None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.615847 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17537c1e-8c55-494c-812c-c61f4600fbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.621321 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998a660-57e8-412b-834d-279fb6835696 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:45.634952 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-17537c1e-8c55-494c-812c-c61f4600fbae None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:45.636612 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-17537c1e-8c55-494c-812c-c61f4600fbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:45.659333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24072b-a431-4eab-88c5-5910d7f927fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:45.660931 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24072b-a431-4eab-88c5-5910d7f927fb None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.661227 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24072b-a431-4eab-88c5-5910d7f927fb None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.661503 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24072b-a431-4eab-88c5-5910d7f927fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.665408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:45.669115 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24072b-a431-4eab-88c5-5910d7f927fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:45.670562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24072b-a431-4eab-88c5-5910d7f927fb None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:45.687878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-5a24072b-a431-4eab-88c5-5910d7f927fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:45.687878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:45.687878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:45.687878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:45.687878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:45.687878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:45.687878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:45.687878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:45.687878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:45.687878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:45.687878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:45.687878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:45.687878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:45.687878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:45.687878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:45.688892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:45.688892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:45.688892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:45.688892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:45.688892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:45.688892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:45.688892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:45.688892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:45.688892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:45.688892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:45.688892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:45.688892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:45.688892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:45.688892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:45.688892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:45.688892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:45.688892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:45.689883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:45.689883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:45.689883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:45.689883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:45.689883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:45.689883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:45.689883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:45.689883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:45.689883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 353/692] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:45.689883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24072b-a431-4eab-88c5-5910d7f927fb None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:45.726872 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 340/693] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:45.727738 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17537c1e-8c55-494c-812c-c61f4600fbae None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:45.759487 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:45.826632 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24072b-a431-4eab-88c5-5910d7f927fb None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:45.853449 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17537c1e-8c55-494c-812c-c61f4600fbae None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:45.868169 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6317d-18e8-40c8-8567-b104d91429e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:45.868881 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6317d-18e8-40c8-8567-b104d91429e4 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.869177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6317d-18e8-40c8-8567-b104d91429e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.869461 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6317d-18e8-40c8-8567-b104d91429e4 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.870587 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6317d-18e8-40c8-8567-b104d91429e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:45.870903 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6317d-18e8-40c8-8567-b104d91429e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:45.872622 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6317d-18e8-40c8-8567-b104d91429e4 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:45.894179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 354/694] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:45.894179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6317d-18e8-40c8-8567-b104d91429e4 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:45.902389 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245911a-ad25-49e7-b1a3-e76e8ba96ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:45.903074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245911a-ad25-49e7-b1a3-e76e8ba96ab1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.903362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245911a-ad25-49e7-b1a3-e76e8ba96ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.903642 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245911a-ad25-49e7-b1a3-e76e8ba96ab1 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.904483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245911a-ad25-49e7-b1a3-e76e8ba96ab1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:45.904811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245911a-ad25-49e7-b1a3-e76e8ba96ab1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:45.906322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245911a-ad25-49e7-b1a3-e76e8ba96ab1 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:45.920492 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 341/695] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:45.921825 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245911a-ad25-49e7-b1a3-e76e8ba96ab1 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:45.945330 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:46.006727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6317d-18e8-40c8-8567-b104d91429e4 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:46.009499 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:46.030427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245911a-ad25-49e7-b1a3-e76e8ba96ab1 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:46.046799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6927f00-33ef-4399-888f-362b0a9853d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:46.047722 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6927f00-33ef-4399-888f-362b0a9853d9 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:46.048083 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6927f00-33ef-4399-888f-362b0a9853d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:46.048463 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6927f00-33ef-4399-888f-362b0a9853d9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:46.049196 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6927f00-33ef-4399-888f-362b0a9853d9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:46.050872 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6927f00-33ef-4399-888f-362b0a9853d9 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:46.066410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-e6927f00-33ef-4399-888f-362b0a9853d9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 18:37:46.066410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:46.066410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:46.066410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:46.066410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:46.066410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:46.066410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:46.066410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:46.066410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 18:37:46.066410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:46.066410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:46.066410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:46.066410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:46.066410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:46.066410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:46.066410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:46.067438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:46.067438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:46.067438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:46.067438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:46.067438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:46.067438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:46.067438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:46.067438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:46.067438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:46.067438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:46.067438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:46.067438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:46.067438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:46.067438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:46.067438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:46.067438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:46.068281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:46.068281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:46.068281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:46.068281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:46.068281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:46.068281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:46.068281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:46.068281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:46.068281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:46.068281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:46.068281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:46.068281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:46.068281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:46.068281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 18:37:46.068281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:46.079336 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76fa72-8ab8-4006-83fc-b018fee037f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:46.079610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 355/696] 10.222.0.93 () {56 vars in 1129 bytes} [Thu Jun 16 18:37:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:46.079610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6927f00-33ef-4399-888f-362b0a9853d9 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:46.081520 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76fa72-8ab8-4006-83fc-b018fee037f1 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:46.082302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76fa72-8ab8-4006-83fc-b018fee037f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:46.083056 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76fa72-8ab8-4006-83fc-b018fee037f1 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:46.084705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76fa72-8ab8-4006-83fc-b018fee037f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:46.087680 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76fa72-8ab8-4006-83fc-b018fee037f1 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:46.182327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6927f00-33ef-4399-888f-362b0a9853d9 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:46.188850 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 342/697] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Jun 16 18:37:45 2022] POST /identity/v3/users => generated 254 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:46.188850 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76fa72-8ab8-4006-83fc-b018fee037f1 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:46.250525 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48250a-b479-4109-89af-8a547cb08593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:46.251208 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48250a-b479-4109-89af-8a547cb08593 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:46.252367 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48250a-b479-4109-89af-8a547cb08593 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:46.252680 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48250a-b479-4109-89af-8a547cb08593 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:46.254213 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48250a-b479-4109-89af-8a547cb08593 None admin] RBAC: Adding query filter params (role.id=06f67743387f476cade2623aa7e5c5d2, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=b45db002889846eda5b2a3e6917fcbe1) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:46.254554 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48250a-b479-4109-89af-8a547cb08593 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:46.256314 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48250a-b479-4109-89af-8a547cb08593 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:46.275209 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 356/698] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:46 2022] GET /identity/v3/role_assignments?user.id=b45db002889846eda5b2a3e6917fcbe1&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=06f67743387f476cade2623aa7e5c5d2 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:46.321024 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:46.352839 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76fa72-8ab8-4006-83fc-b018fee037f1 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:46.408997 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70feffa-140f-4870-8eb2-4c25833ae636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:46.409692 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70feffa-140f-4870-8eb2-4c25833ae636 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:46.409979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70feffa-140f-4870-8eb2-4c25833ae636 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:46.410258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70feffa-140f-4870-8eb2-4c25833ae636 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:46.410987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70feffa-140f-4870-8eb2-4c25833ae636 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:46.411297 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70feffa-140f-4870-8eb2-4c25833ae636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:46.416970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70feffa-140f-4870-8eb2-4c25833ae636 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:46.422410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 343/699] 10.222.0.93 () {56 vars in 1124 bytes} [Thu Jun 16 18:37:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:46.428507 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48250a-b479-4109-89af-8a547cb08593 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:46.470867 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:46.547859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48250a-b479-4109-89af-8a547cb08593 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:46.587600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79182540-fbfa-4b3f-9531-3d978b2e3aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:46.588310 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79182540-fbfa-4b3f-9531-3d978b2e3aef None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:46.588632 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79182540-fbfa-4b3f-9531-3d978b2e3aef None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:46.588911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79182540-fbfa-4b3f-9531-3d978b2e3aef None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:46.589689 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79182540-fbfa-4b3f-9531-3d978b2e3aef None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:46.589999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79182540-fbfa-4b3f-9531-3d978b2e3aef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:46.591692 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79182540-fbfa-4b3f-9531-3d978b2e3aef None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:46.598202 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 357/700] 10.222.0.93 () {56 vars in 1124 bytes} [Thu Jun 16 18:37:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:47.009404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fb917-b8a7-4b32-bdcc-59e83d38519b None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:47.009779 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fb917-b8a7-4b32-bdcc-59e83d38519b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:47.010069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fb917-b8a7-4b32-bdcc-59e83d38519b None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:47.011729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 344/701] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:47.017788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36313fc8-f515-4174-9bac-6e6c5b70efc8 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:47.018318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36313fc8-f515-4174-9bac-6e6c5b70efc8 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:47.018782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36313fc8-f515-4174-9bac-6e6c5b70efc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:47.044834 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-36313fc8-f515-4174-9bac-6e6c5b70efc8 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:47.046832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-36313fc8-f515-4174-9bac-6e6c5b70efc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:47.158584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 358/702] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:47.194549 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fb917-b8a7-4b32-bdcc-59e83d38519b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:47.319662 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fb917-b8a7-4b32-bdcc-59e83d38519b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:47.356551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98364a09-8431-4288-b3d8-2de4c588bc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:47.357352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98364a09-8431-4288-b3d8-2de4c588bc64 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:47.364654 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98364a09-8431-4288-b3d8-2de4c588bc64 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:47.364654 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98364a09-8431-4288-b3d8-2de4c588bc64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:47.365906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:47.372747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98364a09-8431-4288-b3d8-2de4c588bc64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:47.380444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-98364a09-8431-4288-b3d8-2de4c588bc64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:47.380444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:47.380444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:47.380444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:47.380444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:47.380444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:47.380444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:47.380444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:47.380444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:47.380444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:47.380444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:47.380444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:47.380444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:47.380444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:47.380444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:47.380444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:47.381408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:47.381408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:47.381408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:47.381408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:47.381408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:47.381408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:47.381408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:47.381408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:47.381408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:47.381408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:47.381408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:47.381408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:47.381408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:47.381408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:47.381408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:47.381408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:47.382239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:47.382239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:47.382239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:47.382239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:47.382239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:47.382239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:47.382239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:47.382239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:47.382239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:47.382239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:47.382239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:47.382239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:47.382239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 345/703] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:47.389970 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36313fc8-f515-4174-9bac-6e6c5b70efc8 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:47.449170 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:47.557243 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36313fc8-f515-4174-9bac-6e6c5b70efc8 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:47.606228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ee2cc-9193-490e-a997-408684565f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:47.606939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ee2cc-9193-490e-a997-408684565f56 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:47.607227 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ee2cc-9193-490e-a997-408684565f56 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:47.607506 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ee2cc-9193-490e-a997-408684565f56 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:47.608260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ee2cc-9193-490e-a997-408684565f56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:47.608597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ee2cc-9193-490e-a997-408684565f56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:47.609982 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ee2cc-9193-490e-a997-408684565f56 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:47.619014 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 359/704] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:47.624729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98364a09-8431-4288-b3d8-2de4c588bc64 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:47.768352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98364a09-8431-4288-b3d8-2de4c588bc64 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:47.815854 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab97406-d34e-4cc1-8faa-109715fda0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:47.817136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab97406-d34e-4cc1-8faa-109715fda0f3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:47.817617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab97406-d34e-4cc1-8faa-109715fda0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:47.818162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab97406-d34e-4cc1-8faa-109715fda0f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:47.845720 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab97406-d34e-4cc1-8faa-109715fda0f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:47.847512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab97406-d34e-4cc1-8faa-109715fda0f3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:47.871573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-8ab97406-d34e-4cc1-8faa-109715fda0f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:47.871573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:47.871573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:47.871573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:47.871573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:47.871573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:47.871573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:47.871573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:47.871573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:47.871573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:47.871573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:47.871573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:47.871573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:47.871573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:47.871573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:47.872548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:47.872548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:47.872548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:47.872548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:47.872548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:47.872548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:47.872548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:47.872548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:47.872548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:47.872548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:47.872548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:47.872548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:47.872548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:47.872548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:47.872548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:47.872548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:47.872548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:47.873450 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:47.873450 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:47.873450 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:47.873450 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:47.875357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 346/705] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:47.881452 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ee2cc-9193-490e-a997-408684565f56 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:48.020567 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:48.038340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ee2cc-9193-490e-a997-408684565f56 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:48.093306 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7266cd-753a-46df-9d5c-37ec7fcf4f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:48.094310 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7266cd-753a-46df-9d5c-37ec7fcf4f5a None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:48.094789 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7266cd-753a-46df-9d5c-37ec7fcf4f5a None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:48.095256 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7266cd-753a-46df-9d5c-37ec7fcf4f5a None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:48.096200 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7266cd-753a-46df-9d5c-37ec7fcf4f5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:48.096730 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7266cd-753a-46df-9d5c-37ec7fcf4f5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:48.098308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7266cd-753a-46df-9d5c-37ec7fcf4f5a None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:48.115674 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 360/706] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:48.121791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab97406-d34e-4cc1-8faa-109715fda0f3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:48.190366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:48.262145 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab97406-d34e-4cc1-8faa-109715fda0f3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:48.302314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72feb2-b704-4587-ac86-870582897293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:48.303471 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72feb2-b704-4587-ac86-870582897293 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:48.303966 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72feb2-b704-4587-ac86-870582897293 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:48.304460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72feb2-b704-4587-ac86-870582897293 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:48.312588 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72feb2-b704-4587-ac86-870582897293 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:48.314262 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72feb2-b704-4587-ac86-870582897293 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:48.328747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-1c72feb2-b704-4587-ac86-870582897293 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:48.328747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:48.328747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:48.328747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:48.328747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:48.328747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:48.328747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:48.328747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:48.328747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:48.328747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:48.328747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:48.328747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:48.328747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:48.328747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:48.328747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:48.328747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:48.329707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:48.329707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:48.329707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:48.329707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:48.329707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:48.329707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:48.329707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:48.329707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:48.329707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:48.329707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:48.329707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:48.329707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:48.329707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:48.329707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:48.329707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:48.329707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:48.329707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:48.329707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:48.330652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:48.330652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:48.330652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:48.330652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:48.330652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:48.330652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:48.330652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:48.330652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:48.330652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:48.330652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:48.333352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 347/707] 10.222.0.93 () {56 vars in 1093 bytes} [Thu Jun 16 18:37:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:48.341221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7266cd-753a-46df-9d5c-37ec7fcf4f5a None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:48.495031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7266cd-753a-46df-9d5c-37ec7fcf4f5a None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:48.532633 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ada1a-2528-4ad6-9a91-dc55d82861b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:48.533322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ada1a-2528-4ad6-9a91-dc55d82861b0 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:48.533609 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ada1a-2528-4ad6-9a91-dc55d82861b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:48.533880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ada1a-2528-4ad6-9a91-dc55d82861b0 None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:48.534803 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ada1a-2528-4ad6-9a91-dc55d82861b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:48.535259 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ada1a-2528-4ad6-9a91-dc55d82861b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:48.536814 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ada1a-2528-4ad6-9a91-dc55d82861b0 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:48.542889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586d1fb-6a4f-4480-a1ab-ecc2ce0fb70c None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:48.543758 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586d1fb-6a4f-4480-a1ab-ecc2ce0fb70c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:48.544251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586d1fb-6a4f-4480-a1ab-ecc2ce0fb70c None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:48.546088 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 348/708] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:48.551111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a2da8-4bca-432f-8c45-112cc5021be3 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:48.551349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a2da8-4bca-432f-8c45-112cc5021be3 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:48.551633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a2da8-4bca-432f-8c45-112cc5021be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:48.555468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 361/709] 10.222.0.93 () {56 vars in 1133 bytes} [Thu Jun 16 18:37:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:48.563030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ada1a-2528-4ad6-9a91-dc55d82861b0 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:48.571957 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:48.589482 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c50a2da8-4bca-432f-8c45-112cc5021be3 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:48.590967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c50a2da8-4bca-432f-8c45-112cc5021be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:48.676025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ada1a-2528-4ad6-9a91-dc55d82861b0 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:48.715081 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91efb63-e8a8-444a-8919-aefa0a71f6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:48.715747 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91efb63-e8a8-444a-8919-aefa0a71f6f6 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:48.716036 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91efb63-e8a8-444a-8919-aefa0a71f6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:48.716315 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91efb63-e8a8-444a-8919-aefa0a71f6f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:48.750710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 349/710] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:48.784639 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a2da8-4bca-432f-8c45-112cc5021be3 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:48.842354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91efb63-e8a8-444a-8919-aefa0a71f6f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:48.843826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91efb63-e8a8-444a-8919-aefa0a71f6f6 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:48.864457 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:48.864648 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:48.928706 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a2da8-4bca-432f-8c45-112cc5021be3 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:48.975839 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967e35b-b0b9-4d8d-b72d-626e72f81e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:48.977310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967e35b-b0b9-4d8d-b72d-626e72f81e0e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:48.977603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967e35b-b0b9-4d8d-b72d-626e72f81e0e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:48.977883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967e35b-b0b9-4d8d-b72d-626e72f81e0e None admin] PATH_INFO: `/v3/services/network` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:48.979161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967e35b-b0b9-4d8d-b72d-626e72f81e0e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:48.980946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967e35b-b0b9-4d8d-b72d-626e72f81e0e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:48.997797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-7967e35b-b0b9-4d8d-b72d-626e72f81e0e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 18:37:48.997797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:48.997797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:48.997797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:48.997797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:48.997797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:48.997797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:48.997797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:48.997797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 18:37:48.997797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:48.997797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:48.997797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:48.997797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:48.997797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:48.997797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:48.997797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:48.997797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:48.998878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:48.998878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:48.998878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:48.998878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:48.998878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:48.998878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:48.998878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:48.998878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:48.998878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:48.998878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:48.998878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:48.998878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:48.998878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:48.998878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:48.998878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:48.998878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:48.999727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:48.999727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:48.999727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:48.999727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:48.999727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:48.999727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:48.999727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:48.999727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:48.999727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:48.999727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:48.999727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:48.999727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:48.999727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 18:37:48.999727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:48.999727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 350/711] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:48 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:49.007963 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967e35b-b0b9-4d8d-b72d-626e72f81e0e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:49.041461 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 362/712] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:49.047723 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91efb63-e8a8-444a-8919-aefa0a71f6f6 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:49.157575 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91efb63-e8a8-444a-8919-aefa0a71f6f6 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:49.163767 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967e35b-b0b9-4d8d-b72d-626e72f81e0e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:49.165946 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:49.173657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:49.200125 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6eb56-5b85-4ff4-8913-97a98bf9e303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:49.201142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6eb56-5b85-4ff4-8913-97a98bf9e303 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:49.201816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6eb56-5b85-4ff4-8913-97a98bf9e303 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:49.202355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6eb56-5b85-4ff4-8913-97a98bf9e303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:49.215651 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6eb56-5b85-4ff4-8913-97a98bf9e303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:49.216348 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4097f-b2f4-46d4-8e4b-cf7c569f8973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:49.217177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4097f-b2f4-46d4-8e4b-cf7c569f8973 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:49.217685 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4097f-b2f4-46d4-8e4b-cf7c569f8973 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:49.218006 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6eb56-5b85-4ff4-8913-97a98bf9e303 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:49.218136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4097f-b2f4-46d4-8e4b-cf7c569f8973 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:49.219162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4097f-b2f4-46d4-8e4b-cf7c569f8973 None admin] RBAC: Adding query filter params (name=network) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:49.219574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4097f-b2f4-46d4-8e4b-cf7c569f8973 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:49.221983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4097f-b2f4-46d4-8e4b-cf7c569f8973 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:49.227967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 351/713] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Jun 16 18:37:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:49.230020 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285b4b6-be6c-4a4b-80ca-56b9a636de63 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:49.230420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285b4b6-be6c-4a4b-80ca-56b9a636de63 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:49.230800 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285b4b6-be6c-4a4b-80ca-56b9a636de63 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:49.232711 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 352/714] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:49.233510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285b4b6-be6c-4a4b-80ca-56b9a636de63 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:49.240390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-d2e6eb56-5b85-4ff4-8913-97a98bf9e303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:49.240390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:49.240390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:49.240390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:49.240390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:49.240390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:49.240390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:49.240390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:49.240390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:49.240390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:49.240390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:49.240390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:49.240390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:49.240390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:49.240390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:49.241528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:49.241528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:49.241528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:49.241528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:49.241528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:49.241528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:49.241528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:49.241528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:49.241528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:49.241528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:49.241528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:49.241528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:49.241528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:49.241528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:49.241528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:49.241528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:49.241528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:49.242442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:49.242442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:49.242442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:49.242442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:49.250116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 363/715] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:49.251775 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6f6a1-88a1-45a6-a064-062a43ffc905 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:49.252267 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6f6a1-88a1-45a6-a064-062a43ffc905 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:49.252777 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6f6a1-88a1-45a6-a064-062a43ffc905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:49.271867 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-eaf6f6a1-88a1-45a6-a064-062a43ffc905 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:49.273109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-eaf6f6a1-88a1-45a6-a064-062a43ffc905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:49.351242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 364/716] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:49.352479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6f6a1-88a1-45a6-a064-062a43ffc905 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:49.361458 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285b4b6-be6c-4a4b-80ca-56b9a636de63 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:49.403027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cea14-76cc-43ee-93ce-8d4b0627e72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:49.403789 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cea14-76cc-43ee-93ce-8d4b0627e72c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:49.404074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cea14-76cc-43ee-93ce-8d4b0627e72c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:49.404409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cea14-76cc-43ee-93ce-8d4b0627e72c None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:49.405140 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cea14-76cc-43ee-93ce-8d4b0627e72c None admin] RBAC: Adding query filter params (type=network) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:49.405447 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cea14-76cc-43ee-93ce-8d4b0627e72c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:49.406804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cea14-76cc-43ee-93ce-8d4b0627e72c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:49.416635 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 353/717] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Jun 16 18:37:49 2022] GET /identity/v3/services?type=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:49.418064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0c13c-ac6a-40be-9541-a923d3867273 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:49.418353 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0c13c-ac6a-40be-9541-a923d3867273 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:49.418632 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0c13c-ac6a-40be-9541-a923d3867273 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:49.424778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 354/718] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:49.425577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0c13c-ac6a-40be-9541-a923d3867273 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:49.463622 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:49.467672 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:49.478551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6f6a1-88a1-45a6-a064-062a43ffc905 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:49.516052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b7a25-a9d6-4ac7-85ff-92d224f0ac22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:49.516823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b7a25-a9d6-4ac7-85ff-92d224f0ac22 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:49.517045 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b7a25-a9d6-4ac7-85ff-92d224f0ac22 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:49.517331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b7a25-a9d6-4ac7-85ff-92d224f0ac22 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:49.518142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b7a25-a9d6-4ac7-85ff-92d224f0ac22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:49.518526 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b7a25-a9d6-4ac7-85ff-92d224f0ac22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:49.519884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b7a25-a9d6-4ac7-85ff-92d224f0ac22 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:49.536493 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 365/719] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:49.536493 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7929ab-ae15-48f6-8e5d-24da8fb27657 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:49.536493 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7929ab-ae15-48f6-8e5d-24da8fb27657 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:49.536493 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7929ab-ae15-48f6-8e5d-24da8fb27657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:49.549978 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0c13c-ac6a-40be-9541-a923d3867273 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:49.551806 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-9c7929ab-ae15-48f6-8e5d-24da8fb27657 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:49.553076 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-9c7929ab-ae15-48f6-8e5d-24da8fb27657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:49.590398 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cec5ba-501c-44b6-b9a6-bc90a75bf7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:49.591292 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cec5ba-501c-44b6-b9a6-bc90a75bf7e7 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:49.591573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cec5ba-501c-44b6-b9a6-bc90a75bf7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:49.591846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cec5ba-501c-44b6-b9a6-bc90a75bf7e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:49.605328 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cec5ba-501c-44b6-b9a6-bc90a75bf7e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:49.613139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-70cec5ba-501c-44b6-b9a6-bc90a75bf7e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:49.613139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:49.613139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:49.613139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:49.613139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:49.613139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:49.613139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:49.613139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:49.613139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:49.613139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:49.613139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:49.613139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:49.613139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:49.613139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:49.613139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:49.613139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:49.614177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:49.614177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:49.614177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:49.614177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:49.614177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:49.614177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:49.614177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:49.614177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:49.614177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:49.614177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:49.614177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:49.614177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:49.614177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:49.614177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:49.614177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:49.614177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:49.615047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:49.615047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:49.615047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:49.615047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:49.615047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:49.615047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:49.615047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:49.615047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:49.615047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:49.615047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:49.615047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:49.615047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:49.615047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 355/720] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:49.616825 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a6da2-3de2-4789-ac7a-ac7f4c0f8685 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:49.616825 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a6da2-3de2-4789-ac7a-ac7f4c0f8685 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:49.616825 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a6da2-3de2-4789-ac7a-ac7f4c0f8685 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:49.617566 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 356/721] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:49.621674 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a6da2-3de2-4789-ac7a-ac7f4c0f8685 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:49.633305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 366/722] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:49.634044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7929ab-ae15-48f6-8e5d-24da8fb27657 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:49.713997 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:49.734844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7929ab-ae15-48f6-8e5d-24da8fb27657 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:49.741203 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:49.749818 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a6da2-3de2-4789-ac7a-ac7f4c0f8685 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:49.776258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bb5bc-4bde-424a-86f6-0cb48cc5c50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:49.777038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bb5bc-4bde-424a-86f6-0cb48cc5c50c None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:49.777425 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bb5bc-4bde-424a-86f6-0cb48cc5c50c None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:49.777810 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bb5bc-4bde-424a-86f6-0cb48cc5c50c None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:49.778579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bb5bc-4bde-424a-86f6-0cb48cc5c50c None admin] RBAC: Adding query filter params (name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:49.778881 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bb5bc-4bde-424a-86f6-0cb48cc5c50c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:49.780265 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bb5bc-4bde-424a-86f6-0cb48cc5c50c None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:49.787022 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099d96a-25d1-468a-b6bb-a895069c059b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:49.788021 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099d96a-25d1-468a-b6bb-a895069c059b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:49.788308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 367/723] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:49.788658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099d96a-25d1-468a-b6bb-a895069c059b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:49.789144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099d96a-25d1-468a-b6bb-a895069c059b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:49.789552 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590e74f-d230-434d-b21d-29fee4839438 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:49.789844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590e74f-d230-434d-b21d-29fee4839438 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:49.790128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590e74f-d230-434d-b21d-29fee4839438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:49.800521 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099d96a-25d1-468a-b6bb-a895069c059b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:49.802161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099d96a-25d1-468a-b6bb-a895069c059b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:49.808158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-e590e74f-d230-434d-b21d-29fee4839438 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:49.809377 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-e590e74f-d230-434d-b21d-29fee4839438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:49.817794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-4099d96a-25d1-468a-b6bb-a895069c059b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:49.817794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:49.817794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:49.817794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:49.817794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:49.817794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:49.817794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:49.817794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:49.817794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:49.817794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:49.817794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:49.817794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:49.817794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:49.817794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:49.817794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:49.818868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:49.818868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:49.818868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:49.818868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:49.818868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:49.818868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:49.818868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:49.818868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:49.818868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:49.818868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:49.818868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:49.818868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:49.818868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:49.818868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:49.818868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:49.818868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:49.818868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:49.819964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:49.819964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:49.819964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:49.819964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:49.819964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:49.819964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:49.819964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:49.819964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:49.826751 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 357/724] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:49.827779 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099d96a-25d1-468a-b6bb-a895069c059b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:49.882190 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 368/725] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:49.883324 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590e74f-d230-434d-b21d-29fee4839438 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:49.932924 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099d96a-25d1-468a-b6bb-a895069c059b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:49.966029 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:49.966473 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25157a7-28d8-479a-bc1f-c24069dc4d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:49.967293 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25157a7-28d8-479a-bc1f-c24069dc4d33 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:49.967575 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25157a7-28d8-479a-bc1f-c24069dc4d33 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:49.967857 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25157a7-28d8-479a-bc1f-c24069dc4d33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:49.978974 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25157a7-28d8-479a-bc1f-c24069dc4d33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:49.986617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-f25157a7-28d8-479a-bc1f-c24069dc4d33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:49.986617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:49.986617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:49.986617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:49.986617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:49.986617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:49.986617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:49.986617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:49.986617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:49.986617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:49.986617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:49.986617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:49.986617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:49.986617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:49.986617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:49.986617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:49.987565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:49.987565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:49.987565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:49.987565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:49.987565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:49.987565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:49.987565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:49.987565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:49.987565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:49.987565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:49.987565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:49.987565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:49.987565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:49.987565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:49.987565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:49.987565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:49.988537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:49.988537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:49.988537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:49.988537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:49.988537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:49.988537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:49.988537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:49.988537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:49.988537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:49.988537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:49.988537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:49.988537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:49.988537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 358/726] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:49.989394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25157a7-28d8-479a-bc1f-c24069dc4d33 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:50.007024 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590e74f-d230-434d-b21d-29fee4839438 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:50.009155 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:50.042881 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61926d-5a9e-412b-9d71-6e727f779c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:50.043608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61926d-5a9e-412b-9d71-6e727f779c8c None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:50.043893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61926d-5a9e-412b-9d71-6e727f779c8c None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:50.044170 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61926d-5a9e-412b-9d71-6e727f779c8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:50.055394 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61926d-5a9e-412b-9d71-6e727f779c8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:50.057595 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61926d-5a9e-412b-9d71-6e727f779c8c None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:50.074808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-cd61926d-5a9e-412b-9d71-6e727f779c8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:50.074808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:50.074808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:50.074808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:50.074808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:50.074808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:50.074808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:50.074808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:50.074808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:50.074808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:50.074808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:50.074808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:50.074808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:50.074808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:50.074808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:50.075905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:50.075905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:50.075905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:50.075905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:50.075905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:50.075905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:50.075905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:50.075905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:50.075905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:50.075905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:50.075905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:50.075905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:50.075905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:50.075905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:50.075905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:50.075905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:50.075905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:50.076890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:50.076890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:50.076890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:50.076890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:50.076890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 369/727] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:50.076890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61926d-5a9e-412b-9d71-6e727f779c8c None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:50.105437 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25157a7-28d8-479a-bc1f-c24069dc4d33 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:50.142291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306e047-3fca-4c20-adb8-1d74f2f91608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:50.142957 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306e047-3fca-4c20-adb8-1d74f2f91608 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:50.143248 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306e047-3fca-4c20-adb8-1d74f2f91608 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:50.143582 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306e047-3fca-4c20-adb8-1d74f2f91608 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:50.144319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306e047-3fca-4c20-adb8-1d74f2f91608 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:50.144661 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306e047-3fca-4c20-adb8-1d74f2f91608 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:50.146096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306e047-3fca-4c20-adb8-1d74f2f91608 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:50.158545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 359/728] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:50.159364 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306e047-3fca-4c20-adb8-1d74f2f91608 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:50.189571 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61926d-5a9e-412b-9d71-6e727f779c8c None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:50.212355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:50.224545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40255b46-43a2-4f35-845d-4cb71efdc6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:50.225250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40255b46-43a2-4f35-845d-4cb71efdc6f3 None admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:50.225538 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40255b46-43a2-4f35-845d-4cb71efdc6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:50.227057 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40255b46-43a2-4f35-845d-4cb71efdc6f3 None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:50.227057 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40255b46-43a2-4f35-845d-4cb71efdc6f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:50.228505 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40255b46-43a2-4f35-845d-4cb71efdc6f3 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:50.242281 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:50.266843 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306e047-3fca-4c20-adb8-1d74f2f91608 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:50.299876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3d833-3ae4-4331-a9e8-77a08bee2fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:50.300499 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3d833-3ae4-4331-a9e8-77a08bee2fcc None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:50.300783 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3d833-3ae4-4331-a9e8-77a08bee2fcc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:50.301056 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3d833-3ae4-4331-a9e8-77a08bee2fcc None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:50.301851 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3d833-3ae4-4331-a9e8-77a08bee2fcc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:50.302154 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3d833-3ae4-4331-a9e8-77a08bee2fcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:50.303516 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3d833-3ae4-4331-a9e8-77a08bee2fcc None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:50.311698 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 360/729] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:50.312539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3d833-3ae4-4331-a9e8-77a08bee2fcc None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:50.328952 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 370/730] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Jun 16 18:37:50 2022] POST /identity/v3/services => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:50.329998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40255b46-43a2-4f35-845d-4cb71efdc6f3 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:50.492171 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3d833-3ae4-4331-a9e8-77a08bee2fcc None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:50.499464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40255b46-43a2-4f35-845d-4cb71efdc6f3 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:50.538655 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b366c7c-4f33-4b05-9eaa-969f498be5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:50.539487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b366c7c-4f33-4b05-9eaa-969f498be5f9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:50.539881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b366c7c-4f33-4b05-9eaa-969f498be5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:50.540264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b366c7c-4f33-4b05-9eaa-969f498be5f9 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:50.541621 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b366c7c-4f33-4b05-9eaa-969f498be5f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:50.541621 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b366c7c-4f33-4b05-9eaa-969f498be5f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:50.544472 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b366c7c-4f33-4b05-9eaa-969f498be5f9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:50.548674 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af76de-8683-446e-b141-7953db87b20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:50.549354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af76de-8683-446e-b141-7953db87b20c None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:50.549643 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af76de-8683-446e-b141-7953db87b20c None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:50.549977 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af76de-8683-446e-b141-7953db87b20c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:50.550759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af76de-8683-446e-b141-7953db87b20c None admin] RBAC: Adding query filter params (role.id=416a52031d5d49b6a3fa0e9baa814436, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=3503ec98bea14693a17a84e686586bad) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:50.551080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af76de-8683-446e-b141-7953db87b20c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:50.551355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:50.552554 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af76de-8683-446e-b141-7953db87b20c None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:50.558066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 361/731] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:50.559012 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b366c7c-4f33-4b05-9eaa-969f498be5f9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:50.559242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 371/732] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:50 2022] GET /identity/v3/role_assignments?user.id=3503ec98bea14693a17a84e686586bad&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:50.563950 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af76de-8683-446e-b141-7953db87b20c None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:50.652863 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:50.759968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b366c7c-4f33-4b05-9eaa-969f498be5f9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:50.766809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af76de-8683-446e-b141-7953db87b20c None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:50.801320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95ffea-2d87-4f07-b49d-bb923f1d8f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:50.802073 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95ffea-2d87-4f07-b49d-bb923f1d8f25 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:50.802358 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95ffea-2d87-4f07-b49d-bb923f1d8f25 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:50.802639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95ffea-2d87-4f07-b49d-bb923f1d8f25 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:50.811018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95ffea-2d87-4f07-b49d-bb923f1d8f25 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:50.812504 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95ffea-2d87-4f07-b49d-bb923f1d8f25 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:50.834648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-de95ffea-2d87-4f07-b49d-bb923f1d8f25 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:37:50.834648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:50.834648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:50.834648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:50.834648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:50.834648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:50.834648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:50.834648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:50.834648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:50.834648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:50.834648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:50.834648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:50.834648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:50.834648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:50.834648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:50.834648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:50.835801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:50.835801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:50.835801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:50.835801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:50.835801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:50.835801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:50.835801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:50.835801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:50.835801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:50.835801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:50.835801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:50.835801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:50.835801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:50.835801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:50.835801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:50.835801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:50.835801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:50.835801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:50.836974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:50.836974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:50.836974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:50.836974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:50.836974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:50.836974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:50.836974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:50.836974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:50.836974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:37:50.836974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:50.842456 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fafc5e-a07e-49cd-8021-4922a581e46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:50.843421 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fafc5e-a07e-49cd-8021-4922a581e46c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:50.848018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 372/733] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Jun 16 18:37:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:50.848557 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fafc5e-a07e-49cd-8021-4922a581e46c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:50.848986 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fafc5e-a07e-49cd-8021-4922a581e46c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:50.860519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fafc5e-a07e-49cd-8021-4922a581e46c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:50.861966 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95ffea-2d87-4f07-b49d-bb923f1d8f25 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:50.870127 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fafc5e-a07e-49cd-8021-4922a581e46c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:50.895393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-55fafc5e-a07e-49cd-8021-4922a581e46c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:50.895393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:50.895393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:50.895393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:50.895393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:50.895393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:50.895393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:50.895393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:50.895393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:50.895393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:50.895393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:50.895393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:50.895393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:50.895393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:50.895393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:50.896561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:50.896561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:50.896561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:50.896561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:50.896561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:50.896561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:50.896561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:50.896561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:50.896561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:50.896561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:50.896561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:50.896561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:50.896561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:50.896561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:50.896561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:50.896561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:50.896561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:50.897667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:50.897667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:50.897667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:50.897667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:50.898017 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 362/734] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:50.909006 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fafc5e-a07e-49cd-8021-4922a581e46c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:51.005152 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:51.053874 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95ffea-2d87-4f07-b49d-bb923f1d8f25 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:51.055416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:51.099658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fafc5e-a07e-49cd-8021-4922a581e46c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:51.125187 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e38765-cd22-4e34-a774-ae64f5b86c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:51.125877 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e38765-cd22-4e34-a774-ae64f5b86c96 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:51.126163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e38765-cd22-4e34-a774-ae64f5b86c96 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:51.126442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e38765-cd22-4e34-a774-ae64f5b86c96 None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:51.127351 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e38765-cd22-4e34-a774-ae64f5b86c96 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:51.127693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e38765-cd22-4e34-a774-ae64f5b86c96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:51.129166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e38765-cd22-4e34-a774-ae64f5b86c96 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:51.166053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f85df3-ee2b-43e5-810e-a6a863ecc681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:51.166736 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f85df3-ee2b-43e5-810e-a6a863ecc681 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:51.167019 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f85df3-ee2b-43e5-810e-a6a863ecc681 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:51.167294 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f85df3-ee2b-43e5-810e-a6a863ecc681 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:51.168192 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f85df3-ee2b-43e5-810e-a6a863ecc681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:51.168527 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f85df3-ee2b-43e5-810e-a6a863ecc681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:51.169959 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f85df3-ee2b-43e5-810e-a6a863ecc681 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:51.203281 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 363/735] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:51.208851 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f85df3-ee2b-43e5-810e-a6a863ecc681 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:51.288288 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 373/736] 10.222.0.93 () {56 vars in 1149 bytes} [Thu Jun 16 18:37:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:51.301470 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e38765-cd22-4e34-a774-ae64f5b86c96 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:51.357945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f85df3-ee2b-43e5-810e-a6a863ecc681 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:51.370809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:51.413819 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85b084-7c0b-4d78-a095-88de8bceb1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:51.415250 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85b084-7c0b-4d78-a095-88de8bceb1b2 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:51.416716 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85b084-7c0b-4d78-a095-88de8bceb1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:51.417344 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85b084-7c0b-4d78-a095-88de8bceb1b2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:51.431234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85b084-7c0b-4d78-a095-88de8bceb1b2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:51.435119 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85b084-7c0b-4d78-a095-88de8bceb1b2 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:51.454821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-9f85b084-7c0b-4d78-a095-88de8bceb1b2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:51.454821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:51.454821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:51.454821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:51.454821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:51.454821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:51.454821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:51.454821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:51.454821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:51.454821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:51.454821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:51.454821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:51.454821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:51.454821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:51.454821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:51.454821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:51.455860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:51.455860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:51.455860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:51.455860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:51.455860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:51.455860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:51.455860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:51.455860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:51.455860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:51.455860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:51.455860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:51.455860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:51.455860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:51.455860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:51.455860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:51.455860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:51.455860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:51.455860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:51.456835 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:51.456835 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:51.456835 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:51.456835 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:51.456835 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:51.456835 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:51.456835 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:51.456835 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:51.456835 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:51.456835 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:51.468822 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 364/737] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:51.474082 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85b084-7c0b-4d78-a095-88de8bceb1b2 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:51.486076 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e38765-cd22-4e34-a774-ae64f5b86c96 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:51.532630 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9039ea0-4773-49da-8a26-9d73b506aa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:51.533672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039ea0-4773-49da-8a26-9d73b506aa53 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:51.534154 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039ea0-4773-49da-8a26-9d73b506aa53 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:51.534625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039ea0-4773-49da-8a26-9d73b506aa53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:51.570811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:51.620194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9039ea0-4773-49da-8a26-9d73b506aa53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:51.622561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9039ea0-4773-49da-8a26-9d73b506aa53 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:51.689802 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85b084-7c0b-4d78-a095-88de8bceb1b2 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:51.733589 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a405c5b-a5b0-4e8c-a30b-ac67347b8ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:51.734290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a405c5b-a5b0-4e8c-a30b-ac67347b8ee6 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:51.734576 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a405c5b-a5b0-4e8c-a30b-ac67347b8ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:51.734854 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a405c5b-a5b0-4e8c-a30b-ac67347b8ee6 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:51.735715 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a405c5b-a5b0-4e8c-a30b-ac67347b8ee6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:51.736028 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a405c5b-a5b0-4e8c-a30b-ac67347b8ee6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:51.737589 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a405c5b-a5b0-4e8c-a30b-ac67347b8ee6 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:51.773667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 365/738] 10.222.0.93 () {56 vars in 1135 bytes} [Thu Jun 16 18:37:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:51.785502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a405c5b-a5b0-4e8c-a30b-ac67347b8ee6 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:51.824596 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 374/739] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:51 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:51.826178 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84f7da-0898-4374-b7ad-e5451363ac80 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:51.826523 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84f7da-0898-4374-b7ad-e5451363ac80 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:51.827111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84f7da-0898-4374-b7ad-e5451363ac80 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:51.830142 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:51.832502 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 375/740] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:51.833517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84f7da-0898-4374-b7ad-e5451363ac80 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:51.923618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:51.939772 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a405c5b-a5b0-4e8c-a30b-ac67347b8ee6 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:51.986130 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84f7da-0898-4374-b7ad-e5451363ac80 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:51.997567 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438f1f2-a5c9-45f1-a5c3-9be1cc3bef3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:51.998681 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438f1f2-a5c9-45f1-a5c3-9be1cc3bef3e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:51.999164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438f1f2-a5c9-45f1-a5c3-9be1cc3bef3e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:51.999645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438f1f2-a5c9-45f1-a5c3-9be1cc3bef3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:52.037341 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0a804-7e43-4156-be31-6621d1e86437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:52.038413 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0a804-7e43-4156-be31-6621d1e86437 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:52.038959 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0a804-7e43-4156-be31-6621d1e86437 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:52.039386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0a804-7e43-4156-be31-6621d1e86437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:52.063283 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0a804-7e43-4156-be31-6621d1e86437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:52.065465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0a804-7e43-4156-be31-6621d1e86437 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:52.088336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-7cd0a804-7e43-4156-be31-6621d1e86437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:52.088336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:52.088336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:52.088336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:52.088336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:52.088336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:52.088336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:52.088336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:52.088336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:52.088336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:52.088336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:52.088336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:52.088336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:52.088336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:52.088336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:52.089634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:52.089634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:52.089634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:52.089634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:52.089634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:52.089634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:52.089634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:52.089634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:52.089634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:52.089634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:52.089634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:52.089634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:52.089634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:52.089634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:52.089634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:52.089634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:52.089634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:52.090584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:52.090584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:52.090584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:52.090584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:52.097173 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438f1f2-a5c9-45f1-a5c3-9be1cc3bef3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:52.097173 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438f1f2-a5c9-45f1-a5c3-9be1cc3bef3e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:52.097739 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 376/741] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:52.099413 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2098-0eaf-4284-bd97-c54c6fa884f9 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:52.099910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2098-0eaf-4284-bd97-c54c6fa884f9 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:52.100404 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2098-0eaf-4284-bd97-c54c6fa884f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:52.118791 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-719b2098-0eaf-4284-bd97-c54c6fa884f9 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:52.120454 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-719b2098-0eaf-4284-bd97-c54c6fa884f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:52.127368 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:52.216115 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 377/742] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:52 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:52.216115 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b2098-0eaf-4284-bd97-c54c6fa884f9 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:52.232175 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 366/743] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:51 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:52.237231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438f1f2-a5c9-45f1-a5c3-9be1cc3bef3e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:52.272417 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:52.349149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b2098-0eaf-4284-bd97-c54c6fa884f9 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:52.359706 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438f1f2-a5c9-45f1-a5c3-9be1cc3bef3e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:52.388122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c13afe-6be0-4ac7-be6d-6e3fdaa0e092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:52.389191 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c13afe-6be0-4ac7-be6d-6e3fdaa0e092 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:52.389681 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c13afe-6be0-4ac7-be6d-6e3fdaa0e092 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:52.390161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c13afe-6be0-4ac7-be6d-6e3fdaa0e092 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:52.391089 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c13afe-6be0-4ac7-be6d-6e3fdaa0e092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:52.391628 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c13afe-6be0-4ac7-be6d-6e3fdaa0e092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:52.393242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c13afe-6be0-4ac7-be6d-6e3fdaa0e092 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:52.393582 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:52.404799 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ddee7-4d4b-417b-85b5-7c4089c65bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:52.405606 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ddee7-4d4b-417b-85b5-7c4089c65bb5 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:52.411358 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ddee7-4d4b-417b-85b5-7c4089c65bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:52.411358 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ddee7-4d4b-417b-85b5-7c4089c65bb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:52.412003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 378/744] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:52.413164 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c13afe-6be0-4ac7-be6d-6e3fdaa0e092 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:52.419094 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ddee7-4d4b-417b-85b5-7c4089c65bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:52.420646 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ddee7-4d4b-417b-85b5-7c4089c65bb5 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:52.444548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-f22ddee7-4d4b-417b-85b5-7c4089c65bb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:52.444548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:52.444548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:52.444548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:52.444548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:52.444548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:52.444548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:52.444548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:52.444548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:52.444548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:52.444548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:52.444548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:52.444548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:52.444548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:52.444548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:52.445522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:52.445522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:52.445522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:52.445522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:52.445522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:52.445522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:52.445522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:52.445522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:52.445522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:52.445522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:52.445522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:52.445522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:52.445522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:52.445522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:52.445522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:52.445522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:52.445522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:52.446474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:52.446474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:52.446474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:52.446474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:52.446474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 367/745] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:52.447185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ddee7-4d4b-417b-85b5-7c4089c65bb5 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:52.531927 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c13afe-6be0-4ac7-be6d-6e3fdaa0e092 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:52.534090 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:52.576990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d26ec0-3cd5-4fe2-86d5-4b3a99621be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:52.579582 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d26ec0-3cd5-4fe2-86d5-4b3a99621be8 None admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:52.580390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d26ec0-3cd5-4fe2-86d5-4b3a99621be8 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:52.581288 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d26ec0-3cd5-4fe2-86d5-4b3a99621be8 None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:52.581609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ddee7-4d4b-417b-85b5-7c4089c65bb5 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:52.582474 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d26ec0-3cd5-4fe2-86d5-4b3a99621be8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:52.584322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d26ec0-3cd5-4fe2-86d5-4b3a99621be8 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:52.621174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa1b60-3ca7-42bb-9d68-3c261bd9b318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:52.621981 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa1b60-3ca7-42bb-9d68-3c261bd9b318 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:52.622270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa1b60-3ca7-42bb-9d68-3c261bd9b318 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:52.622550 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa1b60-3ca7-42bb-9d68-3c261bd9b318 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:52.629838 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa1b60-3ca7-42bb-9d68-3c261bd9b318 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:52.631303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa1b60-3ca7-42bb-9d68-3c261bd9b318 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:52.645209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-cafa1b60-3ca7-42bb-9d68-3c261bd9b318 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:52.645209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:52.645209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:52.645209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:52.645209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:52.645209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:52.645209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:52.645209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:52.645209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:52.645209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:52.645209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:52.645209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:52.645209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:52.645209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:52.645209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:52.646301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:52.646301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:52.646301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:52.646301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:52.646301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:52.646301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:52.646301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:52.646301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:52.646301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:52.646301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:52.646301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:52.646301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:52.646301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:52.646301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:52.646301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:52.646301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:52.646301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:52.647274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:52.647274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:52.647274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:52.647274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:52.647274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:52.647274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:52.647274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:52.647274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:52.651196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 368/746] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:52.652408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa1b60-3ca7-42bb-9d68-3c261bd9b318 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:52.665732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 379/747] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Jun 16 18:37:52 2022] POST /identity/v3/services => generated 240 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:52.667032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d26ec0-3cd5-4fe2-86d5-4b3a99621be8 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:52.752692 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:52.852145 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa1b60-3ca7-42bb-9d68-3c261bd9b318 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:52.890178 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d26ec0-3cd5-4fe2-86d5-4b3a99621be8 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:52.910291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac9d34-00ba-45be-b23d-7477030d6064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:52.912073 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac9d34-00ba-45be-b23d-7477030d6064 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:52.912073 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac9d34-00ba-45be-b23d-7477030d6064 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:52.912073 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac9d34-00ba-45be-b23d-7477030d6064 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:52.912787 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac9d34-00ba-45be-b23d-7477030d6064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:52.913096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac9d34-00ba-45be-b23d-7477030d6064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:52.914487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac9d34-00ba-45be-b23d-7477030d6064 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:52.937508 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 369/748] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:52.938881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb09d3e-155d-473e-afb9-4f6374cb6628 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:52.939172 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb09d3e-155d-473e-afb9-4f6374cb6628 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:52.939444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb09d3e-155d-473e-afb9-4f6374cb6628 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:52.943906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 370/749] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:52.943906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb09d3e-155d-473e-afb9-4f6374cb6628 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:52.949367 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38d0cb-83a8-4300-a77a-a3a72982c48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:52.950063 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38d0cb-83a8-4300-a77a-a3a72982c48e None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:52.950350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38d0cb-83a8-4300-a77a-a3a72982c48e None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:52.950626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38d0cb-83a8-4300-a77a-a3a72982c48e None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:52.951425 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38d0cb-83a8-4300-a77a-a3a72982c48e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:52.951738 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38d0cb-83a8-4300-a77a-a3a72982c48e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:52.953396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38d0cb-83a8-4300-a77a-a3a72982c48e None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:52.967345 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 380/750] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:52.973478 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921702d-87c2-4f9e-899a-667916c6e6ea None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:52.974743 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921702d-87c2-4f9e-899a-667916c6e6ea None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:52.975057 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921702d-87c2-4f9e-899a-667916c6e6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:53.000457 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-6921702d-87c2-4f9e-899a-667916c6e6ea None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:53.002880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6921702d-87c2-4f9e-899a-667916c6e6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:53.020110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:53.063975 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:53.068733 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb09d3e-155d-473e-afb9-4f6374cb6628 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:53.106631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be342da3-1c1d-4313-ae23-000fdb6f1f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:53.107346 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be342da3-1c1d-4313-ae23-000fdb6f1f59 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:53.107630 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be342da3-1c1d-4313-ae23-000fdb6f1f59 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:53.107908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be342da3-1c1d-4313-ae23-000fdb6f1f59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:53.110195 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 381/751] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:53.111427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921702d-87c2-4f9e-899a-667916c6e6ea None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:53.120499 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be342da3-1c1d-4313-ae23-000fdb6f1f59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:53.120499 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be342da3-1c1d-4313-ae23-000fdb6f1f59 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:53.132487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-be342da3-1c1d-4313-ae23-000fdb6f1f59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:53.132487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:53.132487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:53.132487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:53.132487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:53.132487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:53.132487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:53.132487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:53.132487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:53.132487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:53.132487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:53.132487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:53.132487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:53.132487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:53.132487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:53.133448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:53.133448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:53.133448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:53.133448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:53.133448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:53.133448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:53.133448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:53.133448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:53.133448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:53.133448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:53.133448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:53.133448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:53.133448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:53.133448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:53.133448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:53.133448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:53.133448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:53.134905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:53.134905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:53.134905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:53.134905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:53.134905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:53.134905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:53.134905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:53.134905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:53.134905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 371/752] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:53.135630 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b31e4-54f4-421a-b14e-d015d0bfd3d6 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:53.135931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b31e4-54f4-421a-b14e-d015d0bfd3d6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:53.136211 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b31e4-54f4-421a-b14e-d015d0bfd3d6 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:53.141771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 372/753] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:53.141771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b31e4-54f4-421a-b14e-d015d0bfd3d6 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:53.254014 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921702d-87c2-4f9e-899a-667916c6e6ea None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:53.272865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b31e4-54f4-421a-b14e-d015d0bfd3d6 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:53.306135 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930f81f-c070-4799-a18f-87e1236bbbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:53.306800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930f81f-c070-4799-a18f-87e1236bbbe8 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:53.307086 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930f81f-c070-4799-a18f-87e1236bbbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:53.307363 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930f81f-c070-4799-a18f-87e1236bbbe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:53.308197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930f81f-c070-4799-a18f-87e1236bbbe8 None admin] RBAC: Adding query filter params (role.id=06f67743387f476cade2623aa7e5c5d2, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=1eefe0d721484433b72afca03a2c1bb6) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:53.308564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930f81f-c070-4799-a18f-87e1236bbbe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:53.309957 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac455d1-d7e4-481b-ac71-7a6f1fd0a777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:53.310207 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930f81f-c070-4799-a18f-87e1236bbbe8 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:53.310771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac455d1-d7e4-481b-ac71-7a6f1fd0a777 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:53.311055 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac455d1-d7e4-481b-ac71-7a6f1fd0a777 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:53.311329 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac455d1-d7e4-481b-ac71-7a6f1fd0a777 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:53.311994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac455d1-d7e4-481b-ac71-7a6f1fd0a777 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:53.313379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac455d1-d7e4-481b-ac71-7a6f1fd0a777 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:53.316497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 382/754] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:53 2022] GET /identity/v3/role_assignments?user.id=1eefe0d721484433b72afca03a2c1bb6&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=06f67743387f476cade2623aa7e5c5d2 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:53.320063 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930f81f-c070-4799-a18f-87e1236bbbe8 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:53.335144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:53.342987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-7ac455d1-d7e4-481b-ac71-7a6f1fd0a777 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 18:37:53.342987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:53.342987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:53.342987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:53.342987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:53.342987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:53.342987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:53.342987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:53.342987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 18:37:53.342987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:53.342987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:53.342987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:53.342987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:53.342987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:53.342987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:53.342987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:53.349658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:53.349658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:53.349658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:53.349658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:53.349658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:53.349658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:53.349658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:53.349658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:53.349658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:53.349658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:53.349658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:53.349658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:53.349658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:53.349658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:53.349658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:53.349658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:53.350510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:53.350510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:53.350510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:53.350510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:53.350510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:53.350510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:53.350510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:53.350510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:53.350510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:53.350510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:53.350510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:53.350510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:53.350510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:53.350510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 18:37:53.350510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:53.350510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 373/755] 10.222.0.93 () {56 vars in 1129 bytes} [Thu Jun 16 18:37:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:53.351415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f2eaf-0768-45ef-81f5-56f220055f66 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:53.351415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f2eaf-0768-45ef-81f5-56f220055f66 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:53.351415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f2eaf-0768-45ef-81f5-56f220055f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:53.368564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-0e3f2eaf-0768-45ef-81f5-56f220055f66 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:53.370172 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0e3f2eaf-0768-45ef-81f5-56f220055f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:53.391312 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:53.468299 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 374/756] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:53.469686 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f2eaf-0768-45ef-81f5-56f220055f66 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:53.490532 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930f81f-c070-4799-a18f-87e1236bbbe8 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:53.575400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb8aef-4739-48d4-a74c-d4e26296230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:53.576094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb8aef-4739-48d4-a74c-d4e26296230c None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:53.576373 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb8aef-4739-48d4-a74c-d4e26296230c None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:53.577432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb8aef-4739-48d4-a74c-d4e26296230c None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:53.578723 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb8aef-4739-48d4-a74c-d4e26296230c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:53.579040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb8aef-4739-48d4-a74c-d4e26296230c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:53.581117 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb8aef-4739-48d4-a74c-d4e26296230c None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:53.588722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f2eaf-0768-45ef-81f5-56f220055f66 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:53.598301 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 383/757] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:53.599158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb8aef-4739-48d4-a74c-d4e26296230c None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:53.628782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f956ea6-a109-4bd3-8c64-21a414a09b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:53.629953 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f956ea6-a109-4bd3-8c64-21a414a09b41 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:53.630480 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f956ea6-a109-4bd3-8c64-21a414a09b41 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:53.631015 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f956ea6-a109-4bd3-8c64-21a414a09b41 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:53.631933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f956ea6-a109-4bd3-8c64-21a414a09b41 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:53.632481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f956ea6-a109-4bd3-8c64-21a414a09b41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:53.634758 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f956ea6-a109-4bd3-8c64-21a414a09b41 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:53.640649 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 375/758] 10.222.0.93 () {56 vars in 1124 bytes} [Thu Jun 16 18:37:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:53.641914 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f956ea6-a109-4bd3-8c64-21a414a09b41 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:53.661694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:53.685813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:53.725992 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb8aef-4739-48d4-a74c-d4e26296230c None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:53.760711 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f956ea6-a109-4bd3-8c64-21a414a09b41 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:53.769933 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab218c4-a8f8-47bd-a6a1-94aa62711550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:53.771067 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab218c4-a8f8-47bd-a6a1-94aa62711550 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:53.771563 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab218c4-a8f8-47bd-a6a1-94aa62711550 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:53.772118 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab218c4-a8f8-47bd-a6a1-94aa62711550 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:53.783794 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab218c4-a8f8-47bd-a6a1-94aa62711550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:53.791989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-0ab218c4-a8f8-47bd-a6a1-94aa62711550 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:53.791989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:53.791989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:53.791989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:53.791989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:53.791989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:53.791989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:53.791989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:53.791989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:53.791989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:53.791989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:53.791989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:53.791989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:53.791989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:53.791989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:53.791989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:53.792967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:53.792967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:53.792967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:53.792967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:53.792967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:53.792967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:53.792967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:53.792967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:53.792967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:53.792967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:53.792967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:53.792967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:53.792967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:53.792967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:53.792967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:53.792967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:53.793811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:53.793811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:53.793811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:53.793811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:53.793811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:53.793811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:53.793811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:53.793811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:53.793811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:53.793811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:53.793811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:53.793811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:53.796531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 384/759] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:53.797657 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab218c4-a8f8-47bd-a6a1-94aa62711550 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:53.798752 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1adfc9-adbd-4a49-8168-9d4e60b8d0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:53.799417 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1adfc9-adbd-4a49-8168-9d4e60b8d0c7 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:53.799698 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1adfc9-adbd-4a49-8168-9d4e60b8d0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:53.799974 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1adfc9-adbd-4a49-8168-9d4e60b8d0c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:53.800837 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1adfc9-adbd-4a49-8168-9d4e60b8d0c7 None admin] RBAC: Adding query filter params (role.id=416a52031d5d49b6a3fa0e9baa814436, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=b45db002889846eda5b2a3e6917fcbe1) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:53.801150 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1adfc9-adbd-4a49-8168-9d4e60b8d0c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:53.802595 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1adfc9-adbd-4a49-8168-9d4e60b8d0c7 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:53.813850 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 376/760] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:53 2022] GET /identity/v3/role_assignments?user.id=b45db002889846eda5b2a3e6917fcbe1&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:53.815069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1adfc9-adbd-4a49-8168-9d4e60b8d0c7 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:53.918345 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab218c4-a8f8-47bd-a6a1-94aa62711550 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:53.922811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:53.950646 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1adfc9-adbd-4a49-8168-9d4e60b8d0c7 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:53.952986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:53.958783 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c1ee6-0cfd-42b4-be15-175cbc832881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:53.959840 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c1ee6-0cfd-42b4-be15-175cbc832881 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:53.960361 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c1ee6-0cfd-42b4-be15-175cbc832881 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:53.960871 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c1ee6-0cfd-42b4-be15-175cbc832881 None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:53.962516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c1ee6-0cfd-42b4-be15-175cbc832881 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:53.963048 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c1ee6-0cfd-42b4-be15-175cbc832881 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:53.964976 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c1ee6-0cfd-42b4-be15-175cbc832881 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:53.971232 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 385/761] 10.222.0.93 () {56 vars in 1124 bytes} [Thu Jun 16 18:37:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:53.977297 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c1ee6-0cfd-42b4-be15-175cbc832881 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:54.010319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ca5fe-865b-4419-afdd-0500901b2a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:54.011569 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ca5fe-865b-4419-afdd-0500901b2a00 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:54.013541 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ca5fe-865b-4419-afdd-0500901b2a00 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:54.014113 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ca5fe-865b-4419-afdd-0500901b2a00 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:54.016105 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ca5fe-865b-4419-afdd-0500901b2a00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:54.016721 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ca5fe-865b-4419-afdd-0500901b2a00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:54.021386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ca5fe-865b-4419-afdd-0500901b2a00 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:54.040410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 377/762] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:54.044720 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ca5fe-865b-4419-afdd-0500901b2a00 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:54.132589 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c1ee6-0cfd-42b4-be15-175cbc832881 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:54.195315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ca5fe-865b-4419-afdd-0500901b2a00 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:54.218481 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c2f45-14e7-451c-8b49-d518067e7a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:54.219574 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c2f45-14e7-451c-8b49-d518067e7a8d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:54.220069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c2f45-14e7-451c-8b49-d518067e7a8d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:54.220583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c2f45-14e7-451c-8b49-d518067e7a8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:54.221800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c2f45-14e7-451c-8b49-d518067e7a8d None admin] RBAC: Adding query filter params (interface=public, service_id=a0ee4b9d075e4ac1a069361793d8571a, region_id=RegionOne) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:54.222328 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c2f45-14e7-451c-8b49-d518067e7a8d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:54.223940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c2f45-14e7-451c-8b49-d518067e7a8d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:54.232822 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b1a6b-0565-48cf-8702-5e5f0c62d397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:54.233627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b1a6b-0565-48cf-8702-5e5f0c62d397 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:54.233916 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b1a6b-0565-48cf-8702-5e5f0c62d397 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:54.234198 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b1a6b-0565-48cf-8702-5e5f0c62d397 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:54.243987 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 386/763] 10.222.0.93 () {56 vars in 1251 bytes} [Thu Jun 16 18:37:53 2022] GET /identity/v3/endpoints?service_id=a0ee4b9d075e4ac1a069361793d8571a&interface=public®ion_id=RegionOne => generated 194 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:54.249164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b1a6b-0565-48cf-8702-5e5f0c62d397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:54.250127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c2f45-14e7-451c-8b49-d518067e7a8d None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:54.250629 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b1a6b-0565-48cf-8702-5e5f0c62d397 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:54.252597 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:54.275820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-804b1a6b-0565-48cf-8702-5e5f0c62d397 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:54.275820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:54.275820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:54.275820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:54.275820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:54.275820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:54.275820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:54.275820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:54.275820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:54.275820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:54.275820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:54.275820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:54.275820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:54.275820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:54.275820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:54.276784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:54.276784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:54.276784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:54.276784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:54.276784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:54.276784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:54.276784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:54.276784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:54.276784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:54.276784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:54.276784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:54.276784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:54.276784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:54.276784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:54.276784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:54.276784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:54.276784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:54.277723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:54.277723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:54.277723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:54.277723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:54.279833 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 378/764] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:54.285318 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b1a6b-0565-48cf-8702-5e5f0c62d397 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:54.392624 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b1a6b-0565-48cf-8702-5e5f0c62d397 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:54.396831 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:54.428515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bad15e-9cfb-43a0-8b00-9237cbabbdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:54.429518 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bad15e-9cfb-43a0-8b00-9237cbabbdd9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:54.429987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bad15e-9cfb-43a0-8b00-9237cbabbdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:54.430494 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bad15e-9cfb-43a0-8b00-9237cbabbdd9 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:54.431402 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bad15e-9cfb-43a0-8b00-9237cbabbdd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:54.431893 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bad15e-9cfb-43a0-8b00-9237cbabbdd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:54.433476 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bad15e-9cfb-43a0-8b00-9237cbabbdd9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:54.447075 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 379/765] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:54.452808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bad15e-9cfb-43a0-8b00-9237cbabbdd9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:54.472559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c2f45-14e7-451c-8b49-d518067e7a8d None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:54.516813 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:54.542040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211a55d-d1fa-4b20-8d47-d0d41e6babf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:54.542844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211a55d-d1fa-4b20-8d47-d0d41e6babf4 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:54.543208 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211a55d-d1fa-4b20-8d47-d0d41e6babf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:54.543560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211a55d-d1fa-4b20-8d47-d0d41e6babf4 None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:54.544478 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211a55d-d1fa-4b20-8d47-d0d41e6babf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:54.545953 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211a55d-d1fa-4b20-8d47-d0d41e6babf4 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:54.562390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 387/766] 10.222.0.93 () {56 vars in 1087 bytes} [Thu Jun 16 18:37:54 2022] GET /identity/v3/services => generated 772 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:54.569451 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bad15e-9cfb-43a0-8b00-9237cbabbdd9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:54.613024 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f49305-528a-4c13-8587-5973748cba67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:54.613853 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f49305-528a-4c13-8587-5973748cba67 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:54.614139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f49305-528a-4c13-8587-5973748cba67 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:54.614415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f49305-528a-4c13-8587-5973748cba67 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:54.623308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f49305-528a-4c13-8587-5973748cba67 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:54.624814 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f49305-528a-4c13-8587-5973748cba67 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:54.640352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-39f49305-528a-4c13-8587-5973748cba67 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:54.640352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:54.640352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:54.640352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:54.640352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:54.640352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:54.640352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:54.640352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:54.640352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:54.640352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:54.640352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:54.640352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:54.640352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:54.640352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:54.640352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:54.640352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:54.641405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:54.641405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:54.641405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:54.641405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:54.641405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:54.641405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:54.641405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:54.641405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:54.641405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:54.641405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:54.641405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:54.641405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:54.641405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:54.641405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:54.641405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:54.641405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:54.641405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:54.641405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:54.642372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:54.642372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:54.642372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:54.642372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:54.642372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:54.642372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:54.642372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:54.642372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:54.642372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:54.642372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:54.642372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 380/767] 10.222.0.93 () {56 vars in 1093 bytes} [Thu Jun 16 18:37:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:54.647517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211a55d-d1fa-4b20-8d47-d0d41e6babf4 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:54.761622 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211a55d-d1fa-4b20-8d47-d0d41e6babf4 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:54.788021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:54.799916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f9dff-081b-48e5-9635-1d1995cb8a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:54.800641 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f9dff-081b-48e5-9635-1d1995cb8a07 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:54.800933 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f9dff-081b-48e5-9635-1d1995cb8a07 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:54.806665 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f9dff-081b-48e5-9635-1d1995cb8a07 None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:54.806665 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f9dff-081b-48e5-9635-1d1995cb8a07 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:54.806665 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f9dff-081b-48e5-9635-1d1995cb8a07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:54.806665 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f9dff-081b-48e5-9635-1d1995cb8a07 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:54.823999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 388/768] 10.222.0.93 () {56 vars in 1133 bytes} [Thu Jun 16 18:37:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:54.829651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f49305-528a-4c13-8587-5973748cba67 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:54.935383 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f49305-528a-4c13-8587-5973748cba67 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:54.950008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:54.970826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151def3b-be77-4a1e-bf79-6a72ca169a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:54.971683 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151def3b-be77-4a1e-bf79-6a72ca169a2f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:54.971970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151def3b-be77-4a1e-bf79-6a72ca169a2f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:54.972300 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151def3b-be77-4a1e-bf79-6a72ca169a2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:54.985169 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151def3b-be77-4a1e-bf79-6a72ca169a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:54.986687 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151def3b-be77-4a1e-bf79-6a72ca169a2f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:55.004386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-151def3b-be77-4a1e-bf79-6a72ca169a2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:55.004386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:55.004386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:55.004386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:55.004386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:55.004386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:55.004386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:55.004386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:55.004386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:55.004386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:55.004386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:55.004386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:55.004386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:55.004386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:55.004386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:55.005311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:55.005311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:55.005311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:55.005311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:55.005311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:55.005311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:55.005311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:55.005311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:55.005311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:55.005311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:55.005311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:55.005311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:55.005311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:55.005311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:55.005311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:55.005311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:55.005311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:55.006200 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:55.006200 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:55.006200 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:55.006200 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:55.006200 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 381/769] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:55.012398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f9dff-081b-48e5-9635-1d1995cb8a07 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:55.169557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f9dff-081b-48e5-9635-1d1995cb8a07 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:55.229171 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fdae1-c502-4461-bfe3-d4a93d4ecc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:55.229854 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fdae1-c502-4461-bfe3-d4a93d4ecc4d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:55.230139 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fdae1-c502-4461-bfe3-d4a93d4ecc4d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:55.230414 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fdae1-c502-4461-bfe3-d4a93d4ecc4d None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:55.231140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fdae1-c502-4461-bfe3-d4a93d4ecc4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:55.231446 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fdae1-c502-4461-bfe3-d4a93d4ecc4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:55.232840 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fdae1-c502-4461-bfe3-d4a93d4ecc4d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:55.238905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f26a31-5730-49aa-827f-7025d168ea9e None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:55.238905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f26a31-5730-49aa-827f-7025d168ea9e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:55.238905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f26a31-5730-49aa-827f-7025d168ea9e None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:55.239527 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 382/770] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:37:55.244530 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877713b0-d8ad-487b-9b40-16d967b444d4 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:55.244830 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877713b0-d8ad-487b-9b40-16d967b444d4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:55.245114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877713b0-d8ad-487b-9b40-16d967b444d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:55.251694 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 389/771] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:55.257002 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fdae1-c502-4461-bfe3-d4a93d4ecc4d None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:55.272966 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-877713b0-d8ad-487b-9b40-16d967b444d4 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:55.275023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-877713b0-d8ad-487b-9b40-16d967b444d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:55.352185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:55.359634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 383/772] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:55.382174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877713b0-d8ad-487b-9b40-16d967b444d4 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:55.449616 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fdae1-c502-4461-bfe3-d4a93d4ecc4d None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:55.503754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd486e-41ef-4681-84e8-58c1de5dc71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:55.504613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd486e-41ef-4681-84e8-58c1de5dc71a None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:55.504900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd486e-41ef-4681-84e8-58c1de5dc71a None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:55.505176 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd486e-41ef-4681-84e8-58c1de5dc71a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:55.517325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd486e-41ef-4681-84e8-58c1de5dc71a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:55.518848 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd486e-41ef-4681-84e8-58c1de5dc71a None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:55.542998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-badd486e-41ef-4681-84e8-58c1de5dc71a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:55.542998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:55.542998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:55.542998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:55.542998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:55.542998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:55.542998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:55.542998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:55.542998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:55.542998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:55.542998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:55.542998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:55.542998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:55.542998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:55.542998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:55.543983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:55.543983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:55.543983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:55.543983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:55.543983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:55.543983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:55.543983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:55.543983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:55.543983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:55.543983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:55.543983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:55.543983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:55.543983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:55.543983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:55.543983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:55.543983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:55.543983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:55.544908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:55.544908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:55.544908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:55.544908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:55.544908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:55.544908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:55.544908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:55.544908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:55.556014 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 390/773] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:55.556936 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd486e-41ef-4681-84e8-58c1de5dc71a None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:55.589459 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:55.598560 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877713b0-d8ad-487b-9b40-16d967b444d4 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:55.652246 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de9fca-1c80-44ab-8840-8e43ac9e971e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:55.653097 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de9fca-1c80-44ab-8840-8e43ac9e971e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:55.653382 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de9fca-1c80-44ab-8840-8e43ac9e971e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:55.653885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de9fca-1c80-44ab-8840-8e43ac9e971e None admin] PATH_INFO: `/v3/services/network` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:55.654327 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de9fca-1c80-44ab-8840-8e43ac9e971e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:55.655790 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de9fca-1c80-44ab-8840-8e43ac9e971e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:55.682068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-42de9fca-1c80-44ab-8840-8e43ac9e971e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 18:37:55.682068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:55.682068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:55.682068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:55.682068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:55.682068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:55.682068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:55.682068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:55.682068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 18:37:55.682068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:55.682068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:55.682068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:55.682068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:55.682068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:55.682068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:55.682068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:55.682068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:55.683340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:55.683340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:55.683340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:55.683340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:55.683340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:55.683340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:55.683340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:55.683340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:55.683340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:55.683340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:55.683340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:55.683340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:55.683340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:55.683340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:55.683340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:55.683340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:55.689331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:55.689331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:55.689331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:55.689331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:55.689331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:55.689331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:55.689331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:55.689331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:55.689331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:55.689331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:55.689331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:55.689331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:55.689331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 18:37:55.689331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:55.689331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 384/774] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:55 2022] GET /identity/v3/services/network => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:55.705522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de9fca-1c80-44ab-8840-8e43ac9e971e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:55.721880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd486e-41ef-4681-84e8-58c1de5dc71a None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:55.723965 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:55.768705 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3993cd7-42d4-4c86-bf8f-540e04b8a5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:55.771935 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3993cd7-42d4-4c86-bf8f-540e04b8a5b4 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:55.772229 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3993cd7-42d4-4c86-bf8f-540e04b8a5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:55.772536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3993cd7-42d4-4c86-bf8f-540e04b8a5b4 None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:55.773652 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3993cd7-42d4-4c86-bf8f-540e04b8a5b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:55.774023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3993cd7-42d4-4c86-bf8f-540e04b8a5b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:55.776499 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3993cd7-42d4-4c86-bf8f-540e04b8a5b4 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:55.794623 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 391/775] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:55.800774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a5b7c-b4d9-41cb-8608-2680c7eb729c None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:55.801066 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a5b7c-b4d9-41cb-8608-2680c7eb729c None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:55.801411 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a5b7c-b4d9-41cb-8608-2680c7eb729c None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:55.807083 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 392/776] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:55.807083 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a5b7c-b4d9-41cb-8608-2680c7eb729c None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:55.848202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de9fca-1c80-44ab-8840-8e43ac9e971e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:55.885396 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6614b41-6070-4596-91ab-0e95b8f81ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:55.886320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6614b41-6070-4596-91ab-0e95b8f81ed4 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:55.886780 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6614b41-6070-4596-91ab-0e95b8f81ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:55.887203 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6614b41-6070-4596-91ab-0e95b8f81ed4 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:55.888056 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6614b41-6070-4596-91ab-0e95b8f81ed4 None admin] RBAC: Adding query filter params (name=network) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:55.888536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6614b41-6070-4596-91ab-0e95b8f81ed4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:55.890057 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6614b41-6070-4596-91ab-0e95b8f81ed4 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:55.895430 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 385/777] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Jun 16 18:37:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:55.896852 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec83f90-f4ec-4bd6-8a8c-3713823a117b None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:55.897288 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec83f90-f4ec-4bd6-8a8c-3713823a117b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:55.897712 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec83f90-f4ec-4bd6-8a8c-3713823a117b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:55.915522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-1ec83f90-f4ec-4bd6-8a8c-3713823a117b None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:55.917041 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1ec83f90-f4ec-4bd6-8a8c-3713823a117b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:55.924719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a5b7c-b4d9-41cb-8608-2680c7eb729c None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:55.936522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:55.961537 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd63ded-5096-4c98-a1e4-7a90b4afdd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:55.962040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd63ded-5096-4c98-a1e4-7a90b4afdd9d None admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:55.962325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd63ded-5096-4c98-a1e4-7a90b4afdd9d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:55.962610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd63ded-5096-4c98-a1e4-7a90b4afdd9d None admin] PATH_INFO: `/v3/projects/d6d43f779d67418baf199556b8e497c7/users/3503ec98bea14693a17a84e686586bad/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:55.966108 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd63ded-5096-4c98-a1e4-7a90b4afdd9d None admin] RBAC: Authorizing `identity:create_grant(project_id=d6d43f779d67418baf199556b8e497c7, user_id=3503ec98bea14693a17a84e686586bad, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:55.967678 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd63ded-5096-4c98-a1e4-7a90b4afdd9d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:55.993056 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 386/778] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:55.994127 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec83f90-f4ec-4bd6-8a8c-3713823a117b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:56.047120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 393/779] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:37:55 2022] PUT /identity/v3/projects/d6d43f779d67418baf199556b8e497c7/users/3503ec98bea14693a17a84e686586bad/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:37:56.048175 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd63ded-5096-4c98-a1e4-7a90b4afdd9d None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:56.082411 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:56.170789 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec83f90-f4ec-4bd6-8a8c-3713823a117b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:56.181380 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd63ded-5096-4c98-a1e4-7a90b4afdd9d None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:56.224676 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a0eee-9309-4d7e-bf28-86ca5868d9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:56.225761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a0eee-9309-4d7e-bf28-86ca5868d9d4 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:56.226344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a0eee-9309-4d7e-bf28-86ca5868d9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:56.227367 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a0eee-9309-4d7e-bf28-86ca5868d9d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:56.241936 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a0eee-9309-4d7e-bf28-86ca5868d9d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:56.254105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-211a0eee-9309-4d7e-bf28-86ca5868d9d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:56.254105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:56.254105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:56.254105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:56.254105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:56.254105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:56.254105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:56.254105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:56.254105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:56.254105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:56.254105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:56.254105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:56.254105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:56.254105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:56.254105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:56.254105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:56.255326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:56.255326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:56.255326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:56.255326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:56.255326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:56.255326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:56.255326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:56.255326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:56.255326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:56.255326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:56.255326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:56.255326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:56.255326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:56.255326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:56.255326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:56.255326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:56.256278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:56.256278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:56.256278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:56.256278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:56.256278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:56.256278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:56.256278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:56.256278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:56.256278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:56.256278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:56.256278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:56.256278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:56.257061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683bfb7-3243-4cf0-b6eb-439f0c27cbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:56.257061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683bfb7-3243-4cf0-b6eb-439f0c27cbfe None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:56.257061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683bfb7-3243-4cf0-b6eb-439f0c27cbfe None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:56.257061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683bfb7-3243-4cf0-b6eb-439f0c27cbfe None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:56.257382 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683bfb7-3243-4cf0-b6eb-439f0c27cbfe None admin] RBAC: Adding query filter params (type=network) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:56.257382 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683bfb7-3243-4cf0-b6eb-439f0c27cbfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:56.258374 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683bfb7-3243-4cf0-b6eb-439f0c27cbfe None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:56.260402 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 394/780] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:56.273293 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a0eee-9309-4d7e-bf28-86ca5868d9d4 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:56.278713 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 387/781] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Jun 16 18:37:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:56.281042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683bfb7-3243-4cf0-b6eb-439f0c27cbfe None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:56.303935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:56.404334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:56.427312 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a0eee-9309-4d7e-bf28-86ca5868d9d4 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:56.435319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683bfb7-3243-4cf0-b6eb-439f0c27cbfe None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:56.468875 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd4058-61ce-4bd3-8a4e-1d863e10d4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:56.469571 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd4058-61ce-4bd3-8a4e-1d863e10d4e4 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:56.469960 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd4058-61ce-4bd3-8a4e-1d863e10d4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:56.470344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd4058-61ce-4bd3-8a4e-1d863e10d4e4 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:56.471247 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd4058-61ce-4bd3-8a4e-1d863e10d4e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:56.471701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd4058-61ce-4bd3-8a4e-1d863e10d4e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:56.473465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd4058-61ce-4bd3-8a4e-1d863e10d4e4 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:56.474749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9623c-e383-40fb-82ac-345dc6d84d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:56.475675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9623c-e383-40fb-82ac-345dc6d84d1a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:56.476190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9623c-e383-40fb-82ac-345dc6d84d1a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:56.477214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9623c-e383-40fb-82ac-345dc6d84d1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:56.478183 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9623c-e383-40fb-82ac-345dc6d84d1a None admin] RBAC: Adding query filter params (interface=public, service_id=4edc4c94e39745b5a0cacb3b22aab590, region_id=RegionOne) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:56.478701 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9623c-e383-40fb-82ac-345dc6d84d1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:56.480613 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9623c-e383-40fb-82ac-345dc6d84d1a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:56.488486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 395/782] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:56.490194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd4058-61ce-4bd3-8a4e-1d863e10d4e4 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:56.495356 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 388/783] 10.222.0.93 () {56 vars in 1251 bytes} [Thu Jun 16 18:37:56 2022] GET /identity/v3/endpoints?service_id=4edc4c94e39745b5a0cacb3b22aab590&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:56.507007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9623c-e383-40fb-82ac-345dc6d84d1a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:56.620328 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd4058-61ce-4bd3-8a4e-1d863e10d4e4 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:56.626555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:56.652686 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9623c-e383-40fb-82ac-345dc6d84d1a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:56.656929 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d90528-0ea8-46fa-b7c7-5ed0790bec7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:56.657930 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d90528-0ea8-46fa-b7c7-5ed0790bec7d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:56.658320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d90528-0ea8-46fa-b7c7-5ed0790bec7d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:56.658700 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d90528-0ea8-46fa-b7c7-5ed0790bec7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:56.675174 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d90528-0ea8-46fa-b7c7-5ed0790bec7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:56.677403 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d90528-0ea8-46fa-b7c7-5ed0790bec7d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:56.681541 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:56.697133 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c54e26-ee77-4278-b37a-0c4ca4b8fac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:56.698125 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c54e26-ee77-4278-b37a-0c4ca4b8fac0 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:56.698634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c54e26-ee77-4278-b37a-0c4ca4b8fac0 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:56.699109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-b2d90528-0ea8-46fa-b7c7-5ed0790bec7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:56.699109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:56.699109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:56.699109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:56.699109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:56.699109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:56.699109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:56.699109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:56.699109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:56.699109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:56.699109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:56.699109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:56.699109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:56.699109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:56.699109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:56.699981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:56.699981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:56.699981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:56.699981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:56.699981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:56.699981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:56.699981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:56.699981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:56.699981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:56.699981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:56.699981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:56.699981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:56.699981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:56.699981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:56.699981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:56.699981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:56.699981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:56.701425 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:56.701425 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:56.701425 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:56.701425 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:56.702005 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c54e26-ee77-4278-b37a-0c4ca4b8fac0 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:56.702965 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c54e26-ee77-4278-b37a-0c4ca4b8fac0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:56.704636 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c54e26-ee77-4278-b37a-0c4ca4b8fac0 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:56.705216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 396/784] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:56.706598 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e7331-ebf7-4537-a0f8-6f08a9519414 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:56.706784 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e7331-ebf7-4537-a0f8-6f08a9519414 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:56.707065 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e7331-ebf7-4537-a0f8-6f08a9519414 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:56.708745 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 397/785] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:56.709513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e7331-ebf7-4537-a0f8-6f08a9519414 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:56.712862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 389/786] 10.222.0.93 () {56 vars in 1087 bytes} [Thu Jun 16 18:37:56 2022] GET /identity/v3/services => generated 772 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:56.715590 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b70049-17c0-4f2e-b0ac-64e209de5438 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:56.716171 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b70049-17c0-4f2e-b0ac-64e209de5438 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:56.716711 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b70049-17c0-4f2e-b0ac-64e209de5438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:56.737672 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-92b70049-17c0-4f2e-b0ac-64e209de5438 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:56.739684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-92b70049-17c0-4f2e-b0ac-64e209de5438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:56.828260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 390/787] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:56.850557 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b70049-17c0-4f2e-b0ac-64e209de5438 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:56.919756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e7331-ebf7-4537-a0f8-6f08a9519414 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:56.962017 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:56.990399 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b70049-17c0-4f2e-b0ac-64e209de5438 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:57.018615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5b55f-370a-4049-a6a2-f200582c765e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:57.019300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5b55f-370a-4049-a6a2-f200582c765e None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.019589 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5b55f-370a-4049-a6a2-f200582c765e None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.019862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5b55f-370a-4049-a6a2-f200582c765e None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.020617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5b55f-370a-4049-a6a2-f200582c765e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:57.020927 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5b55f-370a-4049-a6a2-f200582c765e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:57.022305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5b55f-370a-4049-a6a2-f200582c765e None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:57.037749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27babac5-57d6-4119-9bac-9a702b589a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:57.041753 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27babac5-57d6-4119-9bac-9a702b589a92 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.041753 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27babac5-57d6-4119-9bac-9a702b589a92 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.041753 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27babac5-57d6-4119-9bac-9a702b589a92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.052602 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27babac5-57d6-4119-9bac-9a702b589a92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:57.054234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 398/788] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:57.062095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5b55f-370a-4049-a6a2-f200582c765e None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:57.065114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-27babac5-57d6-4119-9bac-9a702b589a92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:57.065114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:57.065114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:57.065114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:57.065114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:57.065114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:57.065114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:57.065114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:57.065114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:57.065114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:57.065114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:57.065114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:57.065114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:57.065114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:57.065114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:57.065114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:57.066080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:57.066080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:57.066080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:57.066080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:57.066080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:57.066080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:57.066080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:57.066080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:57.066080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:57.066080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:57.066080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:57.066080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:57.066080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:57.066080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:57.066080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:57.066080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:57.067326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:57.067326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:57.067326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:57.067326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:57.067326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:57.067326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:57.067326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:57.067326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:57.067326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:57.067326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:57.067326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:57.067326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:57.067326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 391/789] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:57.084012 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27babac5-57d6-4119-9bac-9a702b589a92 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:57.132047 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:57.190642 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5b55f-370a-4049-a6a2-f200582c765e None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:57.201631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27babac5-57d6-4119-9bac-9a702b589a92 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:57.247782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25aaaab-6d3c-4143-a7e9-e87c03387fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:57.247990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aaaab-6d3c-4143-a7e9-e87c03387fc5 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.248154 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aaaab-6d3c-4143-a7e9-e87c03387fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.252455 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aaaab-6d3c-4143-a7e9-e87c03387fc5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.252601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb7f38-0c7c-4e2d-ada1-90d1b03592f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:57.252601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb7f38-0c7c-4e2d-ada1-90d1b03592f8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.252601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb7f38-0c7c-4e2d-ada1-90d1b03592f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.252601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb7f38-0c7c-4e2d-ada1-90d1b03592f8 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.252878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb7f38-0c7c-4e2d-ada1-90d1b03592f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:57.252878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb7f38-0c7c-4e2d-ada1-90d1b03592f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:57.253314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb7f38-0c7c-4e2d-ada1-90d1b03592f8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:57.264807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:57.269792 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25aaaab-6d3c-4143-a7e9-e87c03387fc5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:57.271251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25aaaab-6d3c-4143-a7e9-e87c03387fc5 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:57.286082 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 392/790] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:57.293216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb7f38-0c7c-4e2d-ada1-90d1b03592f8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:57.300492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-a25aaaab-6d3c-4143-a7e9-e87c03387fc5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:37:57.300492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:57.300492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:57.300492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:57.300492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:57.300492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:57.300492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:57.300492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:57.300492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:57.300492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:57.300492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:57.300492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:57.300492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:57.300492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:57.300492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:57.300492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:57.301514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:57.301514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:57.301514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:57.301514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:57.301514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:57.301514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:57.301514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:57.301514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:57.301514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:57.301514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:57.301514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:57.301514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:57.301514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:57.301514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:57.301514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:57.301514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:57.301514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:57.301514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:57.303074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:57.303074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:57.303074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:57.303074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:57.303074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:57.303074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:57.303074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:57.303074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:57.303074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:37:57.303074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:57.309472 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 399/791] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Jun 16 18:37:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:57.317715 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25aaaab-6d3c-4143-a7e9-e87c03387fc5 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:57.481128 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb7f38-0c7c-4e2d-ada1-90d1b03592f8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:57.488378 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25aaaab-6d3c-4143-a7e9-e87c03387fc5 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:57.505987 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:57.518950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2a136-cdd6-4e19-a603-d27d1a38b616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:57.520078 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2a136-cdd6-4e19-a603-d27d1a38b616 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.520606 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2a136-cdd6-4e19-a603-d27d1a38b616 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.521103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2a136-cdd6-4e19-a603-d27d1a38b616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.536468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba91f3-16b7-4ed0-ad62-4044c546a7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:57.536468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba91f3-16b7-4ed0-ad62-4044c546a7e4 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.536468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba91f3-16b7-4ed0-ad62-4044c546a7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.536468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba91f3-16b7-4ed0-ad62-4044c546a7e4 None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.536900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba91f3-16b7-4ed0-ad62-4044c546a7e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:57.536900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba91f3-16b7-4ed0-ad62-4044c546a7e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:57.537038 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2a136-cdd6-4e19-a603-d27d1a38b616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:57.537113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba91f3-16b7-4ed0-ad62-4044c546a7e4 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:57.537183 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2a136-cdd6-4e19-a603-d27d1a38b616 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:57.553845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-2dd2a136-cdd6-4e19-a603-d27d1a38b616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:57.553845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:57.553845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:57.553845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:57.553845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:57.553845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:57.553845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:57.553845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:57.553845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:57.553845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:57.553845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:57.553845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:57.553845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:57.553845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:57.553845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:57.555220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:57.555220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:57.555220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:57.555220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:57.555220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:57.555220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:57.555220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:57.555220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:57.555220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:57.555220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:57.555220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:57.555220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:57.555220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:57.555220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:57.555220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:57.555220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:57.555220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:57.556545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:57.556545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:57.556545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:57.556545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:57.556545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 393/792] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:57.556847 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db6fe8-a663-4f1c-bb07-cc1e999bed07 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.557077 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db6fe8-a663-4f1c-bb07-cc1e999bed07 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.557232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db6fe8-a663-4f1c-bb07-cc1e999bed07 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.558670 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 400/794] 10.222.0.93 () {56 vars in 1149 bytes} [Thu Jun 16 18:37:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:57.558809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 394/794] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:57.559744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba91f3-16b7-4ed0-ad62-4044c546a7e4 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:57.560249 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db6fe8-a663-4f1c-bb07-cc1e999bed07 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:57.620179 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:57.683065 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba91f3-16b7-4ed0-ad62-4044c546a7e4 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:57.689900 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db6fe8-a663-4f1c-bb07-cc1e999bed07 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:57.723729 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5fa4f-d48c-4053-983d-1a6058323547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:57.724936 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5fa4f-d48c-4053-983d-1a6058323547 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.725432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5fa4f-d48c-4053-983d-1a6058323547 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.725914 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5fa4f-d48c-4053-983d-1a6058323547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.735633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203cd8b-eae6-4fff-b72f-35cc16f19063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:57.736543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203cd8b-eae6-4fff-b72f-35cc16f19063 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.736835 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203cd8b-eae6-4fff-b72f-35cc16f19063 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.737168 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203cd8b-eae6-4fff-b72f-35cc16f19063 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.737554 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5fa4f-d48c-4053-983d-1a6058323547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:57.737902 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203cd8b-eae6-4fff-b72f-35cc16f19063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:57.738262 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203cd8b-eae6-4fff-b72f-35cc16f19063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:57.739662 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5fa4f-d48c-4053-983d-1a6058323547 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:57.739773 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203cd8b-eae6-4fff-b72f-35cc16f19063 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:57.753772 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 395/795] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:57.755081 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494788d-e2ae-4277-bf54-f46598a14127 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.755377 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494788d-e2ae-4277-bf54-f46598a14127 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.755713 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494788d-e2ae-4277-bf54-f46598a14127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.760233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-2bf5fa4f-d48c-4053-983d-1a6058323547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:57.760233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:57.760233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:57.760233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:57.760233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:57.760233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:57.760233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:57.760233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:57.760233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:57.760233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:57.760233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:57.760233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:57.760233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:57.760233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:57.760233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:57.761262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:57.761262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:57.761262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:57.761262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:57.761262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:57.761262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:57.761262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:57.761262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:57.761262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:57.761262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:57.761262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:57.761262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:57.761262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:57.761262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:57.761262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:57.761262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:57.761262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:57.762177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:57.762177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:57.762177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:57.762177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:57.764349 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 401/796] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:57.765469 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5fa4f-d48c-4053-983d-1a6058323547 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:57.774979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5494788d-e2ae-4277-bf54-f46598a14127 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:57.776798 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5494788d-e2ae-4277-bf54-f46598a14127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:57.795319 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:57.869694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 396/797] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:57.870762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494788d-e2ae-4277-bf54-f46598a14127 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:57.873289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5fa4f-d48c-4053-983d-1a6058323547 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:57.910279 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de9328-a35f-4783-84de-e1dcb4aacd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:57.911515 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de9328-a35f-4783-84de-e1dcb4aacd58 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.912019 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de9328-a35f-4783-84de-e1dcb4aacd58 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.912533 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de9328-a35f-4783-84de-e1dcb4aacd58 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.921813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de9328-a35f-4783-84de-e1dcb4aacd58 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:57.923949 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de9328-a35f-4783-84de-e1dcb4aacd58 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:57.928351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:57.940119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-33de9328-a35f-4783-84de-e1dcb4aacd58 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:57.940119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:57.940119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:57.940119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:57.940119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:57.940119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:57.940119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:57.940119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:57.940119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:57.940119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:57.940119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:57.940119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:57.940119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:57.940119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:57.940119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:57.940119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:57.941286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:57.941286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:57.941286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:57.941286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:57.941286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:57.941286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:57.941286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:57.941286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:57.941286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:57.941286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:57.941286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:57.941286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:57.941286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:57.941286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:57.941286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:57.941286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:57.941286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:57.941286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:57.942246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:57.942246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:57.942246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:57.942246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:57.942246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:57.942246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:57.942246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:57.942246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:57.942246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:57.942246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:57.944664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 402/798] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:57.946284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de9328-a35f-4783-84de-e1dcb4aacd58 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:58.000209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494788d-e2ae-4277-bf54-f46598a14127 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:58.042270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27254db1-b076-47c5-b63c-c7cc1d178f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:58.043389 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27254db1-b076-47c5-b63c-c7cc1d178f1a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.044041 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:58.044838 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27254db1-b076-47c5-b63c-c7cc1d178f1a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.045393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27254db1-b076-47c5-b63c-c7cc1d178f1a None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.046329 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27254db1-b076-47c5-b63c-c7cc1d178f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:58.046866 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27254db1-b076-47c5-b63c-c7cc1d178f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:58.048461 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27254db1-b076-47c5-b63c-c7cc1d178f1a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:58.061207 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 397/799] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:58.062059 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de9328-a35f-4783-84de-e1dcb4aacd58 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:58.062592 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27254db1-b076-47c5-b63c-c7cc1d178f1a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:58.107362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c23dd-de17-42f0-8fa7-d2448bd1dd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:58.108635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c23dd-de17-42f0-8fa7-d2448bd1dd57 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.109177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c23dd-de17-42f0-8fa7-d2448bd1dd57 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.109657 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c23dd-de17-42f0-8fa7-d2448bd1dd57 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.111141 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c23dd-de17-42f0-8fa7-d2448bd1dd57 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:58.113215 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c23dd-de17-42f0-8fa7-d2448bd1dd57 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:58.130751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-f10c23dd-de17-42f0-8fa7-d2448bd1dd57 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 18:37:58.130751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:58.130751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:58.130751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:58.130751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:58.130751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:58.130751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:58.130751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:58.130751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 18:37:58.130751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:58.130751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:58.130751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:58.130751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:58.130751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:58.130751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:58.130751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:58.131701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:58.131701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:58.131701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:58.131701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:58.131701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:58.131701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:58.131701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:58.131701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:58.131701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:58.131701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:58.131701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:58.131701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:58.131701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:58.131701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:58.131701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:58.131701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:58.133157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:58.133157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:58.133157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:58.133157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:58.133157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:58.133157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:58.133157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:58.133157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:58.133157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:58.133157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:58.133157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:58.133157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:58.133157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:58.133157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 18:37:58.133157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:58.134799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 403/800] 10.222.0.93 () {56 vars in 1129 bytes} [Thu Jun 16 18:37:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:58.135321 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c23dd-de17-42f0-8fa7-d2448bd1dd57 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:58.177824 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:58.181641 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27254db1-b076-47c5-b63c-c7cc1d178f1a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:58.219165 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b6c41-f262-40c1-9de7-14a1aef9c780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:58.220235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b6c41-f262-40c1-9de7-14a1aef9c780 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.220754 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b6c41-f262-40c1-9de7-14a1aef9c780 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.221239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b6c41-f262-40c1-9de7-14a1aef9c780 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.222520 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b6c41-f262-40c1-9de7-14a1aef9c780 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:58.223038 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b6c41-f262-40c1-9de7-14a1aef9c780 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:58.224754 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b6c41-f262-40c1-9de7-14a1aef9c780 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:58.242565 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c23dd-de17-42f0-8fa7-d2448bd1dd57 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:58.245392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 398/801] 10.222.0.93 () {56 vars in 1135 bytes} [Thu Jun 16 18:37:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:58.246588 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b6c41-f262-40c1-9de7-14a1aef9c780 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:58.281878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaffe43-af0b-4023-82e9-79e421dc6dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:58.282823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaffe43-af0b-4023-82e9-79e421dc6dfe None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.283156 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaffe43-af0b-4023-82e9-79e421dc6dfe None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.283441 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaffe43-af0b-4023-82e9-79e421dc6dfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.291642 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaffe43-af0b-4023-82e9-79e421dc6dfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:58.293206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaffe43-af0b-4023-82e9-79e421dc6dfe None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:58.309149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-aeaffe43-af0b-4023-82e9-79e421dc6dfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:58.309149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:58.309149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:58.309149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:58.309149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:58.309149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:58.309149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:58.309149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:58.309149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:58.309149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:58.309149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:58.309149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:58.309149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:58.309149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:58.309149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:58.310074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:58.310074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:58.310074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:58.310074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:58.310074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:58.310074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:58.310074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:58.310074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:58.310074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:58.310074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:58.310074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:58.310074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:58.310074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:58.310074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:58.310074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:58.310074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:58.310074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:58.311558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:58.311558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:58.311558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:58.311558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:58.311558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:58.311558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:58.311558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:58.311558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:58.311558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 404/802] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:58.311558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaffe43-af0b-4023-82e9-79e421dc6dfe None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:58.324901 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:58.370309 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b6c41-f262-40c1-9de7-14a1aef9c780 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:58.416124 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908e5bc-f559-47b7-a7d6-0854b31c1adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:58.417310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908e5bc-f559-47b7-a7d6-0854b31c1adc None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.417707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908e5bc-f559-47b7-a7d6-0854b31c1adc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.418018 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908e5bc-f559-47b7-a7d6-0854b31c1adc None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.419051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908e5bc-f559-47b7-a7d6-0854b31c1adc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:58.419371 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908e5bc-f559-47b7-a7d6-0854b31c1adc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:58.421269 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908e5bc-f559-47b7-a7d6-0854b31c1adc None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:58.426987 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaffe43-af0b-4023-82e9-79e421dc6dfe None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:58.427694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 399/803] 10.222.0.93 () {56 vars in 1124 bytes} [Thu Jun 16 18:37:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:58.428627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908e5bc-f559-47b7-a7d6-0854b31c1adc None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:58.459099 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:58.478606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a383eb-21dd-4416-858c-37239de7e994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:58.479792 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a383eb-21dd-4416-858c-37239de7e994 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.480085 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a383eb-21dd-4416-858c-37239de7e994 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.480367 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a383eb-21dd-4416-858c-37239de7e994 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.494717 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a383eb-21dd-4416-858c-37239de7e994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:58.496886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a383eb-21dd-4416-858c-37239de7e994 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:58.519928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-f9a383eb-21dd-4416-858c-37239de7e994 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:58.519928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:58.519928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:58.519928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:58.519928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:58.519928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:58.519928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:58.519928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:58.519928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:58.519928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:58.519928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:58.519928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:58.519928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:58.519928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:58.519928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:58.520902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:58.520902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:58.520902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:58.520902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:58.520902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:58.520902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:58.520902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:58.520902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:58.520902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:58.520902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:58.520902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:58.520902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:58.520902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:58.520902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:58.520902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:58.520902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:58.520902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:58.521815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:58.521815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:58.521815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:58.521815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:58.524744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 405/804] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:58.525855 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a383eb-21dd-4416-858c-37239de7e994 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:58.558460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908e5bc-f559-47b7-a7d6-0854b31c1adc None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:58.600330 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d80866-3ec2-4c07-91eb-7a9d3c8a6d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:58.601424 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d80866-3ec2-4c07-91eb-7a9d3c8a6d2d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.601918 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d80866-3ec2-4c07-91eb-7a9d3c8a6d2d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.602421 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d80866-3ec2-4c07-91eb-7a9d3c8a6d2d None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.603436 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d80866-3ec2-4c07-91eb-7a9d3c8a6d2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:58.603962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d80866-3ec2-4c07-91eb-7a9d3c8a6d2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:58.605648 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d80866-3ec2-4c07-91eb-7a9d3c8a6d2d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:58.606246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:58.621915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 400/805] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:58.624499 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d80866-3ec2-4c07-91eb-7a9d3c8a6d2d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:58.663878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a383eb-21dd-4416-858c-37239de7e994 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:58.705364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520086fc-15b9-4fcd-a39c-9918fdafc0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:58.706090 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520086fc-15b9-4fcd-a39c-9918fdafc0a6 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.706381 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520086fc-15b9-4fcd-a39c-9918fdafc0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.706655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520086fc-15b9-4fcd-a39c-9918fdafc0a6 None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.707359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520086fc-15b9-4fcd-a39c-9918fdafc0a6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:58.707916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520086fc-15b9-4fcd-a39c-9918fdafc0a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:58.709282 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520086fc-15b9-4fcd-a39c-9918fdafc0a6 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:58.714563 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:58.720177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 406/806] 10.222.0.93 () {56 vars in 1124 bytes} [Thu Jun 16 18:37:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:58.720835 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520086fc-15b9-4fcd-a39c-9918fdafc0a6 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:58.732068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d80866-3ec2-4c07-91eb-7a9d3c8a6d2d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:58.769196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79583d75-acf2-47f3-ac8a-a4e4f6fc4cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:58.770031 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79583d75-acf2-47f3-ac8a-a4e4f6fc4cbd None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.770330 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79583d75-acf2-47f3-ac8a-a4e4f6fc4cbd None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.770614 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79583d75-acf2-47f3-ac8a-a4e4f6fc4cbd None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.771341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79583d75-acf2-47f3-ac8a-a4e4f6fc4cbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:58.771654 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79583d75-acf2-47f3-ac8a-a4e4f6fc4cbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:58.773100 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79583d75-acf2-47f3-ac8a-a4e4f6fc4cbd None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:58.786073 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 401/807] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:58.787344 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666325d-54ac-436a-ba83-53dbec35c6d1 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.787642 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666325d-54ac-436a-ba83-53dbec35c6d1 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.787923 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666325d-54ac-436a-ba83-53dbec35c6d1 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.789398 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 402/808] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:58.790079 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666325d-54ac-436a-ba83-53dbec35c6d1 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:58.831863 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520086fc-15b9-4fcd-a39c-9918fdafc0a6 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:58.863559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:58.875776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a592735-8b90-4b2b-8ab0-d54558f94c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:58.877490 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a592735-8b90-4b2b-8ab0-d54558f94c84 None admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.878045 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a592735-8b90-4b2b-8ab0-d54558f94c84 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.878956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a592735-8b90-4b2b-8ab0-d54558f94c84 None admin] PATH_INFO: `/v3/projects/d6d43f779d67418baf199556b8e497c7/users/1eefe0d721484433b72afca03a2c1bb6/roles/06f67743387f476cade2623aa7e5c5d2` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.895133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a592735-8b90-4b2b-8ab0-d54558f94c84 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6d43f779d67418baf199556b8e497c7, user_id=1eefe0d721484433b72afca03a2c1bb6, role_id=06f67743387f476cade2623aa7e5c5d2)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:58.896786 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a592735-8b90-4b2b-8ab0-d54558f94c84 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:58.904538 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666325d-54ac-436a-ba83-53dbec35c6d1 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:58.938987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda3a24-50d7-43f4-944b-35a84d6231e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:58.939650 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda3a24-50d7-43f4-944b-35a84d6231e3 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.939929 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda3a24-50d7-43f4-944b-35a84d6231e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.940201 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda3a24-50d7-43f4-944b-35a84d6231e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.941483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda3a24-50d7-43f4-944b-35a84d6231e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:58.942339 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda3a24-50d7-43f4-944b-35a84d6231e3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:58.986536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 407/809] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:37:58 2022] PUT /identity/v3/projects/d6d43f779d67418baf199556b8e497c7/users/1eefe0d721484433b72afca03a2c1bb6/roles/06f67743387f476cade2623aa7e5c5d2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:58.987372 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a592735-8b90-4b2b-8ab0-d54558f94c84 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:59.069581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:59.080547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 403/810] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Jun 16 18:37:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:59.080547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7168cce-be53-491b-93b7-62c020b363e6 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:59.080547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7168cce-be53-491b-93b7-62c020b363e6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:59.080547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7168cce-be53-491b-93b7-62c020b363e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:59.114918 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d7168cce-be53-491b-93b7-62c020b363e6 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:59.116266 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d7168cce-be53-491b-93b7-62c020b363e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:59.148059 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a592735-8b90-4b2b-8ab0-d54558f94c84 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:59.206311 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5baf10d-65c1-427d-adda-52dc0431a0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:59.207244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5baf10d-65c1-427d-adda-52dc0431a0f5 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:59.207593 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5baf10d-65c1-427d-adda-52dc0431a0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:59.207936 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5baf10d-65c1-427d-adda-52dc0431a0f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:59.215827 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5baf10d-65c1-427d-adda-52dc0431a0f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:59.217430 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5baf10d-65c1-427d-adda-52dc0431a0f5 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:59.230827 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 404/811] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:59.235396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-b5baf10d-65c1-427d-adda-52dc0431a0f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:59.235396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:59.235396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:59.235396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:59.235396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:59.235396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:59.235396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:59.235396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:59.235396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:59.235396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:59.235396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:59.235396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:59.235396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:59.235396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:59.235396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:59.236333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:59.236333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:59.236333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:59.236333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:59.236333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:59.236333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:59.236333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:59.236333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:59.236333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:59.236333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:59.236333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:59.236333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:59.236333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:59.236333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:59.236333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:59.236333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:59.236333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:59.237330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:59.237330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:59.237330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:59.237330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:59.237330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:59.237330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:59.237330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:59.237330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:59.238328 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 408/812] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:59.246197 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7168cce-be53-491b-93b7-62c020b363e6 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:59.266602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5baf10d-65c1-427d-adda-52dc0431a0f5 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:59.316465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:59.377102 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7168cce-be53-491b-93b7-62c020b363e6 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:59.405307 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5baf10d-65c1-427d-adda-52dc0431a0f5 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:59.412087 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:59.421152 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255501ff-9185-4fc0-a0cc-b458634662ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:59.421958 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255501ff-9185-4fc0-a0cc-b458634662ca None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:59.422343 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255501ff-9185-4fc0-a0cc-b458634662ca None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:59.422724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255501ff-9185-4fc0-a0cc-b458634662ca None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:59.423656 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255501ff-9185-4fc0-a0cc-b458634662ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:59.424073 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255501ff-9185-4fc0-a0cc-b458634662ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:59.425702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255501ff-9185-4fc0-a0cc-b458634662ca None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:59.438066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 405/813] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:59.439509 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1cf6b-0f24-458c-b4fb-9eba762daaa4 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:59.443122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcb7d7-24ba-4ace-8ea5-aaf20cccbbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:59.444221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcb7d7-24ba-4ace-8ea5-aaf20cccbbec None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:59.444752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcb7d7-24ba-4ace-8ea5-aaf20cccbbec None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:59.444858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1cf6b-0f24-458c-b4fb-9eba762daaa4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:59.458795 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1cf6b-0f24-458c-b4fb-9eba762daaa4 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:59.458983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcb7d7-24ba-4ace-8ea5-aaf20cccbbec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:59.459101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 406/814] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:37:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:59.459101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1cf6b-0f24-458c-b4fb-9eba762daaa4 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:59.479626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcb7d7-24ba-4ace-8ea5-aaf20cccbbec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:59.490337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-97bcb7d7-24ba-4ace-8ea5-aaf20cccbbec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:59.490337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:59.490337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:59.490337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:59.490337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:59.490337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:59.490337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:59.490337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:59.490337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:59.490337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:59.490337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:59.490337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:59.490337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:59.490337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:59.490337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:59.490337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:59.491496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:59.491496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:59.491496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:59.491496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:59.491496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:59.491496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:59.491496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:59.491496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:59.491496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:59.491496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:59.491496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:59.491496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:59.491496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:59.491496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:59.491496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:59.491496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:59.492558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:59.492558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:59.492558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:59.492558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:59.492558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:59.492558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:59.492558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:59.492558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:59.492558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:59.492558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:59.492558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:59.492558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:37:59.494925 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 409/815] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:59.496505 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1ba8f-9ebb-47f2-a0b9-77334b04d0e6 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:59.496936 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1ba8f-9ebb-47f2-a0b9-77334b04d0e6 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:59.498216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1ba8f-9ebb-47f2-a0b9-77334b04d0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:59.521091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-e7f1ba8f-9ebb-47f2-a0b9-77334b04d0e6 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:59.523503 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-e7f1ba8f-9ebb-47f2-a0b9-77334b04d0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:59.568807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1cf6b-0f24-458c-b4fb-9eba762daaa4 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:59.608082 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 410/816] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:59.608985 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1ba8f-9ebb-47f2-a0b9-77334b04d0e6 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:59.613750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93d328-f66d-47f4-8bd8-22feb9242595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:59.614726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93d328-f66d-47f4-8bd8-22feb9242595 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:59.615008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93d328-f66d-47f4-8bd8-22feb9242595 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:59.615310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93d328-f66d-47f4-8bd8-22feb9242595 None admin] PATH_INFO: `/v3/projects/d6d43f779d67418baf199556b8e497c7/users/b45db002889846eda5b2a3e6917fcbe1/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:59.617376 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93d328-f66d-47f4-8bd8-22feb9242595 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6d43f779d67418baf199556b8e497c7, user_id=b45db002889846eda5b2a3e6917fcbe1, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:59.619261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93d328-f66d-47f4-8bd8-22feb9242595 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:59.646149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:59.704638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 407/817] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:37:59 2022] PUT /identity/v3/projects/d6d43f779d67418baf199556b8e497c7/users/b45db002889846eda5b2a3e6917fcbe1/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:59.706000 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93d328-f66d-47f4-8bd8-22feb9242595 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:59.772269 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1ba8f-9ebb-47f2-a0b9-77334b04d0e6 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:59.808843 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:59.849540 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6475c3-4dbb-4e0a-a569-da0144392731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:59.850298 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6475c3-4dbb-4e0a-a569-da0144392731 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:59.850581 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6475c3-4dbb-4e0a-a569-da0144392731 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:59.850951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6475c3-4dbb-4e0a-a569-da0144392731 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:59.851728 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6475c3-4dbb-4e0a-a569-da0144392731 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:59.852034 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6475c3-4dbb-4e0a-a569-da0144392731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:59.853497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6475c3-4dbb-4e0a-a569-da0144392731 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:59.871962 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 411/818] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:59.881525 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6475c3-4dbb-4e0a-a569-da0144392731 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:59.898789 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93d328-f66d-47f4-8bd8-22feb9242595 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:59.938607 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c789083-0e18-40a5-9540-a5051d1b3b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:59.939430 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c789083-0e18-40a5-9540-a5051d1b3b09 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:59.939722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c789083-0e18-40a5-9540-a5051d1b3b09 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:59.940000 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c789083-0e18-40a5-9540-a5051d1b3b09 None admin] PATH_INFO: `/v3/services/network` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:59.940862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c789083-0e18-40a5-9540-a5051d1b3b09 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:59.942267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c789083-0e18-40a5-9540-a5051d1b3b09 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:59.956460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-3c789083-0e18-40a5-9540-a5051d1b3b09 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 18:37:59.956460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:59.956460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:59.956460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:59.956460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:59.956460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:59.956460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:59.956460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:59.956460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 18:37:59.956460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:59.956460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:59.956460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:59.956460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:59.956460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:59.956460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:59.956460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:59.956460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:59.957709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:59.957709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:59.957709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:59.957709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:59.957709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:59.957709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:59.957709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:59.957709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:59.957709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:59.957709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:59.957709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:59.957709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:59.957709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:59.957709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:59.957709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:59.957709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:59.958729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:59.958729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:59.958729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:59.958729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:59.958729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:59.958729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:59.958729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:59.958729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:59.958729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:59.958729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:59.958729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:59.958729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:59.958729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 18:37:59.958729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:37:59.958729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 408/819] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:59 2022] GET /identity/v3/services/network => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:59.965350 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c789083-0e18-40a5-9540-a5051d1b3b09 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:59.994299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:00.016617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6475c3-4dbb-4e0a-a569-da0144392731 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:00.051632 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95702e4-8e0c-485b-8a6a-2ad4d8f02034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:00.052770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95702e4-8e0c-485b-8a6a-2ad4d8f02034 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:00.053253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95702e4-8e0c-485b-8a6a-2ad4d8f02034 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:00.054245 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95702e4-8e0c-485b-8a6a-2ad4d8f02034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:00.064969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95702e4-8e0c-485b-8a6a-2ad4d8f02034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:00.066765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95702e4-8e0c-485b-8a6a-2ad4d8f02034 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:00.088263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-f95702e4-8e0c-485b-8a6a-2ad4d8f02034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:00.088263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:00.088263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:00.088263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:00.088263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:00.088263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:00.088263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:00.088263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:00.088263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:00.088263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:00.088263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:00.088263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:00.088263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:00.088263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:00.088263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:00.089432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:00.089432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:00.089432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:00.089432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:00.089432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:00.089432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:00.089432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:00.089432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:00.089432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:00.089432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:00.089432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:00.089432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:00.089432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:00.089432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:00.089432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:00.089432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:00.089432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:00.090643 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:00.090643 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:00.090643 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:00.090643 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:00.093274 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 412/820] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:00.104464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95702e4-8e0c-485b-8a6a-2ad4d8f02034 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:00.161059 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c789083-0e18-40a5-9540-a5051d1b3b09 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:00.188403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:00.215021 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d5cde-2158-4c97-a199-831332403b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:00.215782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d5cde-2158-4c97-a199-831332403b15 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:00.216140 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d5cde-2158-4c97-a199-831332403b15 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:00.216527 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d5cde-2158-4c97-a199-831332403b15 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:00.217316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d5cde-2158-4c97-a199-831332403b15 None admin] RBAC: Adding query filter params (name=network) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:00.217798 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d5cde-2158-4c97-a199-831332403b15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:00.219253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d5cde-2158-4c97-a199-831332403b15 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:00.224681 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 409/821] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Jun 16 18:37:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:00.230337 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d5cde-2158-4c97-a199-831332403b15 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:00.341323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d5cde-2158-4c97-a199-831332403b15 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:00.378504 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95702e4-8e0c-485b-8a6a-2ad4d8f02034 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:00.385692 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dde12-737b-434e-80c1-5fe07789592a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:00.386633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dde12-737b-434e-80c1-5fe07789592a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:00.387209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dde12-737b-434e-80c1-5fe07789592a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:00.387685 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dde12-737b-434e-80c1-5fe07789592a None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:00.388616 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084dde12-737b-434e-80c1-5fe07789592a None admin] RBAC: Adding query filter params (type=network) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:00.389107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084dde12-737b-434e-80c1-5fe07789592a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:00.390650 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084dde12-737b-434e-80c1-5fe07789592a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:00.402714 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 410/822] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Jun 16 18:38:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:00.409388 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dde12-737b-434e-80c1-5fe07789592a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:00.424417 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99f9c7-7a9e-43bf-ac2c-51291a2590ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:00.425786 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99f9c7-7a9e-43bf-ac2c-51291a2590ce None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:00.425919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99f9c7-7a9e-43bf-ac2c-51291a2590ce None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:00.426203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99f9c7-7a9e-43bf-ac2c-51291a2590ce None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:00.427256 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99f9c7-7a9e-43bf-ac2c-51291a2590ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:00.427695 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99f9c7-7a9e-43bf-ac2c-51291a2590ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:00.430708 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99f9c7-7a9e-43bf-ac2c-51291a2590ce None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:00.447579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 413/823] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:00.447778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:00.455563 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99f9c7-7a9e-43bf-ac2c-51291a2590ce None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:00.495621 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:00.599480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99f9c7-7a9e-43bf-ac2c-51291a2590ce None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:00.611339 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dde12-737b-434e-80c1-5fe07789592a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:00.645799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917635c6-f10d-40c8-b888-5016346c73ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:00.646606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917635c6-f10d-40c8-b888-5016346c73ef None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:00.646886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917635c6-f10d-40c8-b888-5016346c73ef None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:00.647749 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917635c6-f10d-40c8-b888-5016346c73ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:00.656894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917635c6-f10d-40c8-b888-5016346c73ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:00.658344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917635c6-f10d-40c8-b888-5016346c73ef None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:00.675210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-917635c6-f10d-40c8-b888-5016346c73ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:38:00.675210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:00.675210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:00.675210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:00.675210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:00.675210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:00.675210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:00.675210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:00.675210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:00.675210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:00.675210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:00.675210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:00.675210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:38:00.675210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:38:00.675210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:38:00.675210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:38:00.676163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:00.676163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:00.676163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:38:00.676163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:00.676163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:38:00.676163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:00.676163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:00.676163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:00.676163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:00.676163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:00.676163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:00.676163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:00.676163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:00.676163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:00.676163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:00.676163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:00.676163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:00.676163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:00.677158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:00.677158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:00.677158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:38:00.677158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:38:00.677158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:38:00.677158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:38:00.677158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:38:00.677158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:38:00.677158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:38:00.677158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:00.677158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 414/824] 10.222.0.93 () {56 vars in 1093 bytes} [Thu Jun 16 18:38:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:00.685462 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01595a-0dce-4cfd-b7c8-45ab1422aa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:00.686143 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01595a-0dce-4cfd-b7c8-45ab1422aa16 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:00.686431 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01595a-0dce-4cfd-b7c8-45ab1422aa16 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:00.686714 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01595a-0dce-4cfd-b7c8-45ab1422aa16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:00.687479 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01595a-0dce-4cfd-b7c8-45ab1422aa16 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:00.688884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01595a-0dce-4cfd-b7c8-45ab1422aa16 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:00.693982 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917635c6-f10d-40c8-b888-5016346c73ef None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:00.760099 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:00.793755 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 411/825] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Jun 16 18:38:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:38:00.807326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917635c6-f10d-40c8-b888-5016346c73ef None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:00.867060 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1b7d9-8870-4168-a2cb-5a15ac83c2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:00.867748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1b7d9-8870-4168-a2cb-5a15ac83c2c0 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:00.868034 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1b7d9-8870-4168-a2cb-5a15ac83c2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:00.868317 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1b7d9-8870-4168-a2cb-5a15ac83c2c0 None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:00.869184 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1b7d9-8870-4168-a2cb-5a15ac83c2c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:00.869497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1b7d9-8870-4168-a2cb-5a15ac83c2c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:00.870935 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1b7d9-8870-4168-a2cb-5a15ac83c2c0 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:00.898092 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 415/826] 10.222.0.93 () {56 vars in 1133 bytes} [Thu Jun 16 18:38:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:00.903958 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01595a-0dce-4cfd-b7c8-45ab1422aa16 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:01.073109 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:01.080549 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01595a-0dce-4cfd-b7c8-45ab1422aa16 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:01.115522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3881f15-21fd-44e9-aace-e717d602439c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:01.116541 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3881f15-21fd-44e9-aace-e717d602439c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:01.117002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3881f15-21fd-44e9-aace-e717d602439c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:01.117420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3881f15-21fd-44e9-aace-e717d602439c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:01.189501 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3881f15-21fd-44e9-aace-e717d602439c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:01.191346 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3881f15-21fd-44e9-aace-e717d602439c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:01.294045 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:01.294340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 412/827] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:00 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:38:01.301562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1b7d9-8870-4168-a2cb-5a15ac83c2c0 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:01.425480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1b7d9-8870-4168-a2cb-5a15ac83c2c0 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:01.437506 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:01.448596 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c14d4-9497-4c67-9e45-b01011669651 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:01.449161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c14d4-9497-4c67-9e45-b01011669651 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:01.453314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c14d4-9497-4c67-9e45-b01011669651 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:01.453314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 413/828] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:01.456501 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef423e7-78e3-48ff-a32d-b434099b8efc None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:01.457004 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef423e7-78e3-48ff-a32d-b434099b8efc None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:01.457481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef423e7-78e3-48ff-a32d-b434099b8efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:01.465359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f920bf4-0613-4382-be0e-4e48504cbdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:01.465875 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f920bf4-0613-4382-be0e-4e48504cbdab None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:01.466163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f920bf4-0613-4382-be0e-4e48504cbdab None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:01.466441 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f920bf4-0613-4382-be0e-4e48504cbdab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:01.478375 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f920bf4-0613-4382-be0e-4e48504cbdab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:01.478861 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-7ef423e7-78e3-48ff-a32d-b434099b8efc None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:01.480653 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7ef423e7-78e3-48ff-a32d-b434099b8efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:01.481066 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f920bf4-0613-4382-be0e-4e48504cbdab None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:01.500300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-0f920bf4-0613-4382-be0e-4e48504cbdab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:01.500300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:01.500300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:01.500300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:01.500300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:01.500300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:01.500300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:01.500300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:01.500300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:01.500300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:01.500300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:01.500300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:01.500300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:01.500300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:01.500300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:01.501281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:01.501281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:01.501281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:01.501281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:01.501281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:01.501281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:01.501281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:01.501281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:01.501281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:01.501281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:01.501281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:01.501281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:01.501281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:01.501281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:01.501281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:01.501281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:01.501281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:01.502155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:01.502155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:01.502155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:01.502155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:01.502155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 416/829] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:01.509503 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f920bf4-0613-4382-be0e-4e48504cbdab None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:01.566415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 414/830] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:01.590904 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef423e7-78e3-48ff-a32d-b434099b8efc None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:01.638066 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f920bf4-0613-4382-be0e-4e48504cbdab None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:01.680679 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4618b-f168-406b-b381-f3d9671be198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:01.681281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4618b-f168-406b-b381-f3d9671be198 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:01.681664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4618b-f168-406b-b381-f3d9671be198 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:01.681948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4618b-f168-406b-b381-f3d9671be198 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:01.682682 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4618b-f168-406b-b381-f3d9671be198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:01.683022 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4618b-f168-406b-b381-f3d9671be198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:01.684506 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4618b-f168-406b-b381-f3d9671be198 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:01.697405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 417/831] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:01.703600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4618b-f168-406b-b381-f3d9671be198 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:01.712543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef423e7-78e3-48ff-a32d-b434099b8efc None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:01.735987 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:01.740326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:01.748904 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646252d-e38a-4170-bdbb-69b74794dc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:01.749706 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646252d-e38a-4170-bdbb-69b74794dc9f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:01.754124 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646252d-e38a-4170-bdbb-69b74794dc9f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:01.754124 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646252d-e38a-4170-bdbb-69b74794dc9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:01.760900 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646252d-e38a-4170-bdbb-69b74794dc9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:01.768955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-b646252d-e38a-4170-bdbb-69b74794dc9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:38:01.768955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:01.768955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:01.768955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:01.768955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:01.768955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:01.768955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:01.768955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:01.768955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:01.768955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:01.768955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:01.768955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:01.768955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:01.768955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:01.768955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:01.768955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:01.769977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:01.769977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:01.769977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:01.769977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:01.769977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:01.769977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:01.769977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:01.769977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:01.769977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:01.769977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:01.769977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:01.769977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:01.769977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:01.769977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:01.769977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:01.769977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:01.770808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:01.770808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:01.770808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:01.770808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:01.770808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:01.770808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:01.770808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:01.770808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:01.770808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:01.770808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:01.770808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:38:01.770808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:01.770808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 415/832] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:38:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:01.771986 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a7f58-1ef0-486f-913d-3c372528a3f6 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:01.772824 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a7f58-1ef0-486f-913d-3c372528a3f6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:01.773027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a7f58-1ef0-486f-913d-3c372528a3f6 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:01.774423 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 416/833] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:01.779629 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a7f58-1ef0-486f-913d-3c372528a3f6 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:01.819756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4618b-f168-406b-b381-f3d9671be198 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:01.855398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e015bf-81b5-41cb-a4f9-04bc337d423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:01.856201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e015bf-81b5-41cb-a4f9-04bc337d423d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:01.856572 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e015bf-81b5-41cb-a4f9-04bc337d423d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:01.856832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e015bf-81b5-41cb-a4f9-04bc337d423d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:01.864776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e015bf-81b5-41cb-a4f9-04bc337d423d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:01.866256 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e015bf-81b5-41cb-a4f9-04bc337d423d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:01.879752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-f4e015bf-81b5-41cb-a4f9-04bc337d423d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:01.879752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:01.879752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:01.879752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:01.879752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:01.879752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:01.879752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:01.879752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:01.879752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:01.879752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:01.879752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:01.879752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:01.879752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:38:01.879752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:38:01.879752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:38:01.880711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:38:01.880711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:01.880711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:01.880711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:01.880711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:01.880711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:01.880711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:01.880711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:01.880711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:01.880711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:01.880711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:01.880711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:01.880711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:01.880711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:01.880711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:01.880711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:01.880711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:01.882148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:38:01.882148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:38:01.882148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:38:01.882148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:38:01.882148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:38:01.882148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:38:01.882148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:01.882148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:01.882148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 418/834] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:01.882664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97af88-cd69-4955-a6c9-5f1f3be10a28 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:01.883228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97af88-cd69-4955-a6c9-5f1f3be10a28 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:01.883228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97af88-cd69-4955-a6c9-5f1f3be10a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:01.889342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a7f58-1ef0-486f-913d-3c372528a3f6 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:01.900083 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-6a97af88-cd69-4955-a6c9-5f1f3be10a28 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:01.901294 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6a97af88-cd69-4955-a6c9-5f1f3be10a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:01.928971 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5a777-ac1d-43f1-924a-9c64beb6a8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:01.930971 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5a777-ac1d-43f1-924a-9c64beb6a8b3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:01.931430 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5a777-ac1d-43f1-924a-9c64beb6a8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:01.932143 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5a777-ac1d-43f1-924a-9c64beb6a8b3 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:01.934031 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5a777-ac1d-43f1-924a-9c64beb6a8b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:01.934354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5a777-ac1d-43f1-924a-9c64beb6a8b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:01.935752 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5a777-ac1d-43f1-924a-9c64beb6a8b3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:01.951777 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 417/835] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:38:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:01.951777 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5a777-ac1d-43f1-924a-9c64beb6a8b3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:01.976150 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 419/836] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:01.977163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97af88-cd69-4955-a6c9-5f1f3be10a28 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:01.993696 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:02.014260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:02.066740 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5a777-ac1d-43f1-924a-9c64beb6a8b3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.083907 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97af88-cd69-4955-a6c9-5f1f3be10a28 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.103094 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78495f-29aa-43eb-9f30-84465a1c10d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:02.103763 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78495f-29aa-43eb-9f30-84465a1c10d0 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.104049 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78495f-29aa-43eb-9f30-84465a1c10d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.104327 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78495f-29aa-43eb-9f30-84465a1c10d0 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.105153 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78495f-29aa-43eb-9f30-84465a1c10d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:02.105464 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78495f-29aa-43eb-9f30-84465a1c10d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:02.106892 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78495f-29aa-43eb-9f30-84465a1c10d0 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:02.119024 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 418/837] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:38:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:02.119723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78495f-29aa-43eb-9f30-84465a1c10d0 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:02.124734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004c89b-7806-47c1-ae2c-ebcb7a8556f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:02.125536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004c89b-7806-47c1-ae2c-ebcb7a8556f1 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.125815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004c89b-7806-47c1-ae2c-ebcb7a8556f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.126092 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004c89b-7806-47c1-ae2c-ebcb7a8556f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.137384 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004c89b-7806-47c1-ae2c-ebcb7a8556f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:02.138768 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004c89b-7806-47c1-ae2c-ebcb7a8556f1 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:02.157221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-1004c89b-7806-47c1-ae2c-ebcb7a8556f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:02.157221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:02.157221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:02.157221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:02.157221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:02.157221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:02.157221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:02.157221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:02.157221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:02.157221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:02.157221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:02.157221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:02.157221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:02.157221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:02.157221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:02.158221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:02.158221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:02.158221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:02.158221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:02.158221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:02.158221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:02.158221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:02.158221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:02.158221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:02.158221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:02.158221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:02.158221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:02.158221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:02.158221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:02.158221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:02.158221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:02.158221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:02.159120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:02.159120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:02.159120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:02.159120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:02.159120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 420/838] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:02.159409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004c89b-7806-47c1-ae2c-ebcb7a8556f1 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:02.231260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:02.242081 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78495f-29aa-43eb-9f30-84465a1c10d0 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.254634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:02.273083 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004c89b-7806-47c1-ae2c-ebcb7a8556f1 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.280221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08580f-1b1d-47fb-a9e7-805b0b53107a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:02.281168 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08580f-1b1d-47fb-a9e7-805b0b53107a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.281450 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08580f-1b1d-47fb-a9e7-805b0b53107a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.281725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08580f-1b1d-47fb-a9e7-805b0b53107a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.282374 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08580f-1b1d-47fb-a9e7-805b0b53107a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:02.283731 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08580f-1b1d-47fb-a9e7-805b0b53107a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:02.295426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-1d08580f-1b1d-47fb-a9e7-805b0b53107a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 18:38:02.295426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:02.295426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:02.295426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:02.295426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:02.295426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:02.295426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:02.295426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:02.295426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 18:38:02.295426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:02.295426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:02.295426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:02.295426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:02.295426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:02.295426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:02.295426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:02.295426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:02.296688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:02.296688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:02.296688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:02.296688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:02.296688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:02.296688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:02.296688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:02.296688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:02.296688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:02.296688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:02.296688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:02.296688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:02.296688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:02.296688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:02.296688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:02.296688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:02.297572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:02.297572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:02.297572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:02.297572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:02.297572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:02.297572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:02.297572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:02.297572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:02.297572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:02.297572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:02.297572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:02.297572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:02.297572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 18:38:02.297572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:02.297572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 419/839] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:38:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:02.298378 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08580f-1b1d-47fb-a9e7-805b0b53107a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:02.312081 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d7516-5de9-4962-a37e-dbdf8c103d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:02.312797 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d7516-5de9-4962-a37e-dbdf8c103d41 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.313084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d7516-5de9-4962-a37e-dbdf8c103d41 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.313363 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d7516-5de9-4962-a37e-dbdf8c103d41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.314208 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d7516-5de9-4962-a37e-dbdf8c103d41 None admin] RBAC: Adding query filter params (role.id=416a52031d5d49b6a3fa0e9baa814436, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=3503ec98bea14693a17a84e686586bad) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:02.314529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d7516-5de9-4962-a37e-dbdf8c103d41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:02.315991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d7516-5de9-4962-a37e-dbdf8c103d41 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:02.322950 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 421/840] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:02 2022] GET /identity/v3/role_assignments?user.id=3503ec98bea14693a17a84e686586bad&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:02.324553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0c810-a069-44ce-a5c9-834f7d31cb0c None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.324850 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0c810-a069-44ce-a5c9-834f7d31cb0c None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.325128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0c810-a069-44ce-a5c9-834f7d31cb0c None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.332967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 422/841] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:02.332967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0c810-a069-44ce-a5c9-834f7d31cb0c None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:02.433945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08580f-1b1d-47fb-a9e7-805b0b53107a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.445926 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0c810-a069-44ce-a5c9-834f7d31cb0c None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.471884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bf823-457d-42a9-a2b0-7a8491da1c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:02.472596 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bf823-457d-42a9-a2b0-7a8491da1c81 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.472881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bf823-457d-42a9-a2b0-7a8491da1c81 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.473155 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bf823-457d-42a9-a2b0-7a8491da1c81 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.473892 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bf823-457d-42a9-a2b0-7a8491da1c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:02.474202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bf823-457d-42a9-a2b0-7a8491da1c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:02.475658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bf823-457d-42a9-a2b0-7a8491da1c81 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:02.476954 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:02.493159 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8b34d-c6c2-4ad8-b3b4-15f477388f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:02.493159 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8b34d-c6c2-4ad8-b3b4-15f477388f6b None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.493407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 420/842] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:02.493507 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8b34d-c6c2-4ad8-b3b4-15f477388f6b None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.493582 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff93c9-3146-4cc0-8e9c-077ebe8dde20 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.493662 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8b34d-c6c2-4ad8-b3b4-15f477388f6b None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.493734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff93c9-3146-4cc0-8e9c-077ebe8dde20 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.493734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff93c9-3146-4cc0-8e9c-077ebe8dde20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.493869 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8b34d-c6c2-4ad8-b3b4-15f477388f6b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:02.493869 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8b34d-c6c2-4ad8-b3b4-15f477388f6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:02.493869 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8b34d-c6c2-4ad8-b3b4-15f477388f6b None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:02.498713 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 423/843] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:38:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:02.499354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8b34d-c6c2-4ad8-b3b4-15f477388f6b None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:02.511400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-86ff93c9-3146-4cc0-8e9c-077ebe8dde20 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:02.513081 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-86ff93c9-3146-4cc0-8e9c-077ebe8dde20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:02.540873 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:02.590478 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 421/844] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:02.591228 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff93c9-3146-4cc0-8e9c-077ebe8dde20 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:02.624491 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8b34d-c6c2-4ad8-b3b4-15f477388f6b None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.660185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6afe9c-ef1f-4c7a-904a-abe3a1470ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:02.661466 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6afe9c-ef1f-4c7a-904a-abe3a1470ed9 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.661960 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6afe9c-ef1f-4c7a-904a-abe3a1470ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.662972 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6afe9c-ef1f-4c7a-904a-abe3a1470ed9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.672072 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6afe9c-ef1f-4c7a-904a-abe3a1470ed9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:02.673989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6afe9c-ef1f-4c7a-904a-abe3a1470ed9 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:02.691234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-6b6afe9c-ef1f-4c7a-904a-abe3a1470ed9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:38:02.691234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:02.691234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:02.691234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:02.691234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:02.691234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:02.691234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:02.691234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:02.691234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:02.691234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:02.691234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:02.691234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:02.691234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:38:02.691234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:38:02.691234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:38:02.691234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:38:02.692308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:02.692308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:02.692308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:38:02.692308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:02.692308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:38:02.692308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:02.692308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:02.692308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:02.692308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:02.692308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:02.692308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:02.692308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:02.692308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:02.692308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:02.692308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:02.692308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:02.692308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:02.692308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:02.693344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:02.693344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:02.693344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:38:02.693344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:38:02.693344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:38:02.693344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:38:02.693344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:38:02.693344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:38:02.693344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:38:02.693344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:02.699130 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 424/845] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Jun 16 18:38:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:02.699130 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6afe9c-ef1f-4c7a-904a-abe3a1470ed9 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:02.754396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:02.804815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6afe9c-ef1f-4c7a-904a-abe3a1470ed9 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.823510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff93c9-3146-4cc0-8e9c-077ebe8dde20 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.839430 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187378fd-9e36-44bc-b601-e2c4dbb243c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:02.840486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187378fd-9e36-44bc-b601-e2c4dbb243c3 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.840956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187378fd-9e36-44bc-b601-e2c4dbb243c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.841243 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187378fd-9e36-44bc-b601-e2c4dbb243c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.852201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187378fd-9e36-44bc-b601-e2c4dbb243c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:02.860033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-187378fd-9e36-44bc-b601-e2c4dbb243c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:02.860033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:02.860033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:02.860033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:02.860033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:02.860033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:02.860033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:02.860033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:02.860033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:02.860033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:02.860033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:02.860033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:02.860033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:02.860033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:02.860033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:02.860033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:02.861011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:02.861011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:02.861011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:02.861011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:02.861011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:02.861011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:02.861011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:02.861011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:02.861011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:02.861011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:02.861011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:02.861011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:02.861011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:02.861011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:02.861011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:02.861011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:02.861838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:02.861838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:02.861838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:02.861838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:02.861838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:02.861838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:02.861838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:02.861838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:02.861838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:02.861838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:02.861838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:02.861838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:02.861838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 425/846] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:38:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:02.862529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187378fd-9e36-44bc-b601-e2c4dbb243c3 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:02.863443 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86041dee-3935-42c8-8f32-163cac467534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:02.864112 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86041dee-3935-42c8-8f32-163cac467534 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.864395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86041dee-3935-42c8-8f32-163cac467534 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.864737 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86041dee-3935-42c8-8f32-163cac467534 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.865460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86041dee-3935-42c8-8f32-163cac467534 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:02.866334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86041dee-3935-42c8-8f32-163cac467534 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:02.868590 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86041dee-3935-42c8-8f32-163cac467534 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:02.873659 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 422/847] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:38:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:02.876473 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86041dee-3935-42c8-8f32-163cac467534 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:02.931442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:02.977096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187378fd-9e36-44bc-b601-e2c4dbb243c3 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.991702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:02.994300 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86041dee-3935-42c8-8f32-163cac467534 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:03.016613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f6746-69f7-401c-ab87-555641cc4f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:03.017483 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f6746-69f7-401c-ab87-555641cc4f98 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:03.017770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f6746-69f7-401c-ab87-555641cc4f98 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:03.018467 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f6746-69f7-401c-ab87-555641cc4f98 None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:03.019345 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f6746-69f7-401c-ab87-555641cc4f98 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:03.019655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f6746-69f7-401c-ab87-555641cc4f98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:03.021165 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f6746-69f7-401c-ab87-555641cc4f98 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:03.045048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc48d9-40f2-4284-a9ab-46a7be425cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:03.045972 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 426/848] 10.222.0.93 () {56 vars in 1149 bytes} [Thu Jun 16 18:38:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:03.048845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc48d9-40f2-4284-a9ab-46a7be425cb1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:03.049142 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc48d9-40f2-4284-a9ab-46a7be425cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:03.049420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc48d9-40f2-4284-a9ab-46a7be425cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:03.050205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc48d9-40f2-4284-a9ab-46a7be425cb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:03.050515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc48d9-40f2-4284-a9ab-46a7be425cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:03.051907 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc48d9-40f2-4284-a9ab-46a7be425cb1 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:03.054064 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f6746-69f7-401c-ab87-555641cc4f98 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:03.062894 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 423/849] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:38:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:03.068556 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc48d9-40f2-4284-a9ab-46a7be425cb1 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:03.175319 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f6746-69f7-401c-ab87-555641cc4f98 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:03.176820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:03.193060 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc48d9-40f2-4284-a9ab-46a7be425cb1 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:03.224670 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370facb1-ca0b-4fe3-b91b-94948eb25fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:03.226020 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370facb1-ca0b-4fe3-b91b-94948eb25fda None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:03.226491 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370facb1-ca0b-4fe3-b91b-94948eb25fda None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:03.226948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370facb1-ca0b-4fe3-b91b-94948eb25fda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:03.229479 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f534c80-d806-4b7f-8170-6e33070cff8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:03.230426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f534c80-d806-4b7f-8170-6e33070cff8a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:03.230778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f534c80-d806-4b7f-8170-6e33070cff8a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:03.231129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f534c80-d806-4b7f-8170-6e33070cff8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:03.242581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f534c80-d806-4b7f-8170-6e33070cff8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:03.244098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f534c80-d806-4b7f-8170-6e33070cff8a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:03.269829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-7f534c80-d806-4b7f-8170-6e33070cff8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:03.269829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:03.269829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:03.269829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:03.269829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:03.269829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:03.269829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:03.269829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:03.269829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:03.269829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:03.269829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:03.269829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:03.269829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:03.269829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:03.269829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:03.270771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:03.270771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:03.270771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:03.270771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:03.270771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:03.270771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:03.270771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:03.270771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:03.270771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:03.270771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:03.270771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:03.270771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:03.270771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:03.270771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:03.270771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:03.270771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:03.270771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:03.271721 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:03.271721 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:03.271721 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:03.271721 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:03.276038 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 424/850] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:03.276897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:03.278396 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f534c80-d806-4b7f-8170-6e33070cff8a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:03.316920 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370facb1-ca0b-4fe3-b91b-94948eb25fda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:03.319641 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370facb1-ca0b-4fe3-b91b-94948eb25fda None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:03.411746 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f534c80-d806-4b7f-8170-6e33070cff8a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:03.432969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 427/851] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:38:03.439986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370facb1-ca0b-4fe3-b91b-94948eb25fda None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:03.453885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8f3bb-a81a-425b-afe5-0140337afd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:03.454686 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8f3bb-a81a-425b-afe5-0140337afd4a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:03.455067 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8f3bb-a81a-425b-afe5-0140337afd4a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:03.455437 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8f3bb-a81a-425b-afe5-0140337afd4a None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:03.456282 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8f3bb-a81a-425b-afe5-0140337afd4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:03.456727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8f3bb-a81a-425b-afe5-0140337afd4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:03.458241 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8f3bb-a81a-425b-afe5-0140337afd4a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:03.469506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:03.473585 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 425/852] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:03.479105 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8f3bb-a81a-425b-afe5-0140337afd4a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:03.536847 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:03.570986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370facb1-ca0b-4fe3-b91b-94948eb25fda None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:03.619261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c61554-d15a-47b0-8178-137aa0c11496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:03.620310 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c61554-d15a-47b0-8178-137aa0c11496 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:03.621221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c61554-d15a-47b0-8178-137aa0c11496 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:03.621593 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c61554-d15a-47b0-8178-137aa0c11496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:03.624313 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8f3bb-a81a-425b-afe5-0140337afd4a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:03.635604 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c61554-d15a-47b0-8178-137aa0c11496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:03.637774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c61554-d15a-47b0-8178-137aa0c11496 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:03.661023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bdfdf-fe8b-4806-9bb1-07a110d16515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:03.661254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-91c61554-d15a-47b0-8178-137aa0c11496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:03.661254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:03.661254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:03.661254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:03.661254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:03.661254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:03.661254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:03.661254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:03.661254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:03.661254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:03.661254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:03.661254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:03.661254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:03.661254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:03.661254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:03.662069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:03.662069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:03.662069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:03.662069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:03.662069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:03.662069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:03.662069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:03.662069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:03.662069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:03.662069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:03.662069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:03.662069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:03.662069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:03.662069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:03.662069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:03.662069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:03.662069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:03.663427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:03.663427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:03.663427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:03.663427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:03.663427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 428/853] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:03.664859 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bdfdf-fe8b-4806-9bb1-07a110d16515 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:03.665393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bdfdf-fe8b-4806-9bb1-07a110d16515 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:03.665865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bdfdf-fe8b-4806-9bb1-07a110d16515 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:03.667843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c61554-d15a-47b0-8178-137aa0c11496 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:03.676700 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bdfdf-fe8b-4806-9bb1-07a110d16515 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:03.678615 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bdfdf-fe8b-4806-9bb1-07a110d16515 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:03.701098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-096bdfdf-fe8b-4806-9bb1-07a110d16515 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:38:03.701098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:03.701098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:03.701098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:03.701098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:03.701098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:03.701098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:03.701098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:03.701098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:03.701098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:03.701098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:03.701098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:03.701098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:38:03.701098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:38:03.701098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:38:03.701098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:38:03.702149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:03.702149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:03.702149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:38:03.702149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:03.702149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:38:03.702149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:03.702149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:03.702149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:03.702149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:03.702149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:03.702149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:03.702149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:03.702149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:03.702149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:03.702149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:03.702149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:03.702149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:03.702149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:03.703136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:03.703136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:03.703136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:38:03.703136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:38:03.703136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:38:03.703136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:38:03.703136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:38:03.703136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:38:03.703136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:38:03.703136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:03.710751 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 426/854] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:38:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:03.713072 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bdfdf-fe8b-4806-9bb1-07a110d16515 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:03.790261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:03.791400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c61554-d15a-47b0-8178-137aa0c11496 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:03.820775 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:03.834330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d270cb2-2d2f-4519-8b59-8b10b641e967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:03.835288 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d270cb2-2d2f-4519-8b59-8b10b641e967 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:03.835743 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d270cb2-2d2f-4519-8b59-8b10b641e967 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:03.836184 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d270cb2-2d2f-4519-8b59-8b10b641e967 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:03.837189 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bdfdf-fe8b-4806-9bb1-07a110d16515 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:03.837722 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d270cb2-2d2f-4519-8b59-8b10b641e967 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:03.838233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d270cb2-2d2f-4519-8b59-8b10b641e967 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:03.839996 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d270cb2-2d2f-4519-8b59-8b10b641e967 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:03.853195 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 429/855] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:03.858188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d270cb2-2d2f-4519-8b59-8b10b641e967 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:03.882181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac944b-cb02-4df1-bde5-676b917bef2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:03.882918 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac944b-cb02-4df1-bde5-676b917bef2f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:03.883204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac944b-cb02-4df1-bde5-676b917bef2f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:03.883714 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac944b-cb02-4df1-bde5-676b917bef2f None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:03.884502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac944b-cb02-4df1-bde5-676b917bef2f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:03.884824 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac944b-cb02-4df1-bde5-676b917bef2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:03.886303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac944b-cb02-4df1-bde5-676b917bef2f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:03.908693 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 427/856] 10.222.0.93 () {56 vars in 1135 bytes} [Thu Jun 16 18:38:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:03.911026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac944b-cb02-4df1-bde5-676b917bef2f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:03.983094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d270cb2-2d2f-4519-8b59-8b10b641e967 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:04.018039 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac944b-cb02-4df1-bde5-676b917bef2f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:04.027328 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1964a4-29dd-4b28-934d-6c52e9c07c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:04.028378 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1964a4-29dd-4b28-934d-6c52e9c07c22 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:04.028904 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1964a4-29dd-4b28-934d-6c52e9c07c22 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:04.029692 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1964a4-29dd-4b28-934d-6c52e9c07c22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:04.038800 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:04.039233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1964a4-29dd-4b28-934d-6c52e9c07c22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:04.041181 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1964a4-29dd-4b28-934d-6c52e9c07c22 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:04.058064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e623e22-d688-4f36-a187-b9d4699f133a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:04.059128 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e623e22-d688-4f36-a187-b9d4699f133a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:04.059364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-aa1964a4-29dd-4b28-934d-6c52e9c07c22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:04.059364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:04.059364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:04.059364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:04.059364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:04.059364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:04.059364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:04.059364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:04.059364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:04.059364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:04.059364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:04.059364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:04.059364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:38:04.059364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:38:04.059364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:38:04.060460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:38:04.060460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:04.060460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:04.060460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:04.060460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:04.060460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:04.060460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:04.060460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:04.060460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:04.060460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:04.060460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:04.060460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:04.060460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:04.060460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:04.060460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:04.060460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:04.060460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:04.061635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:38:04.061635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:38:04.061635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:38:04.061635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:38:04.061635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:38:04.061635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:38:04.061635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:04.061635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:04.062742 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e623e22-d688-4f36-a187-b9d4699f133a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:04.063230 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e623e22-d688-4f36-a187-b9d4699f133a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:04.067348 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 430/857] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:04.068580 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1964a4-29dd-4b28-934d-6c52e9c07c22 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:04.125435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:04.144015 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e623e22-d688-4f36-a187-b9d4699f133a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:04.145295 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e623e22-d688-4f36-a187-b9d4699f133a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:04.202942 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1964a4-29dd-4b28-934d-6c52e9c07c22 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:04.250066 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d2c4c-e8ed-4e7c-8f9d-228932e0a438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:04.251142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d2c4c-e8ed-4e7c-8f9d-228932e0a438 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:04.251639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d2c4c-e8ed-4e7c-8f9d-228932e0a438 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:04.252124 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d2c4c-e8ed-4e7c-8f9d-228932e0a438 None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:04.253160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d2c4c-e8ed-4e7c-8f9d-228932e0a438 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:04.253681 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d2c4c-e8ed-4e7c-8f9d-228932e0a438 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:04.255348 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d2c4c-e8ed-4e7c-8f9d-228932e0a438 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:04.256678 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 428/858] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:38:04.258165 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e623e22-d688-4f36-a187-b9d4699f133a None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:04.278359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 431/859] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:38:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:04.279214 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d2c4c-e8ed-4e7c-8f9d-228932e0a438 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:04.308908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:04.371891 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e623e22-d688-4f36-a187-b9d4699f133a None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:04.385522 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d2c4c-e8ed-4e7c-8f9d-228932e0a438 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:04.387610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:04.408358 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7a78d-bb81-4035-a318-0493ebbfa52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:04.409551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7a78d-bb81-4035-a318-0493ebbfa52e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:04.409956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7a78d-bb81-4035-a318-0493ebbfa52e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:04.410344 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7a78d-bb81-4035-a318-0493ebbfa52e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:04.421637 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7a78d-bb81-4035-a318-0493ebbfa52e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:04.423174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7a78d-bb81-4035-a318-0493ebbfa52e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:04.423728 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c075811-83e1-4f5b-9193-1f150bfe4f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:04.424718 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c075811-83e1-4f5b-9193-1f150bfe4f10 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:04.425187 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c075811-83e1-4f5b-9193-1f150bfe4f10 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:04.425648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c075811-83e1-4f5b-9193-1f150bfe4f10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:04.426908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c075811-83e1-4f5b-9193-1f150bfe4f10 None admin] RBAC: Adding query filter params (role.id=06f67743387f476cade2623aa7e5c5d2, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=1eefe0d721484433b72afca03a2c1bb6) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:04.427911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c075811-83e1-4f5b-9193-1f150bfe4f10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:04.429564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c075811-83e1-4f5b-9193-1f150bfe4f10 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:04.440780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 432/860] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:04 2022] GET /identity/v3/role_assignments?user.id=1eefe0d721484433b72afca03a2c1bb6&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=06f67743387f476cade2623aa7e5c5d2 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:04.441762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-3af7a78d-bb81-4035-a318-0493ebbfa52e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:04.441762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:04.441762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:04.441762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:04.441762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:04.441762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:04.441762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:04.441762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:04.441762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:04.441762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:04.441762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:04.441762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:04.441762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:04.441762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:04.441762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:04.442749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:04.442749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:04.442749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:04.442749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:04.442749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:04.442749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:04.442749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:04.442749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:04.442749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:04.442749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:04.442749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:04.442749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:04.442749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:04.442749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:04.442749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:04.442749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:04.442749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:04.444209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:04.444209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:04.444209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:04.444209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:04.448490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 429/861] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:04.449707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c075811-83e1-4f5b-9193-1f150bfe4f10 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:04.544734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d491fe-b010-4c1c-941e-b7945e7465ee None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:04.545011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d491fe-b010-4c1c-941e-b7945e7465ee None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:04.545289 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d491fe-b010-4c1c-941e-b7945e7465ee None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:04.546942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 430/862] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:38:04.552330 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a59ed-f85c-4a81-a0c5-5b97529e342d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:04.553211 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a59ed-f85c-4a81-a0c5-5b97529e342d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:04.553499 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a59ed-f85c-4a81-a0c5-5b97529e342d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:04.571596 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c075811-83e1-4f5b-9193-1f150bfe4f10 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:04.573414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-680a59ed-f85c-4a81-a0c5-5b97529e342d None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:04.575986 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-680a59ed-f85c-4a81-a0c5-5b97529e342d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:04.620045 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcdf75-f1d5-4d31-bc31-f0286b22f861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:04.621015 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcdf75-f1d5-4d31-bc31-f0286b22f861 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:04.622229 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcdf75-f1d5-4d31-bc31-f0286b22f861 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:04.622518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcdf75-f1d5-4d31-bc31-f0286b22f861 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:04.623250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcdf75-f1d5-4d31-bc31-f0286b22f861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:04.623563 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcdf75-f1d5-4d31-bc31-f0286b22f861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:04.624978 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcdf75-f1d5-4d31-bc31-f0286b22f861 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:04.641912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 433/863] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:04.648017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcdf75-f1d5-4d31-bc31-f0286b22f861 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:04.658777 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:04.666471 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 431/864] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:04.685791 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:04.690093 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a59ed-f85c-4a81-a0c5-5b97529e342d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:04.778910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcdf75-f1d5-4d31-bc31-f0286b22f861 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:04.814250 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a59ed-f85c-4a81-a0c5-5b97529e342d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:04.814713 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26218a-a326-4513-b098-a86bc25c81d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:04.815587 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26218a-a326-4513-b098-a86bc25c81d3 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:04.815942 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26218a-a326-4513-b098-a86bc25c81d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:04.816306 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26218a-a326-4513-b098-a86bc25c81d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:04.824010 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26218a-a326-4513-b098-a86bc25c81d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:04.825522 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26218a-a326-4513-b098-a86bc25c81d3 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:04.839918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-4a26218a-a326-4513-b098-a86bc25c81d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:04.839918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:04.839918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:04.839918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:04.839918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:04.839918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:04.839918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:04.839918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:04.839918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:04.839918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:04.839918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:04.839918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:04.839918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:38:04.839918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:38:04.839918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:38:04.840910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:38:04.840910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:04.840910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:04.840910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:04.840910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:04.840910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:04.840910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:04.840910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:04.840910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:04.840910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:04.840910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:04.840910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:04.840910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:04.840910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:04.840910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:04.840910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:04.840910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:04.841802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:38:04.841802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:38:04.841802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:38:04.841802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:38:04.841802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:38:04.841802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:38:04.841802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:04.841802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:04.841802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 434/865] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:04.847164 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26218a-a326-4513-b098-a86bc25c81d3 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:04.855814 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da32cb0-05a3-446a-8007-73ccc44823e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:04.856989 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da32cb0-05a3-446a-8007-73ccc44823e3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:04.857562 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da32cb0-05a3-446a-8007-73ccc44823e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:04.858012 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da32cb0-05a3-446a-8007-73ccc44823e3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:04.858886 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da32cb0-05a3-446a-8007-73ccc44823e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:04.860579 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da32cb0-05a3-446a-8007-73ccc44823e3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:04.875347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-3da32cb0-05a3-446a-8007-73ccc44823e3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 18:38:04.875347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:04.875347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:04.875347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:04.875347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:04.875347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:04.875347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:04.875347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:04.875347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 18:38:04.875347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:04.875347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:04.875347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:04.875347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:04.875347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:04.875347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:04.875347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:04.876310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:04.876310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:04.876310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:04.876310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:04.876310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:04.876310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:04.876310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:04.876310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:04.876310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:04.876310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:04.876310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:04.876310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:04.876310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:04.876310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:04.876310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:04.876310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:04.877191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:04.877191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:04.877191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:04.877191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:04.877191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:04.877191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:04.877191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:04.877191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:04.877191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:04.877191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:04.877191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:04.877191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:04.877191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:04.877191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 18:38:04.877191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:04.879822 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 432/866] 10.222.0.93 () {56 vars in 1132 bytes} [Thu Jun 16 18:38:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:04.885729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da32cb0-05a3-446a-8007-73ccc44823e3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:04.938967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:04.954520 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:04.954713 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26218a-a326-4513-b098-a86bc25c81d3 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:04.990853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba74dd-7c47-4f7e-86c5-f2bd46cd7f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:04.991317 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba74dd-7c47-4f7e-86c5-f2bd46cd7f9a None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:04.991606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba74dd-7c47-4f7e-86c5-f2bd46cd7f9a None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:04.991886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba74dd-7c47-4f7e-86c5-f2bd46cd7f9a None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:04.992721 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba74dd-7c47-4f7e-86c5-f2bd46cd7f9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:04.993034 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba74dd-7c47-4f7e-86c5-f2bd46cd7f9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:04.994482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba74dd-7c47-4f7e-86c5-f2bd46cd7f9a None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:04.998787 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da32cb0-05a3-446a-8007-73ccc44823e3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:05.012188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 435/867] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:38:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:05.013322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba74dd-7c47-4f7e-86c5-f2bd46cd7f9a None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:05.038218 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c17f45-86c7-4ae8-96da-725fda976f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:05.039237 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c17f45-86c7-4ae8-96da-725fda976f74 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:05.039796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c17f45-86c7-4ae8-96da-725fda976f74 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:05.040255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c17f45-86c7-4ae8-96da-725fda976f74 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:05.041219 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c17f45-86c7-4ae8-96da-725fda976f74 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:05.041703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c17f45-86c7-4ae8-96da-725fda976f74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:05.043397 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c17f45-86c7-4ae8-96da-725fda976f74 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:05.053443 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 433/868] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Jun 16 18:38:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:05.054620 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c17f45-86c7-4ae8-96da-725fda976f74 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:05.122598 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba74dd-7c47-4f7e-86c5-f2bd46cd7f9a None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:05.158503 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817daf7-886f-4a76-931b-08c2a8112dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:05.159278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817daf7-886f-4a76-931b-08c2a8112dfd None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:05.159595 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817daf7-886f-4a76-931b-08c2a8112dfd None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:05.160074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817daf7-886f-4a76-931b-08c2a8112dfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:05.160917 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817daf7-886f-4a76-931b-08c2a8112dfd None admin] RBAC: Adding query filter params (role.id=416a52031d5d49b6a3fa0e9baa814436, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=b45db002889846eda5b2a3e6917fcbe1) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:05.161176 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817daf7-886f-4a76-931b-08c2a8112dfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:05.163364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817daf7-886f-4a76-931b-08c2a8112dfd None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:05.169004 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c17f45-86c7-4ae8-96da-725fda976f74 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:05.177049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 436/869] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:05 2022] GET /identity/v3/role_assignments?user.id=b45db002889846eda5b2a3e6917fcbe1&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:05.177049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266ce44-0873-43cc-8f9e-d0f1bc9cf8bd None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:05.177049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266ce44-0873-43cc-8f9e-d0f1bc9cf8bd None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:05.177049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266ce44-0873-43cc-8f9e-d0f1bc9cf8bd None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:05.177049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 437/870] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:05.178817 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20a038-faa7-4ac1-abd7-3d44f110232b None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:05.179114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20a038-faa7-4ac1-abd7-3d44f110232b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:05.179395 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20a038-faa7-4ac1-abd7-3d44f110232b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:05.197549 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-ca20a038-faa7-4ac1-abd7-3d44f110232b None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:05.198816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-ca20a038-faa7-4ac1-abd7-3d44f110232b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:05.202045 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:05.207981 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:05.219057 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa19862-d4a8-47a2-98ce-3576ceed1271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:05.220003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa19862-d4a8-47a2-98ce-3576ceed1271 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:05.220822 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa19862-d4a8-47a2-98ce-3576ceed1271 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:05.220822 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa19862-d4a8-47a2-98ce-3576ceed1271 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:05.221647 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa19862-d4a8-47a2-98ce-3576ceed1271 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:05.222686 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa19862-d4a8-47a2-98ce-3576ceed1271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:05.225181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa19862-d4a8-47a2-98ce-3576ceed1271 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:05.232609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 434/871] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Jun 16 18:38:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:05.285215 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 438/872] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:05.309265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa19862-d4a8-47a2-98ce-3576ceed1271 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:05.426999 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa19862-d4a8-47a2-98ce-3576ceed1271 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:05.464565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8302874-3996-4827-af1f-cda05dfe1496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:05.465235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8302874-3996-4827-af1f-cda05dfe1496 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:05.465523 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8302874-3996-4827-af1f-cda05dfe1496 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:05.465803 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8302874-3996-4827-af1f-cda05dfe1496 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:05.466535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8302874-3996-4827-af1f-cda05dfe1496 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:05.467900 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8302874-3996-4827-af1f-cda05dfe1496 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:05.548604 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 435/873] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Jun 16 18:38:05 2022] POST /identity/v3/services => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:06.756369 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cad2e-fa10-4367-8be1-660d3532f27e None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:06.756945 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cad2e-fa10-4367-8be1-660d3532f27e None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:06.756945 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cad2e-fa10-4367-8be1-660d3532f27e None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:06.758582 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 439/874] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:06.763987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66464c3-4e8e-4d0e-a3d5-9b97becf520f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:06.764408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66464c3-4e8e-4d0e-a3d5-9b97becf520f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:06.764611 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66464c3-4e8e-4d0e-a3d5-9b97becf520f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:06.782511 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a66464c3-4e8e-4d0e-a3d5-9b97becf520f None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:06.783689 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a66464c3-4e8e-4d0e-a3d5-9b97becf520f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:06.831243 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:06.868545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 436/875] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:06 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:06.887006 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cad2e-fa10-4367-8be1-660d3532f27e None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:06.995713 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cad2e-fa10-4367-8be1-660d3532f27e None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:07.032356 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8af6a0-7ba5-44d1-b2e4-0803b87a5331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:07.033527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8af6a0-7ba5-44d1-b2e4-0803b87a5331 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:07.034008 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8af6a0-7ba5-44d1-b2e4-0803b87a5331 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:07.034483 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8af6a0-7ba5-44d1-b2e4-0803b87a5331 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:07.042739 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:07.048983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8af6a0-7ba5-44d1-b2e4-0803b87a5331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:07.057912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-6d8af6a0-7ba5-44d1-b2e4-0803b87a5331 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:07.057912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:07.057912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:07.057912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:07.057912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:07.057912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:07.057912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:07.057912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:07.057912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:07.057912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:07.057912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:07.057912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:07.057912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:07.057912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:07.057912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:07.057912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:07.058918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:07.058918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:07.058918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:07.058918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:07.058918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:07.058918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:07.058918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:07.058918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:07.058918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:07.058918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:07.058918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:07.058918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:07.058918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:07.058918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:07.058918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:07.058918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:07.059836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:07.059836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:07.059836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:07.059836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:07.059836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:07.059836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:07.059836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:07.059836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:07.059836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:07.059836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:07.059836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:07.059836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:07.062280 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 440/876] 10.222.0.93 () {56 vars in 1120 bytes} [Thu Jun 16 18:38:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:07.068607 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66464c3-4e8e-4d0e-a3d5-9b97becf520f None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:07.173293 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66464c3-4e8e-4d0e-a3d5-9b97becf520f None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:07.208007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f007b-cbac-4db1-b44d-5396bc0b55ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:07.209260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f007b-cbac-4db1-b44d-5396bc0b55ce None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:07.209542 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f007b-cbac-4db1-b44d-5396bc0b55ce None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:07.209819 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f007b-cbac-4db1-b44d-5396bc0b55ce None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:07.210563 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f007b-cbac-4db1-b44d-5396bc0b55ce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:07.210872 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f007b-cbac-4db1-b44d-5396bc0b55ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:07.212511 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f007b-cbac-4db1-b44d-5396bc0b55ce None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:07.221535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 437/877] 10.222.0.93 () {56 vars in 1115 bytes} [Thu Jun 16 18:38:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:07.227028 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8af6a0-7ba5-44d1-b2e4-0803b87a5331 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:07.345248 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8af6a0-7ba5-44d1-b2e4-0803b87a5331 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:07.381642 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bd2b4-563d-492e-bcac-48c6deb8ce7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:07.382799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bd2b4-563d-492e-bcac-48c6deb8ce7b None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:07.383297 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bd2b4-563d-492e-bcac-48c6deb8ce7b None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:07.383788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bd2b4-563d-492e-bcac-48c6deb8ce7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:07.397044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34bd2b4-563d-492e-bcac-48c6deb8ce7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:07.398866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34bd2b4-563d-492e-bcac-48c6deb8ce7b None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:07.418494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-d34bd2b4-563d-492e-bcac-48c6deb8ce7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:07.418494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:07.418494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:07.418494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:07.418494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:07.418494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:07.418494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:07.418494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:07.418494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:07.418494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:07.418494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:07.418494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:07.418494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:07.418494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:07.418494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:07.419497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:07.419497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:07.419497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:07.419497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:07.419497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:07.419497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:07.419497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:07.419497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:07.419497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:07.419497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:07.419497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:07.419497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:07.419497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:07.419497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:07.419497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:07.419497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:07.419497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:07.420400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:07.420400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:07.420400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:07.420400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:07.422588 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 441/878] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:07.428889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f007b-cbac-4db1-b44d-5396bc0b55ce None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:07.460148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070790c-7f94-403f-ac7a-606da9aeadb1 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:07.460809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070790c-7f94-403f-ac7a-606da9aeadb1 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:07.461517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070790c-7f94-403f-ac7a-606da9aeadb1 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:07.463490 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 442/879] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:07.471020 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae19555-9971-492a-a8dc-fec2aa8790e4 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:07.471304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae19555-9971-492a-a8dc-fec2aa8790e4 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:07.471583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae19555-9971-492a-a8dc-fec2aa8790e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:07.477012 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:07.492707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-cae19555-9971-492a-a8dc-fec2aa8790e4 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:07.494591 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-cae19555-9971-492a-a8dc-fec2aa8790e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:07.540959 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f007b-cbac-4db1-b44d-5396bc0b55ce None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:07.546537 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:07.571971 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 443/880] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:07 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:07.573869 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da8f7b-8e62-49a3-97c0-fee0e28125cb None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:07.574155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da8f7b-8e62-49a3-97c0-fee0e28125cb None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:07.574431 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da8f7b-8e62-49a3-97c0-fee0e28125cb None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:07.575855 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 444/881] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:07.581106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3969f-00d3-4b41-8b52-472dee19a10b None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:07.581396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3969f-00d3-4b41-8b52-472dee19a10b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:07.581674 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3969f-00d3-4b41-8b52-472dee19a10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:07.593346 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4461617-cd80-48a5-a2c7-249c134d58f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:07.594945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4461617-cd80-48a5-a2c7-249c134d58f2 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:07.595238 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4461617-cd80-48a5-a2c7-249c134d58f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:07.595573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4461617-cd80-48a5-a2c7-249c134d58f2 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:07.596426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4461617-cd80-48a5-a2c7-249c134d58f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:07.596762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4461617-cd80-48a5-a2c7-249c134d58f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:07.598139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4461617-cd80-48a5-a2c7-249c134d58f2 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:07.600297 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-05b3969f-00d3-4b41-8b52-472dee19a10b None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:07.601527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-05b3969f-00d3-4b41-8b52-472dee19a10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:07.610759 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 438/882] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:07.611480 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4461617-cd80-48a5-a2c7-249c134d58f2 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:07.696937 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 445/883] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:07 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:07.697619 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3969f-00d3-4b41-8b52-472dee19a10b None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:07.750510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:07.754515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4461617-cd80-48a5-a2c7-249c134d58f2 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:07.793690 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d91c8-ab67-4bee-ade0-01d611ef9e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:07.794374 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d91c8-ab67-4bee-ade0-01d611ef9e4e None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:07.794658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d91c8-ab67-4bee-ade0-01d611ef9e4e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:07.794930 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d91c8-ab67-4bee-ade0-01d611ef9e4e None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:07.795648 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d91c8-ab67-4bee-ade0-01d611ef9e4e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:07.797042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d91c8-ab67-4bee-ade0-01d611ef9e4e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:07.804311 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3969f-00d3-4b41-8b52-472dee19a10b None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:07.817497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:07.838144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef0406-faf1-4015-ba48-e1b719f42e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:07.838955 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef0406-faf1-4015-ba48-e1b719f42e10 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:07.839241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef0406-faf1-4015-ba48-e1b719f42e10 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:07.839518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef0406-faf1-4015-ba48-e1b719f42e10 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:07.846456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef0406-faf1-4015-ba48-e1b719f42e10 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:07.847897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef0406-faf1-4015-ba48-e1b719f42e10 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:07.863194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-55ef0406-faf1-4015-ba48-e1b719f42e10 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:38:07.863194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:07.863194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:07.863194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:07.863194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:07.863194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:07.863194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:07.863194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:07.863194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:07.863194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:07.863194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:07.863194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:07.863194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:38:07.863194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:38:07.863194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:38:07.863194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:38:07.865842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:07.865842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:07.865842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:38:07.865842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:07.865842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:38:07.865842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:07.865842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:07.865842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:07.865842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:07.865842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:07.865842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:07.865842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:07.865842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:07.865842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:07.865842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:07.865842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:07.865842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:07.865842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:07.866832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:07.866832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:07.866832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:38:07.866832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:38:07.866832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:38:07.866832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:38:07.866832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:38:07.866832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:38:07.866832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:38:07.866832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:07.866832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 446/884] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Jun 16 18:38:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:07.866832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef0406-faf1-4015-ba48-e1b719f42e10 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:07.889583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 439/885] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Jun 16 18:38:07 2022] POST /identity/v3/services => generated 269 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:07.890953 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f57878-dcf2-4702-8e89-6e8706233cea None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:07.891248 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f57878-dcf2-4702-8e89-6e8706233cea None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:07.891620 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f57878-dcf2-4702-8e89-6e8706233cea None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:07.893036 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 440/886] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:07.893614 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f57878-dcf2-4702-8e89-6e8706233cea None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:07.989500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef0406-faf1-4015-ba48-e1b719f42e10 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:08.023197 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f57878-dcf2-4702-8e89-6e8706233cea None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:08.027835 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554242b8-4690-499e-baa4-2be9925b2fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:08.028752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554242b8-4690-499e-baa4-2be9925b2fde None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.029040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554242b8-4690-499e-baa4-2be9925b2fde None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.029318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554242b8-4690-499e-baa4-2be9925b2fde None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.029992 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554242b8-4690-499e-baa4-2be9925b2fde None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:08.031511 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554242b8-4690-499e-baa4-2be9925b2fde None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:08.044841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-554242b8-4690-499e-baa4-2be9925b2fde None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:08.044841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:08.044841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:08.044841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:08.044841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:08.044841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:08.044841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:08.044841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:08.044841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:08.044841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:08.044841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:08.044841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:08.044841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:08.044841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:08.044841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:08.044841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:08.044841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:08.045973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:08.045973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:08.045973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:08.045973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:08.045973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:08.045973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:08.045973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:08.045973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:08.045973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:08.045973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:08.045973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:08.045973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:08.045973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:08.045973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:08.045973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:08.045973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:08.046849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:08.046849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:08.046849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:08.046849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:08.046849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:08.046849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:08.046849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:08.046849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:08.046849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:08.046849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:08.046849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:08.046849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:08.046849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:08.046849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:08.046849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 447/887] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Jun 16 18:38:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:08.047670 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3d2e1-0d69-4b2e-9b7d-d182acf6c890 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.047670 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3d2e1-0d69-4b2e-9b7d-d182acf6c890 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.048359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3d2e1-0d69-4b2e-9b7d-d182acf6c890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.066630 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-e4b3d2e1-0d69-4b2e-9b7d-d182acf6c890 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:08.066839 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fb6e2-1e40-4006-b755-d2b92dfd9547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:08.067436 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fb6e2-1e40-4006-b755-d2b92dfd9547 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.067727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fb6e2-1e40-4006-b755-d2b92dfd9547 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.067871 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-e4b3d2e1-0d69-4b2e-9b7d-d182acf6c890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:08.068004 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fb6e2-1e40-4006-b755-d2b92dfd9547 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.068888 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fb6e2-1e40-4006-b755-d2b92dfd9547 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:08.069846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fb6e2-1e40-4006-b755-d2b92dfd9547 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:08.070943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fb6e2-1e40-4006-b755-d2b92dfd9547 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:08.090715 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 441/888] 10.222.0.93 () {56 vars in 1149 bytes} [Thu Jun 16 18:38:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:08.091553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fb6e2-1e40-4006-b755-d2b92dfd9547 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:08.103276 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:08.107459 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:08.142253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 448/889] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:08.142935 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3d2e1-0d69-4b2e-9b7d-d182acf6c890 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:08.197502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fb6e2-1e40-4006-b755-d2b92dfd9547 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:08.234268 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757272e0-ea6b-4f86-a70c-b94b15f5303f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:08.234942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757272e0-ea6b-4f86-a70c-b94b15f5303f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.235230 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757272e0-ea6b-4f86-a70c-b94b15f5303f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.235513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757272e0-ea6b-4f86-a70c-b94b15f5303f None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.236226 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757272e0-ea6b-4f86-a70c-b94b15f5303f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:08.236567 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757272e0-ea6b-4f86-a70c-b94b15f5303f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:08.237938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757272e0-ea6b-4f86-a70c-b94b15f5303f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:08.243838 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 442/890] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Jun 16 18:38:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:08.249617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757272e0-ea6b-4f86-a70c-b94b15f5303f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:08.273751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3d2e1-0d69-4b2e-9b7d-d182acf6c890 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:08.310850 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0edad1-afe7-44e9-98b7-98d664ff4859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:08.311796 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0edad1-afe7-44e9-98b7-98d664ff4859 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.312269 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0edad1-afe7-44e9-98b7-98d664ff4859 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.312596 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0edad1-afe7-44e9-98b7-98d664ff4859 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.334817 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:08.349088 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:08.357334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757272e0-ea6b-4f86-a70c-b94b15f5303f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:08.386253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0edad1-afe7-44e9-98b7-98d664ff4859 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:08.387725 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0edad1-afe7-44e9-98b7-98d664ff4859 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:08.396706 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba16e3b-4bf5-42bd-bbe4-26a75ec8480f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:08.401081 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba16e3b-4bf5-42bd-bbe4-26a75ec8480f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.401081 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba16e3b-4bf5-42bd-bbe4-26a75ec8480f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.401081 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba16e3b-4bf5-42bd-bbe4-26a75ec8480f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.401081 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba16e3b-4bf5-42bd-bbe4-26a75ec8480f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:08.401081 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba16e3b-4bf5-42bd-bbe4-26a75ec8480f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:08.412537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-0ba16e3b-4bf5-42bd-bbe4-26a75ec8480f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 18:38:08.412537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:08.412537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:08.412537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:08.412537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:08.412537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:08.412537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:08.412537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:08.412537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 18:38:08.412537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:08.412537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:08.412537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:08.412537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:08.412537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:08.412537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:08.412537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:08.412537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:08.414502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:08.414502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:08.414502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:08.414502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:08.414502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:08.414502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:08.414502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:08.414502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:08.414502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:08.414502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:08.414502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:08.414502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:08.414502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:08.414502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:08.414502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:08.414502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:08.416202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:08.416202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:08.416202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:08.416202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:08.416202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:08.416202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:08.416202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:08.416202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:08.416202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:08.416202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:08.416202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:08.416202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:08.416202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 18:38:08.416202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:08.416202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 443/891] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:38:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:08.418289 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba16e3b-4bf5-42bd-bbe4-26a75ec8480f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:08.500356 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 449/892] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:08 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:38:08.501222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0edad1-afe7-44e9-98b7-98d664ff4859 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:08.532576 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba16e3b-4bf5-42bd-bbe4-26a75ec8480f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:08.567070 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:08.572513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65784c7e-d6be-46b9-919e-58cc0bad1863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:08.572513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65784c7e-d6be-46b9-919e-58cc0bad1863 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.572868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65784c7e-d6be-46b9-919e-58cc0bad1863 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.573089 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65784c7e-d6be-46b9-919e-58cc0bad1863 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.573790 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65784c7e-d6be-46b9-919e-58cc0bad1863 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:08.574100 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65784c7e-d6be-46b9-919e-58cc0bad1863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:08.575462 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65784c7e-d6be-46b9-919e-58cc0bad1863 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:08.582872 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 444/893] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Jun 16 18:38:08 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:08.588324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65784c7e-d6be-46b9-919e-58cc0bad1863 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:08.599994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:08.625606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0edad1-afe7-44e9-98b7-98d664ff4859 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:08.677274 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b2145-e86e-4336-b599-4b5b02691d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:08.678387 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b2145-e86e-4336-b599-4b5b02691d00 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.678894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b2145-e86e-4336-b599-4b5b02691d00 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.679367 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b2145-e86e-4336-b599-4b5b02691d00 None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.680292 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b2145-e86e-4336-b599-4b5b02691d00 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:08.680832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b2145-e86e-4336-b599-4b5b02691d00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:08.683247 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b2145-e86e-4336-b599-4b5b02691d00 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:08.689743 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 450/894] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:38:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:08.695086 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b2145-e86e-4336-b599-4b5b02691d00 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:08.723307 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65784c7e-d6be-46b9-919e-58cc0bad1863 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:08.788360 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe92ed6-c8d2-41c1-ab75-9928403f2fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:08.789210 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe92ed6-c8d2-41c1-ab75-9928403f2fe9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.789507 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe92ed6-c8d2-41c1-ab75-9928403f2fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.789787 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe92ed6-c8d2-41c1-ab75-9928403f2fe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.802496 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe92ed6-c8d2-41c1-ab75-9928403f2fe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:08.804091 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe92ed6-c8d2-41c1-ab75-9928403f2fe9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:08.822973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b2145-e86e-4336-b599-4b5b02691d00 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:08.825675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-0fe92ed6-c8d2-41c1-ab75-9928403f2fe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:08.825675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:08.825675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:08.825675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:08.825675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:08.825675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:08.825675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:08.825675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:08.825675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:08.825675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:08.825675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:08.825675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:08.825675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:08.825675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:08.825675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:08.826539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:08.826539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:08.826539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:08.826539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:08.826539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:08.826539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:08.826539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:08.826539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:08.826539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:08.826539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:08.826539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:08.826539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:08.826539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:08.826539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:08.826539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:08.826539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:08.826539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:08.827427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:08.827427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:08.827427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:08.827427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:08.827647 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 445/895] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:08.833936 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe92ed6-c8d2-41c1-ab75-9928403f2fe9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:08.859046 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:08.865116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74635de2-6b4c-4f96-8500-0eb79275f02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:08.866063 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74635de2-6b4c-4f96-8500-0eb79275f02c None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.866510 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74635de2-6b4c-4f96-8500-0eb79275f02c None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.866952 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74635de2-6b4c-4f96-8500-0eb79275f02c None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.867910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74635de2-6b4c-4f96-8500-0eb79275f02c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:08.868360 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74635de2-6b4c-4f96-8500-0eb79275f02c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:08.869933 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74635de2-6b4c-4f96-8500-0eb79275f02c None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:08.880634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 451/896] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:38:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:08.881487 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74635de2-6b4c-4f96-8500-0eb79275f02c None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:08.907177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:08.963664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe92ed6-c8d2-41c1-ab75-9928403f2fe9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:08.991401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74635de2-6b4c-4f96-8500-0eb79275f02c None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:09.010057 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf0f86-9c91-4a8e-a7d1-519758c6e128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:09.010968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf0f86-9c91-4a8e-a7d1-519758c6e128 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:09.011519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf0f86-9c91-4a8e-a7d1-519758c6e128 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:09.011947 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf0f86-9c91-4a8e-a7d1-519758c6e128 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:09.013465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf0f86-9c91-4a8e-a7d1-519758c6e128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:09.014244 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf0f86-9c91-4a8e-a7d1-519758c6e128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:09.016807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf0f86-9c91-4a8e-a7d1-519758c6e128 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:09.031538 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387e394-8aa0-401d-8bf0-987148016809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:09.032356 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387e394-8aa0-401d-8bf0-987148016809 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:09.032751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387e394-8aa0-401d-8bf0-987148016809 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:09.033093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387e394-8aa0-401d-8bf0-987148016809 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:09.033957 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387e394-8aa0-401d-8bf0-987148016809 None admin] RBAC: Adding query filter params (interface=public, service_id=6c17d32c59944a61a0ce798cea760b4e, region_id=RegionOne) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:09.034333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387e394-8aa0-401d-8bf0-987148016809 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:09.035787 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387e394-8aa0-401d-8bf0-987148016809 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:09.041063 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 446/897] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:09.042852 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf0f86-9c91-4a8e-a7d1-519758c6e128 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:09.050700 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 452/898] 10.222.0.93 () {56 vars in 1251 bytes} [Thu Jun 16 18:38:08 2022] GET /identity/v3/endpoints?service_id=6c17d32c59944a61a0ce798cea760b4e&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:09.051588 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387e394-8aa0-401d-8bf0-987148016809 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:09.112992 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:09.172935 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387e394-8aa0-401d-8bf0-987148016809 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:09.179457 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf0f86-9c91-4a8e-a7d1-519758c6e128 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:09.197205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:09.213027 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d38139-6b22-468b-8389-54024429ce3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:09.214206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d38139-6b22-468b-8389-54024429ce3d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:09.214644 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d38139-6b22-468b-8389-54024429ce3d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:09.214769 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a577c-fd21-4a62-8e50-349c0e139542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:09.215194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d38139-6b22-468b-8389-54024429ce3d None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:09.215717 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a577c-fd21-4a62-8e50-349c0e139542 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:09.216087 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a577c-fd21-4a62-8e50-349c0e139542 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:09.216401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d38139-6b22-468b-8389-54024429ce3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:09.216545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a577c-fd21-4a62-8e50-349c0e139542 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:09.218240 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d38139-6b22-468b-8389-54024429ce3d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:09.224209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a577c-fd21-4a62-8e50-349c0e139542 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:09.225548 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 453/899] 10.222.0.93 () {56 vars in 1087 bytes} [Thu Jun 16 18:38:09 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:38:09.225871 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a577c-fd21-4a62-8e50-349c0e139542 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:09.241460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-0b1a577c-fd21-4a62-8e50-349c0e139542 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:09.241460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:09.241460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:09.241460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:09.241460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:09.241460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:09.241460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:09.241460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:09.241460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:09.241460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:09.241460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:09.241460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:09.241460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:38:09.241460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:38:09.241460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:38:09.242645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:38:09.242645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:09.242645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:09.242645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:09.242645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:09.242645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:09.242645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:09.242645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:09.242645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:09.242645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:09.242645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:09.242645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:09.242645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:09.242645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:09.242645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:09.242645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:09.242645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:09.243759 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:38:09.243759 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:38:09.243759 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:38:09.243759 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:38:09.243759 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:38:09.243759 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:38:09.243759 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:09.243759 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:09.246214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 447/900] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:09.251873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d38139-6b22-468b-8389-54024429ce3d None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:09.367758 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d38139-6b22-468b-8389-54024429ce3d None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:09.393733 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:09.406456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99ee8c-95c6-4d47-a580-48aa651680f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:09.407183 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99ee8c-95c6-4d47-a580-48aa651680f8 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:09.407417 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99ee8c-95c6-4d47-a580-48aa651680f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:09.407700 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99ee8c-95c6-4d47-a580-48aa651680f8 None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:09.408527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99ee8c-95c6-4d47-a580-48aa651680f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:09.408844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99ee8c-95c6-4d47-a580-48aa651680f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:09.410296 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99ee8c-95c6-4d47-a580-48aa651680f8 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:09.423523 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 454/901] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:38:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:09.429527 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a577c-fd21-4a62-8e50-349c0e139542 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:09.542932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a577c-fd21-4a62-8e50-349c0e139542 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:09.578509 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15c66c-b0a2-439a-aa7d-3ad3fa4d6acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:09.579181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15c66c-b0a2-439a-aa7d-3ad3fa4d6acd None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:09.579471 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15c66c-b0a2-439a-aa7d-3ad3fa4d6acd None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:09.579755 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15c66c-b0a2-439a-aa7d-3ad3fa4d6acd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:09.580635 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15c66c-b0a2-439a-aa7d-3ad3fa4d6acd None admin] RBAC: Adding query filter params (role.id=4b8942e18cb04e18bc69029f7203d9c0, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=1eefe0d721484433b72afca03a2c1bb6) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:09.580954 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15c66c-b0a2-439a-aa7d-3ad3fa4d6acd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:09.582397 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15c66c-b0a2-439a-aa7d-3ad3fa4d6acd None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:09.589737 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 448/902] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:09 2022] GET /identity/v3/role_assignments?user.id=1eefe0d721484433b72afca03a2c1bb6&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=4b8942e18cb04e18bc69029f7203d9c0 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:10.092317 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891f59f-e23e-466d-bd0c-22dd849f40ff None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:10.092892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891f59f-e23e-466d-bd0c-22dd849f40ff None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:10.092892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891f59f-e23e-466d-bd0c-22dd849f40ff None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:10.094399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 455/903] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:10.099739 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13fe1d-b404-4320-a07c-4964af0ccb2a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:10.100595 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13fe1d-b404-4320-a07c-4964af0ccb2a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:10.101098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13fe1d-b404-4320-a07c-4964af0ccb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:10.118226 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-dc13fe1d-b404-4320-a07c-4964af0ccb2a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:10.119726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-dc13fe1d-b404-4320-a07c-4964af0ccb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:10.157937 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:10.190646 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 449/904] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:10.214260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891f59f-e23e-466d-bd0c-22dd849f40ff None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:10.321661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891f59f-e23e-466d-bd0c-22dd849f40ff None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:10.362508 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83db58-2dc6-44b4-84a9-1745ed85d13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:10.364262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83db58-2dc6-44b4-84a9-1745ed85d13d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:10.364801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83db58-2dc6-44b4-84a9-1745ed85d13d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:10.365280 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83db58-2dc6-44b4-84a9-1745ed85d13d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:10.366145 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83db58-2dc6-44b4-84a9-1745ed85d13d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:10.367793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83db58-2dc6-44b4-84a9-1745ed85d13d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:10.381741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-2a83db58-2dc6-44b4-84a9-1745ed85d13d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 18:38:10.381741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:10.381741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:10.381741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:10.381741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:10.381741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:10.381741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:10.381741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:10.381741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 18:38:10.381741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:10.381741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:10.381741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:10.381741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:10.381741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:10.381741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:10.381741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:10.382744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:10.382744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:10.382744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:10.382744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:10.382744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:10.382744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:10.382744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:10.382744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:10.382744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:10.382744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:10.382744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:10.382744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:10.382744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:10.382744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:10.382744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:10.382744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:10.383584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:10.383584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:10.383584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:10.383584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:10.383584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:10.383584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:10.383584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:10.383584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:10.383584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:10.383584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:10.383584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:10.383584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:10.383584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:10.383584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 18:38:10.383584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:10.386225 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 456/905] 10.222.0.93 () {56 vars in 1132 bytes} [Thu Jun 16 18:38:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:10.393535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13fe1d-b404-4320-a07c-4964af0ccb2a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:10.497017 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13fe1d-b404-4320-a07c-4964af0ccb2a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:10.533863 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fcb67-f857-4939-9dbf-25098c395222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:10.534533 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fcb67-f857-4939-9dbf-25098c395222 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:10.534821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fcb67-f857-4939-9dbf-25098c395222 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:10.535095 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fcb67-f857-4939-9dbf-25098c395222 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:10.536346 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fcb67-f857-4939-9dbf-25098c395222 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:10.536681 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fcb67-f857-4939-9dbf-25098c395222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:10.538048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fcb67-f857-4939-9dbf-25098c395222 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:10.543199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 450/906] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Jun 16 18:38:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:10.548867 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83db58-2dc6-44b4-84a9-1745ed85d13d None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:10.597691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:10.656897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83db58-2dc6-44b4-84a9-1745ed85d13d None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:10.692683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea8fba-1bc4-476a-bf71-22697e0fa9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:10.693359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea8fba-1bc4-476a-bf71-22697e0fa9dd None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:10.693649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea8fba-1bc4-476a-bf71-22697e0fa9dd None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:10.693932 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea8fba-1bc4-476a-bf71-22697e0fa9dd None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:10.694645 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea8fba-1bc4-476a-bf71-22697e0fa9dd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:10.694957 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea8fba-1bc4-476a-bf71-22697e0fa9dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:10.696344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea8fba-1bc4-476a-bf71-22697e0fa9dd None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:10.701610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 457/907] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Jun 16 18:38:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:10.707510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fcb67-f857-4939-9dbf-25098c395222 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:10.744957 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:10.820825 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fcb67-f857-4939-9dbf-25098c395222 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:10.845660 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e860210-0e70-4d59-9409-10b54b015da1 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:10.845967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e860210-0e70-4d59-9409-10b54b015da1 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:10.846226 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e860210-0e70-4d59-9409-10b54b015da1 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:10.847844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 458/908] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:10.853187 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc30b1c-0219-42cd-8b5d-c3ff7810e7cf None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:10.853469 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc30b1c-0219-42cd-8b5d-c3ff7810e7cf None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:10.853746 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc30b1c-0219-42cd-8b5d-c3ff7810e7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:10.859367 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b671ed-30df-498c-8af1-4361491b00cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:10.860310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b671ed-30df-498c-8af1-4361491b00cd None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:10.867469 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b671ed-30df-498c-8af1-4361491b00cd None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:10.867469 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b671ed-30df-498c-8af1-4361491b00cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:10.867469 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b671ed-30df-498c-8af1-4361491b00cd None admin] RBAC: Adding query filter params (interface=public, service_id=7e8b8099018f4e1db28b5e8139658065, region_id=RegionOne) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:10.867469 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b671ed-30df-498c-8af1-4361491b00cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:10.867469 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b671ed-30df-498c-8af1-4361491b00cd None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:10.869337 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 451/909] 10.222.0.93 () {56 vars in 1251 bytes} [Thu Jun 16 18:38:10 2022] GET /identity/v3/endpoints?service_id=7e8b8099018f4e1db28b5e8139658065&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:10.873501 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-4bc30b1c-0219-42cd-8b5d-c3ff7810e7cf None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:10.874709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-4bc30b1c-0219-42cd-8b5d-c3ff7810e7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:10.880383 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b671ed-30df-498c-8af1-4361491b00cd None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:10.956537 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 459/910] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:10.978281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc30b1c-0219-42cd-8b5d-c3ff7810e7cf None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:11.011731 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:11.016427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b671ed-30df-498c-8af1-4361491b00cd None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:11.022707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:11.060598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790b917-de14-4716-870e-5692f143c691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:11.061993 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790b917-de14-4716-870e-5692f143c691 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:11.062487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790b917-de14-4716-870e-5692f143c691 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:11.063329 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790b917-de14-4716-870e-5692f143c691 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:11.064533 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790b917-de14-4716-870e-5692f143c691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:11.066661 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790b917-de14-4716-870e-5692f143c691 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:11.074567 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 452/911] 10.222.0.93 () {56 vars in 1087 bytes} [Thu Jun 16 18:38:10 2022] GET /identity/v3/services => generated 1268 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:38:11.088303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc30b1c-0219-42cd-8b5d-c3ff7810e7cf None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:11.127566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb835817-9b1e-4add-b12e-82d59a0e879b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:11.129161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb835817-9b1e-4add-b12e-82d59a0e879b None admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:11.129658 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb835817-9b1e-4add-b12e-82d59a0e879b None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:11.130163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb835817-9b1e-4add-b12e-82d59a0e879b None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:11.131121 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb835817-9b1e-4add-b12e-82d59a0e879b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:11.132844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb835817-9b1e-4add-b12e-82d59a0e879b None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:11.210580 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 460/912] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Jun 16 18:38:10 2022] POST /identity/v3/services => generated 241 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:38:11.470004 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f05014-053e-486b-9f3d-34ca618aaa8e None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:11.470506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f05014-053e-486b-9f3d-34ca618aaa8e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:11.470506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f05014-053e-486b-9f3d-34ca618aaa8e None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:11.472125 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 453/913] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:11.478432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa07bb8-96ce-4517-b0df-c3fbf7f3d6cc None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:11.478725 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa07bb8-96ce-4517-b0df-c3fbf7f3d6cc None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:11.479005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa07bb8-96ce-4517-b0df-c3fbf7f3d6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:11.495976 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-3aa07bb8-96ce-4517-b0df-c3fbf7f3d6cc None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:11.497230 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-3aa07bb8-96ce-4517-b0df-c3fbf7f3d6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:11.572933 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 461/914] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:11.601501 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f05014-053e-486b-9f3d-34ca618aaa8e None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:11.708945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f05014-053e-486b-9f3d-34ca618aaa8e None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:11.744670 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b32e8-d7d7-4d52-83c1-98bfa1b55028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:11.745398 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b32e8-d7d7-4d52-83c1-98bfa1b55028 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:11.745733 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b32e8-d7d7-4d52-83c1-98bfa1b55028 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:11.746017 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b32e8-d7d7-4d52-83c1-98bfa1b55028 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:11.746677 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b32e8-d7d7-4d52-83c1-98bfa1b55028 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:11.748047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b32e8-d7d7-4d52-83c1-98bfa1b55028 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:11.760956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-ac5b32e8-d7d7-4d52-83c1-98bfa1b55028 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 18:38:11.760956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:11.760956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:11.760956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:11.760956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:11.760956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:11.760956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:11.760956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:11.760956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 18:38:11.760956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:11.760956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:11.760956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:11.760956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:11.760956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:11.760956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:11.760956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:11.760956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:11.762096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:11.762096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:11.762096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:11.762096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:11.762096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:11.762096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:11.762096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:11.762096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:11.762096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:11.762096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:11.762096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:11.762096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:11.762096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:11.762096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:11.762096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:11.762096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:11.762946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:11.762946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:11.762946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:11.762946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:11.762946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:11.762946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:11.762946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:11.762946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:11.762946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:11.762946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:11.762946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:11.762946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:11.762946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 18:38:11.762946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:11.767720 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 454/915] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:38:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:11.769228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa07bb8-96ce-4517-b0df-c3fbf7f3d6cc None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:11.800141 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:11.826623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14d854-08a7-4180-ad50-5497aa19aa23 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:11.826957 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14d854-08a7-4180-ad50-5497aa19aa23 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:11.827183 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14d854-08a7-4180-ad50-5497aa19aa23 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:11.828872 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 455/916] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:11.834225 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229dfd8-7ed3-4fc8-9732-f9ea6cac1748 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:11.834518 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229dfd8-7ed3-4fc8-9732-f9ea6cac1748 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:11.834799 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229dfd8-7ed3-4fc8-9732-f9ea6cac1748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:11.852971 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d229dfd8-7ed3-4fc8-9732-f9ea6cac1748 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:11.854178 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d229dfd8-7ed3-4fc8-9732-f9ea6cac1748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:11.887668 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa07bb8-96ce-4517-b0df-c3fbf7f3d6cc None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:11.904853 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:11.929524 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bae393-96fc-40f2-bde8-0d6bd2ea086f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:11.930198 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bae393-96fc-40f2-bde8-0d6bd2ea086f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:11.930483 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bae393-96fc-40f2-bde8-0d6bd2ea086f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:11.930762 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bae393-96fc-40f2-bde8-0d6bd2ea086f None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:11.931475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bae393-96fc-40f2-bde8-0d6bd2ea086f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:11.931784 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bae393-96fc-40f2-bde8-0d6bd2ea086f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:11.932764 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 456/917] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:11.933464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bae393-96fc-40f2-bde8-0d6bd2ea086f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:11.940049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 462/918] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:38:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:11.945566 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229dfd8-7ed3-4fc8-9732-f9ea6cac1748 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:11.950731 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bae393-96fc-40f2-bde8-0d6bd2ea086f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:12.063348 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:12.073833 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bae393-96fc-40f2-bde8-0d6bd2ea086f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:12.078988 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229dfd8-7ed3-4fc8-9732-f9ea6cac1748 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:12.115489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434d6fe-89c5-477f-b7db-8d853ce4a2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:12.116027 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04bfb9-2051-483f-8cbd-7ded4d6ebb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:12.116335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434d6fe-89c5-477f-b7db-8d853ce4a2ec None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:12.116730 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434d6fe-89c5-477f-b7db-8d853ce4a2ec None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:12.117082 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434d6fe-89c5-477f-b7db-8d853ce4a2ec None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:12.117518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04bfb9-2051-483f-8cbd-7ded4d6ebb8d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:12.117924 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434d6fe-89c5-477f-b7db-8d853ce4a2ec None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:12.118090 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04bfb9-2051-483f-8cbd-7ded4d6ebb8d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:12.118357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434d6fe-89c5-477f-b7db-8d853ce4a2ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:12.118644 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04bfb9-2051-483f-8cbd-7ded4d6ebb8d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:12.120065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434d6fe-89c5-477f-b7db-8d853ce4a2ec None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:12.130412 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 457/919] 10.222.0.93 () {56 vars in 1114 bytes} [Thu Jun 16 18:38:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:12.131782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434d6fe-89c5-477f-b7db-8d853ce4a2ec None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:12.134868 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04bfb9-2051-483f-8cbd-7ded4d6ebb8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:12.144846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-8b04bfb9-2051-483f-8cbd-7ded4d6ebb8d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:12.144846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:12.144846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:12.144846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:12.144846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:12.144846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:12.144846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:12.144846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:12.144846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:12.144846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:12.144846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:12.144846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:12.144846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:12.144846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:12.144846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:12.144846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:12.145900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:12.145900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:12.145900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:12.145900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:12.145900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:12.145900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:12.145900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:12.145900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:12.145900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:12.145900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:12.145900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:12.145900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:12.145900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:12.145900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:12.145900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:12.145900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:12.146769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:12.146769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:12.146769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:12.146769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:12.146769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:12.146769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:12.146769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:12.146769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:12.146769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:12.146769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:12.146769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:12.146769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:12.147411 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 463/920] 10.222.0.93 () {56 vars in 1120 bytes} [Thu Jun 16 18:38:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:12.152534 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04bfb9-2051-483f-8cbd-7ded4d6ebb8d None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:12.165815 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:12.265988 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434d6fe-89c5-477f-b7db-8d853ce4a2ec None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:12.275945 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04bfb9-2051-483f-8cbd-7ded4d6ebb8d None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:12.311424 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0e6f0-8fac-4deb-b1db-5110bd88c3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:12.312535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0e6f0-8fac-4deb-b1db-5110bd88c3df None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:12.313131 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0e6f0-8fac-4deb-b1db-5110bd88c3df None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:12.313424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987a1be-caae-49cc-ab7b-d52bbdf086d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:12.313880 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0e6f0-8fac-4deb-b1db-5110bd88c3df None admin] PATH_INFO: `/v3/endpoints` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:12.314056 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987a1be-caae-49cc-ab7b-d52bbdf086d2 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:12.314337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987a1be-caae-49cc-ab7b-d52bbdf086d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:12.314622 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987a1be-caae-49cc-ab7b-d52bbdf086d2 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:12.315380 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987a1be-caae-49cc-ab7b-d52bbdf086d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:12.315634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0e6f0-8fac-4deb-b1db-5110bd88c3df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:12.315732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987a1be-caae-49cc-ab7b-d52bbdf086d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:12.317706 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987a1be-caae-49cc-ab7b-d52bbdf086d2 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:12.320917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0e6f0-8fac-4deb-b1db-5110bd88c3df None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:12.331759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 464/921] 10.222.0.93 () {56 vars in 1115 bytes} [Thu Jun 16 18:38:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:12.332648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987a1be-caae-49cc-ab7b-d52bbdf086d2 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:12.351483 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:12.436412 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987a1be-caae-49cc-ab7b-d52bbdf086d2 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:12.437489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 458/922] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Jun 16 18:38:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:38:12.487189 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11b64f-3e7f-4b64-b0af-81ac9f08c506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:12.488018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11b64f-3e7f-4b64-b0af-81ac9f08c506 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:12.488881 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11b64f-3e7f-4b64-b0af-81ac9f08c506 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:12.489160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11b64f-3e7f-4b64-b0af-81ac9f08c506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:12.501482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11b64f-3e7f-4b64-b0af-81ac9f08c506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:12.502974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11b64f-3e7f-4b64-b0af-81ac9f08c506 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:12.523242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-cd11b64f-3e7f-4b64-b0af-81ac9f08c506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:12.523242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:12.523242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:12.523242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:12.523242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:12.523242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:12.523242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:12.523242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:12.523242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:12.523242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:12.523242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:12.523242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:12.523242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:12.523242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:12.523242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:12.524304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:12.524304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:12.524304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:12.524304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:12.524304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:12.524304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:12.524304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:12.524304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:12.524304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:12.524304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:12.524304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:12.524304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:12.524304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:12.524304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:12.524304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:12.524304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:12.524304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:12.525219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:12.525219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:12.525219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:12.525219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:12.525219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 465/923] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:12.530878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0e6f0-8fac-4deb-b1db-5110bd88c3df None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:12.628734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:12.650059 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0e6f0-8fac-4deb-b1db-5110bd88c3df None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:12.684276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90a03a-b74a-408a-a31e-09c73f50b90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:12.685039 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90a03a-b74a-408a-a31e-09c73f50b90e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:12.685326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90a03a-b74a-408a-a31e-09c73f50b90e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:12.685711 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90a03a-b74a-408a-a31e-09c73f50b90e None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:12.686567 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90a03a-b74a-408a-a31e-09c73f50b90e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:12.686879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90a03a-b74a-408a-a31e-09c73f50b90e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:12.688299 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90a03a-b74a-408a-a31e-09c73f50b90e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:12.700341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 459/924] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:12.705605 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11b64f-3e7f-4b64-b0af-81ac9f08c506 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:12.773396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:12.815163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11b64f-3e7f-4b64-b0af-81ac9f08c506 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:12.854202 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c68f43-8754-407c-907e-b5680d8a6811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:12.855034 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c68f43-8754-407c-907e-b5680d8a6811 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:12.855322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c68f43-8754-407c-907e-b5680d8a6811 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:12.857898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c68f43-8754-407c-907e-b5680d8a6811 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:12.867163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c68f43-8754-407c-907e-b5680d8a6811 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:12.867163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c68f43-8754-407c-907e-b5680d8a6811 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:12.880988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-d3c68f43-8754-407c-907e-b5680d8a6811 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:38:12.880988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:12.880988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:12.880988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:12.880988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:12.880988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:12.880988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:12.880988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:12.880988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:12.880988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:12.880988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:12.880988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:12.880988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:38:12.880988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:38:12.880988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:38:12.880988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:38:12.882873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:12.882873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:12.882873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:38:12.882873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:12.882873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:38:12.882873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:12.882873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:12.882873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:12.882873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:12.882873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:12.882873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:12.882873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:12.882873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:12.882873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:12.882873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:12.882873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:12.882873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:12.882873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:12.885054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:12.885054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:12.885054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:38:12.885054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:38:12.885054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:38:12.885054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:38:12.885054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:38:12.885054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:38:12.885054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:38:12.885054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:12.885054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 466/925] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Jun 16 18:38:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:12.891921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90a03a-b74a-408a-a31e-09c73f50b90e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:12.994387 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90a03a-b74a-408a-a31e-09c73f50b90e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:13.033640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77425af-8ac7-4b90-9538-78d2f693595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:13.034325 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77425af-8ac7-4b90-9538-78d2f693595e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:13.034667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77425af-8ac7-4b90-9538-78d2f693595e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:13.034978 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77425af-8ac7-4b90-9538-78d2f693595e None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:13.035872 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77425af-8ac7-4b90-9538-78d2f693595e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:13.036188 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77425af-8ac7-4b90-9538-78d2f693595e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:13.037644 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77425af-8ac7-4b90-9538-78d2f693595e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:13.048887 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:13.058936 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 460/926] 10.222.0.93 () {56 vars in 1149 bytes} [Thu Jun 16 18:38:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:13.064190 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c68f43-8754-407c-907e-b5680d8a6811 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:13.168690 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c68f43-8754-407c-907e-b5680d8a6811 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:13.190314 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:13.204754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea675fe-a4e0-4948-a244-5be460da742a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:13.205568 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea675fe-a4e0-4948-a244-5be460da742a None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:13.205853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea675fe-a4e0-4948-a244-5be460da742a None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:13.208130 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea675fe-a4e0-4948-a244-5be460da742a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:13.218223 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea675fe-a4e0-4948-a244-5be460da742a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:13.219695 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea675fe-a4e0-4948-a244-5be460da742a None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:13.238093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-bea675fe-a4e0-4948-a244-5be460da742a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:13.238093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:13.238093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:13.238093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:13.238093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:13.238093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:13.238093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:13.238093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:13.238093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:13.238093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:13.238093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:13.238093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:13.238093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:13.238093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:13.238093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:13.239049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:13.239049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:13.239049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:13.239049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:13.239049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:13.239049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:13.239049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:13.239049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:13.239049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:13.239049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:13.239049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:13.239049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:13.239049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:13.239049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:13.239049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:13.239049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:13.239049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:13.239963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:13.239963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:13.239963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:13.239963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:13.239963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 467/927] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:13.245366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77425af-8ac7-4b90-9538-78d2f693595e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:13.355577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77425af-8ac7-4b90-9538-78d2f693595e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:13.394981 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13045b4f-3d9d-437a-aa18-f8ae10c1321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:13.395654 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13045b4f-3d9d-437a-aa18-f8ae10c1321a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:13.395939 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13045b4f-3d9d-437a-aa18-f8ae10c1321a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:13.396217 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13045b4f-3d9d-437a-aa18-f8ae10c1321a None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:13.396980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13045b4f-3d9d-437a-aa18-f8ae10c1321a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:13.397289 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13045b4f-3d9d-437a-aa18-f8ae10c1321a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:13.398657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13045b4f-3d9d-437a-aa18-f8ae10c1321a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:13.412136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 461/928] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:13.418075 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea675fe-a4e0-4948-a244-5be460da742a None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:13.419132 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882dc529-c07a-448d-a27c-1bf821cf3390 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:13.419361 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882dc529-c07a-448d-a27c-1bf821cf3390 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:13.419646 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882dc529-c07a-448d-a27c-1bf821cf3390 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:13.421352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 462/929] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:38:13.430707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d94425-353d-4e70-b677-8a5e3c390ad6 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:13.430707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d94425-353d-4e70-b677-8a5e3c390ad6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:13.430978 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d94425-353d-4e70-b677-8a5e3c390ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:13.450196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-58d94425-353d-4e70-b677-8a5e3c390ad6 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:13.451431 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-58d94425-353d-4e70-b677-8a5e3c390ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:13.509256 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:13.525748 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 463/930] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:13.529784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6187c4-f71a-4019-9281-73dd12e42bf8 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:13.530078 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6187c4-f71a-4019-9281-73dd12e42bf8 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:13.530355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6187c4-f71a-4019-9281-73dd12e42bf8 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:13.532601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 464/931] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:13.536219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea675fe-a4e0-4948-a244-5be460da742a None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:13.537676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9dd39-7112-4953-8920-f250dcfe9463 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:13.538144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9dd39-7112-4953-8920-f250dcfe9463 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:13.538562 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9dd39-7112-4953-8920-f250dcfe9463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:13.556297 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-05a9dd39-7112-4953-8920-f250dcfe9463 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:13.557502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-05a9dd39-7112-4953-8920-f250dcfe9463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:13.572824 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f922d1-4493-4116-9a2d-a35b72692aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:13.573630 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f922d1-4493-4116-9a2d-a35b72692aff None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:13.573917 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f922d1-4493-4116-9a2d-a35b72692aff None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:13.574196 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f922d1-4493-4116-9a2d-a35b72692aff None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:13.581109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f922d1-4493-4116-9a2d-a35b72692aff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:13.582606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f922d1-4493-4116-9a2d-a35b72692aff None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:13.596941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-51f922d1-4493-4116-9a2d-a35b72692aff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:13.596941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:13.596941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:13.596941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:13.596941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:13.596941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:13.596941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:13.596941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:13.596941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:13.596941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:13.596941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:13.596941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:13.596941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:38:13.596941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:38:13.596941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:38:13.607649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:38:13.607649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:13.607649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:13.607649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:13.607649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:13.607649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:13.607649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:13.607649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:13.607649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:13.607649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:13.607649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:13.607649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:13.607649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:13.607649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:13.607649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:13.607649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:13.607649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:13.608664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:38:13.608664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:38:13.608664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:38:13.608664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:38:13.608664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:38:13.608664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:38:13.608664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:13.608664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:13.608664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 468/932] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:13.608664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f922d1-4493-4116-9a2d-a35b72692aff None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:13.638428 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:13.640857 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 465/933] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:13.641929 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9dd39-7112-4953-8920-f250dcfe9463 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:13.717297 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f922d1-4493-4116-9a2d-a35b72692aff None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:13.753051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9dd39-7112-4953-8920-f250dcfe9463 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:13.758348 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04be2c-062c-4f56-b149-8ce7f0bb3700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:13.759170 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04be2c-062c-4f56-b149-8ce7f0bb3700 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:13.759456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04be2c-062c-4f56-b149-8ce7f0bb3700 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:13.759733 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04be2c-062c-4f56-b149-8ce7f0bb3700 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:13.760908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04be2c-062c-4f56-b149-8ce7f0bb3700 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:13.762649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04be2c-062c-4f56-b149-8ce7f0bb3700 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:13.769560 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:13.775634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-1f04be2c-062c-4f56-b149-8ce7f0bb3700 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 18:38:13.775634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:13.775634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:13.775634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:13.775634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:13.775634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:13.775634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:13.775634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:13.775634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 18:38:13.775634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:13.775634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:13.775634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:13.775634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:13.775634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:13.775634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:13.775634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:13.777007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:13.777007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:13.777007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:13.777007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:13.777007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:13.777007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:13.777007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:13.777007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:13.777007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:13.777007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:13.777007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:13.777007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:13.777007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:13.777007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:13.777007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:13.777007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:13.778396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:13.778396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:13.778396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:13.778396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:13.778396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:13.778396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:13.778396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:13.778396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:13.778396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:13.778396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:13.778396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:13.778396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:13.778396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:13.778396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 18:38:13.778396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:13.778396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 469/934] 10.222.0.93 () {56 vars in 1132 bytes} [Thu Jun 16 18:38:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:13.779288 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04be2c-062c-4f56-b149-8ce7f0bb3700 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:13.793618 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279133d7-9fcf-4e0e-a9c2-287dc3552d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:13.794321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279133d7-9fcf-4e0e-a9c2-287dc3552d18 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:13.794607 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279133d7-9fcf-4e0e-a9c2-287dc3552d18 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:13.794885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279133d7-9fcf-4e0e-a9c2-287dc3552d18 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:13.795678 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279133d7-9fcf-4e0e-a9c2-287dc3552d18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:13.795990 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279133d7-9fcf-4e0e-a9c2-287dc3552d18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:13.797464 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279133d7-9fcf-4e0e-a9c2-287dc3552d18 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:13.810502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 466/935] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:38:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:13.811641 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279133d7-9fcf-4e0e-a9c2-287dc3552d18 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:13.890083 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:13.895733 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04be2c-062c-4f56-b149-8ce7f0bb3700 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:13.918448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279133d7-9fcf-4e0e-a9c2-287dc3552d18 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:13.933155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef695a-f263-497e-b6bb-03a8b7a69728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:13.933990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef695a-f263-497e-b6bb-03a8b7a69728 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:13.934277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef695a-f263-497e-b6bb-03a8b7a69728 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:13.934551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef695a-f263-497e-b6bb-03a8b7a69728 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:13.935213 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef695a-f263-497e-b6bb-03a8b7a69728 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:13.936611 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef695a-f263-497e-b6bb-03a8b7a69728 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:13.949193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-02ef695a-f263-497e-b6bb-03a8b7a69728 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:13.949193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:13.949193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:13.949193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:13.949193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:13.949193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:13.949193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:13.949193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:13.949193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:13.949193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:13.949193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:13.949193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:13.949193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:13.949193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:13.949193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:13.949193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:13.949193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:13.950398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:13.950398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:13.950398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:13.950398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:13.950398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:13.950398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:13.950398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:13.950398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:13.950398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:13.950398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:13.950398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:13.950398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:13.950398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:13.950398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:13.950398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:13.950398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:13.951262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:13.951262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:13.951262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:13.951262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:13.951262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:13.951262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:13.951262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:13.951262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:13.951262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:13.951262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:13.951262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:13.951262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:13.951262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:13.951262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:13.951262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 470/936] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Jun 16 18:38:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:13.952074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef695a-f263-497e-b6bb-03a8b7a69728 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:13.960840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf88cc6-cddc-4112-993f-a9c30440d24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:13.961520 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf88cc6-cddc-4112-993f-a9c30440d24b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:13.961809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf88cc6-cddc-4112-993f-a9c30440d24b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:13.962087 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf88cc6-cddc-4112-993f-a9c30440d24b None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:13.962812 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf88cc6-cddc-4112-993f-a9c30440d24b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:13.963121 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf88cc6-cddc-4112-993f-a9c30440d24b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:13.964505 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf88cc6-cddc-4112-993f-a9c30440d24b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:13.969624 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 467/937] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Jun 16 18:38:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:13.970114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf88cc6-cddc-4112-993f-a9c30440d24b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:14.016782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:14.060925 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef695a-f263-497e-b6bb-03a8b7a69728 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:14.077468 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf88cc6-cddc-4112-993f-a9c30440d24b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:14.098028 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fdbc2-dd17-4d34-9ed0-ccfa755e633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:14.098920 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fdbc2-dd17-4d34-9ed0-ccfa755e633e None admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:14.099204 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fdbc2-dd17-4d34-9ed0-ccfa755e633e None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:14.099481 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fdbc2-dd17-4d34-9ed0-ccfa755e633e None admin] PATH_INFO: `/v3/projects/d6d43f779d67418baf199556b8e497c7/users/1eefe0d721484433b72afca03a2c1bb6/roles/4b8942e18cb04e18bc69029f7203d9c0` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:14.101792 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fdbc2-dd17-4d34-9ed0-ccfa755e633e None admin] RBAC: Authorizing `identity:create_grant(project_id=d6d43f779d67418baf199556b8e497c7, user_id=1eefe0d721484433b72afca03a2c1bb6, role_id=4b8942e18cb04e18bc69029f7203d9c0)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:14.103230 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fdbc2-dd17-4d34-9ed0-ccfa755e633e None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:14.114323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43379355-328f-420a-a385-587577baa9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:14.115065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43379355-328f-420a-a385-587577baa9b2 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:14.115417 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43379355-328f-420a-a385-587577baa9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:14.115763 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43379355-328f-420a-a385-587577baa9b2 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:14.116514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43379355-328f-420a-a385-587577baa9b2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:14.116828 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43379355-328f-420a-a385-587577baa9b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:14.118234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43379355-328f-420a-a385-587577baa9b2 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:14.134437 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 468/938] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Jun 16 18:38:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:14.134437 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43379355-328f-420a-a385-587577baa9b2 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:14.196684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 471/939] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:38:13 2022] PUT /identity/v3/projects/d6d43f779d67418baf199556b8e497c7/users/1eefe0d721484433b72afca03a2c1bb6/roles/4b8942e18cb04e18bc69029f7203d9c0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:38:14.205289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fdbc2-dd17-4d34-9ed0-ccfa755e633e None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:14.232289 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43379355-328f-420a-a385-587577baa9b2 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:14.236136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:14.248221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:14.297192 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b41c8-641e-4c50-9a6b-b15529c82089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:14.298273 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b41c8-641e-4c50-9a6b-b15529c82089 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:14.300327 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b41c8-641e-4c50-9a6b-b15529c82089 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:14.300851 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b41c8-641e-4c50-9a6b-b15529c82089 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:14.301768 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b41c8-641e-4c50-9a6b-b15529c82089 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:14.302307 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b41c8-641e-4c50-9a6b-b15529c82089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:14.304064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b41c8-641e-4c50-9a6b-b15529c82089 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:14.315101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 469/940] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Jun 16 18:38:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:14.316926 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b41c8-641e-4c50-9a6b-b15529c82089 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:14.368783 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fdbc2-dd17-4d34-9ed0-ccfa755e633e None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:14.423756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84659e-1b28-41a5-9a7f-31e87a2baf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:14.424469 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84659e-1b28-41a5-9a7f-31e87a2baf16 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:14.424770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84659e-1b28-41a5-9a7f-31e87a2baf16 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:14.425333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84659e-1b28-41a5-9a7f-31e87a2baf16 None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:14.426937 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84659e-1b28-41a5-9a7f-31e87a2baf16 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:14.427252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84659e-1b28-41a5-9a7f-31e87a2baf16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:14.428743 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84659e-1b28-41a5-9a7f-31e87a2baf16 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:14.436740 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 472/941] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Jun 16 18:38:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:14.442127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84659e-1b28-41a5-9a7f-31e87a2baf16 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:14.446773 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b41c8-641e-4c50-9a6b-b15529c82089 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:14.486849 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d8ef1-88ef-4cd6-b94e-4d030b3b563e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:14.487488 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8ef1-88ef-4cd6-b94e-4d030b3b563e None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:14.487808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8ef1-88ef-4cd6-b94e-4d030b3b563e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:14.488610 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d8ef1-88ef-4cd6-b94e-4d030b3b563e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:14.489417 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d8ef1-88ef-4cd6-b94e-4d030b3b563e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:14.490792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d8ef1-88ef-4cd6-b94e-4d030b3b563e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:14.536221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:14.552534 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84659e-1b28-41a5-9a7f-31e87a2baf16 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:14.587204 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37638ba4-660f-442b-94c7-f47273b88769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:14.587869 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37638ba4-660f-442b-94c7-f47273b88769 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:14.588156 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37638ba4-660f-442b-94c7-f47273b88769 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:14.588456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37638ba4-660f-442b-94c7-f47273b88769 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:14.589322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37638ba4-660f-442b-94c7-f47273b88769 None admin] RBAC: Adding query filter params (interface=public, service_id=d87b2f9d4afb4755ad6cf5a6a5f2a9d2, region_id=RegionOne) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:14.589645 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37638ba4-660f-442b-94c7-f47273b88769 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:14.591006 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37638ba4-660f-442b-94c7-f47273b88769 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:14.600794 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 473/942] 10.222.0.93 () {56 vars in 1251 bytes} [Thu Jun 16 18:38:14 2022] GET /identity/v3/endpoints?service_id=d87b2f9d4afb4755ad6cf5a6a5f2a9d2&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:14.604876 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37638ba4-660f-442b-94c7-f47273b88769 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:14.612958 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 470/943] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Jun 16 18:38:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:14.695523 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefdbd5-9ff3-4b4f-bf7a-c25512717f4f None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:14.695885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefdbd5-9ff3-4b4f-bf7a-c25512717f4f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:14.696084 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefdbd5-9ff3-4b4f-bf7a-c25512717f4f None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:14.697796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 471/944] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:38:14.703234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbab922-10f3-4eec-be44-afa8dd677f09 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:14.703517 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbab922-10f3-4eec-be44-afa8dd677f09 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:14.703795 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbab922-10f3-4eec-be44-afa8dd677f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:14.730281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37638ba4-660f-442b-94c7-f47273b88769 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:14.732050 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5bbab922-10f3-4eec-be44-afa8dd677f09 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:14.733561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5bbab922-10f3-4eec-be44-afa8dd677f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:14.753774 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:14.787062 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fec17-f856-4666-a252-6ef8847ae1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:14.789309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fec17-f856-4666-a252-6ef8847ae1c2 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:14.790277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fec17-f856-4666-a252-6ef8847ae1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:14.790748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fec17-f856-4666-a252-6ef8847ae1c2 None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:14.791932 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fec17-f856-4666-a252-6ef8847ae1c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:14.794093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fec17-f856-4666-a252-6ef8847ae1c2 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:14.804183 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 474/945] 10.222.0.93 () {56 vars in 1087 bytes} [Thu Jun 16 18:38:14 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:38:14.816458 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 472/946] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:14.841899 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fec17-f856-4666-a252-6ef8847ae1c2 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:14.853867 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:14.957616 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fec17-f856-4666-a252-6ef8847ae1c2 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:14.996132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e2032-fc94-422b-a163-72ed7f06687d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:14.996857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e2032-fc94-422b-a163-72ed7f06687d None admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:14.997146 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e2032-fc94-422b-a163-72ed7f06687d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:14.997428 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e2032-fc94-422b-a163-72ed7f06687d None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:14.998151 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e2032-fc94-422b-a163-72ed7f06687d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:14.999590 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e2032-fc94-422b-a163-72ed7f06687d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:15.001142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: WARNING keystone.server.flask.common [None req-e01e2032-fc94-422b-a163-72ed7f06687d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 18:38:15.051799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.sql.core [None req-e01e2032-fc94-422b-a163-72ed7f06687d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 18:38:15.051799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 18:38:15.051799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [parameters: {'id': 'bbd92a30802e4353a060d65e719cbdd7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 18:38:15.051799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86943) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 18:38:15.059578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-e01e2032-fc94-422b-a163-72ed7f06687d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bbd92a30802e4353a060d65e719cbdd7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bbd92a30802e4353a060d65e719cbdd7. Jun 16 18:38:15.059578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:15.059578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 18:38:15.059578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 18:38:15.059578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 18:38:15.059578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 18:38:15.059578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 18:38:15.059578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 18:38:15.059578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 18:38:15.059578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application conn.query(q) Jun 16 18:38:15.059578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 18:38:15.059578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 18:38:15.059578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 18:38:15.060456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application result.read() Jun 16 18:38:15.060456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 18:38:15.060456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 18:38:15.060456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 18:38:15.060456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 18:38:15.060456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 18:38:15.060456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 18:38:15.060456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 18:38:15.060456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 18:38:15.060456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 18:38:15.060456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:15.060456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 18:38:15.060456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:15.060456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:15.060456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 18:38:15.060456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 18:38:15.060456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 16 18:38:15.060456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 16 18:38:15.061442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 18:38:15.061442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application next(self.gen) Jun 16 18:38:15.061442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 18:38:15.061442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application yield resource Jun 16 18:38:15.061442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 18:38:15.061442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application next(self.gen) Jun 16 18:38:15.061442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 18:38:15.061442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 18:38:15.061442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:38:15.061442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 18:38:15.061442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:38:15.061442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise self.value Jun 16 18:38:15.061442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 18:38:15.061442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 18:38:15.061442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 18:38:15.061442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application session.commit() Jun 16 18:38:15.061442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 18:38:15.062859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 18:38:15.062859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 18:38:15.062859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 18:38:15.062859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 18:38:15.062859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self.session.flush() Jun 16 18:38:15.062859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 18:38:15.062859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 18:38:15.062859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 18:38:15.062859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 18:38:15.062859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 18:38:15.062859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application compat.raise_( Jun 16 18:38:15.062859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 18:38:15.062859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception Jun 16 18:38:15.062859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 18:38:15.062859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 18:38:15.062859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 18:38:15.062859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 18:38:15.063828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 18:38:15.063828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 18:38:15.063828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 18:38:15.063828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 18:38:15.063828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 18:38:15.063828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 18:38:15.063828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 18:38:15.063828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 18:38:15.063828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 18:38:15.063828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 18:38:15.063828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 18:38:15.063828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 18:38:15.063828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 18:38:15.063828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 18:38:15.063828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 18:38:15.064663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 18:38:15.064663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 18:38:15.064663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception Jun 16 18:38:15.064663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 18:38:15.064663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 18:38:15.064663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 18:38:15.064663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 18:38:15.064663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 18:38:15.064663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 18:38:15.064663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 18:38:15.064663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application conn.query(q) Jun 16 18:38:15.064663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 18:38:15.064663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 18:38:15.064663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 18:38:15.064663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application result.read() Jun 16 18:38:15.064663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 18:38:15.064663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 18:38:15.066882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 18:38:15.066882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 18:38:15.066882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 18:38:15.066882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 18:38:15.066882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 18:38:15.066882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 18:38:15.066882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 18:38:15.066882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 18:38:15.066882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [parameters: {'id': 'bbd92a30802e4353a060d65e719cbdd7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 18:38:15.066882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 18:38:15.066882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:15.066882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:15.066882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:15.066882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:15.066882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 16 18:38:15.071114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 16 18:38:15.071114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 18:38:15.071114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 18:38:15.071114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 16 18:38:15.071114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:15.071114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:15.071114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:15.071114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:15.071114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:15.071114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:15.071114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:15.071114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:15.071114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:15.071114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:15.071114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:15.071114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:15.071114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:15.075268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:15.075268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 16 18:38:15.075268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 16 18:38:15.075268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:15.075268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:15.075268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 16 18:38:15.075268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 16 18:38:15.075268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bbd92a30802e4353a060d65e719cbdd7. Jun 16 18:38:15.075268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:15.075268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 475/947] 10.222.0.93 () {60 vars in 1140 bytes} [Thu Jun 16 18:38:14 2022] POST /identity/v3/projects => generated 262 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:15.076707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbab922-10f3-4eec-be44-afa8dd677f09 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:15.178115 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbab922-10f3-4eec-be44-afa8dd677f09 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:15.213465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a62aa-1c5b-465d-9c47-3b655ba67882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:15.214270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a62aa-1c5b-465d-9c47-3b655ba67882 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:15.214550 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a62aa-1c5b-465d-9c47-3b655ba67882 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:15.214823 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a62aa-1c5b-465d-9c47-3b655ba67882 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:15.221905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a62aa-1c5b-465d-9c47-3b655ba67882 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:15.223938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a62aa-1c5b-465d-9c47-3b655ba67882 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:15.239785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-ce5a62aa-1c5b-465d-9c47-3b655ba67882 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:15.239785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:15.239785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:15.239785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:15.239785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:15.239785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:15.239785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:15.239785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:15.239785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:15.239785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:15.239785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:15.239785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:15.239785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:38:15.239785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:38:15.239785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:38:15.241750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:38:15.241750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:15.241750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:15.241750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:15.241750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:15.241750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:15.241750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:15.241750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:15.241750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:15.241750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:15.241750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:15.241750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:15.241750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:15.241750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:15.241750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:15.241750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:15.241750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:15.243362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:38:15.243362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:38:15.243362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:38:15.243362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:38:15.243362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:38:15.243362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:38:15.243362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:15.243362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:15.243362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 473/948] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:15.247125 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e2032-fc94-422b-a163-72ed7f06687d None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:15.313085 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:15.352918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e2032-fc94-422b-a163-72ed7f06687d None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:15.388459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa147f2-1497-4fca-8bdc-1659adab9820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:15.389165 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa147f2-1497-4fca-8bdc-1659adab9820 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:15.389451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa147f2-1497-4fca-8bdc-1659adab9820 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:15.389740 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa147f2-1497-4fca-8bdc-1659adab9820 None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:15.390531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa147f2-1497-4fca-8bdc-1659adab9820 None admin] RBAC: Adding query filter params (name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:15.390845 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa147f2-1497-4fca-8bdc-1659adab9820 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:15.392615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa147f2-1497-4fca-8bdc-1659adab9820 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:15.415814 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 476/949] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Jun 16 18:38:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:16.481892 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23d0e8-ca04-4519-9036-51c471b50225 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:16.482598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23d0e8-ca04-4519-9036-51c471b50225 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:16.482598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23d0e8-ca04-4519-9036-51c471b50225 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:16.484057 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 474/950] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:16.489579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c90fd5-60af-4a0f-a1d7-f157a2c20e42 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:16.490062 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c90fd5-60af-4a0f-a1d7-f157a2c20e42 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:16.490237 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c90fd5-60af-4a0f-a1d7-f157a2c20e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:16.507412 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-57c90fd5-60af-4a0f-a1d7-f157a2c20e42 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:16.509102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-57c90fd5-60af-4a0f-a1d7-f157a2c20e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:16.586125 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 477/951] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:16.609006 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23d0e8-ca04-4519-9036-51c471b50225 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:16.625752 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:16.717042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23d0e8-ca04-4519-9036-51c471b50225 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:16.752270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972035e-8926-4d7b-a612-6322d1a0da30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:16.753123 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972035e-8926-4d7b-a612-6322d1a0da30 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:16.753407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972035e-8926-4d7b-a612-6322d1a0da30 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:16.753684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972035e-8926-4d7b-a612-6322d1a0da30 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:16.766020 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972035e-8926-4d7b-a612-6322d1a0da30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:16.774979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-1972035e-8926-4d7b-a612-6322d1a0da30 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:16.774979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:16.774979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:16.774979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:16.774979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:16.774979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:16.774979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:16.774979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:16.774979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:16.774979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:16.774979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:16.774979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:16.774979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:16.774979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:16.774979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:16.774979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:16.775920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:16.775920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:16.775920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:16.775920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:16.775920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:16.775920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:16.775920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:16.775920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:16.775920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:16.775920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:16.775920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:16.775920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:16.775920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:16.775920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:16.775920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:16.775920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:16.776820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:16.776820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:16.776820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:16.776820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:16.776820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:16.776820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:16.776820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:16.776820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:16.776820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:16.776820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:16.776820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:16.776820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:16.776820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 475/952] 10.222.0.93 () {56 vars in 1120 bytes} [Thu Jun 16 18:38:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:16.784027 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c90fd5-60af-4a0f-a1d7-f157a2c20e42 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:16.840600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:16.888737 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c90fd5-60af-4a0f-a1d7-f157a2c20e42 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:16.930798 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093e763-fc59-428c-a9ef-d8bba809fa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:16.931501 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093e763-fc59-428c-a9ef-d8bba809fa04 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:16.931792 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093e763-fc59-428c-a9ef-d8bba809fa04 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:16.932077 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093e763-fc59-428c-a9ef-d8bba809fa04 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:16.932951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093e763-fc59-428c-a9ef-d8bba809fa04 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:16.933283 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093e763-fc59-428c-a9ef-d8bba809fa04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:16.934922 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093e763-fc59-428c-a9ef-d8bba809fa04 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:16.945767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 478/953] 10.222.0.93 () {56 vars in 1115 bytes} [Thu Jun 16 18:38:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:16.951489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972035e-8926-4d7b-a612-6322d1a0da30 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:16.955346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196a7cf-3718-4ecd-90ff-dbf518cb0167 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:16.955651 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196a7cf-3718-4ecd-90ff-dbf518cb0167 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:16.955932 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196a7cf-3718-4ecd-90ff-dbf518cb0167 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:16.957563 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 479/954] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:38:16.966729 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ef402-5596-4b80-8e97-9bc1135cf4a2 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:16.967044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ef402-5596-4b80-8e97-9bc1135cf4a2 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:16.967300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ef402-5596-4b80-8e97-9bc1135cf4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:16.985716 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-b64ef402-5596-4b80-8e97-9bc1135cf4a2 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:16.987235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b64ef402-5596-4b80-8e97-9bc1135cf4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:17.038533 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:17.062002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972035e-8926-4d7b-a612-6322d1a0da30 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:17.065518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 480/955] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:17.066814 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c064c9a-ef8d-4220-a185-46ca1431f3e5 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:17.067115 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c064c9a-ef8d-4220-a185-46ca1431f3e5 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:17.067398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c064c9a-ef8d-4220-a185-46ca1431f3e5 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:17.068871 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 481/956] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:17.074019 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647927ba-9e21-49c5-a1eb-b08a9956eb4e None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:17.074315 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647927ba-9e21-49c5-a1eb-b08a9956eb4e None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:17.074606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647927ba-9e21-49c5-a1eb-b08a9956eb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:17.099785 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-647927ba-9e21-49c5-a1eb-b08a9956eb4e None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:17.101426 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-647927ba-9e21-49c5-a1eb-b08a9956eb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:17.114618 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5fccf-8fb2-4309-8390-311b0fdf35d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:17.115420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5fccf-8fb2-4309-8390-311b0fdf35d3 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:17.115706 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5fccf-8fb2-4309-8390-311b0fdf35d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:17.115984 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5fccf-8fb2-4309-8390-311b0fdf35d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:17.126636 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5fccf-8fb2-4309-8390-311b0fdf35d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:17.128084 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5fccf-8fb2-4309-8390-311b0fdf35d3 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:17.146400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-52d5fccf-8fb2-4309-8390-311b0fdf35d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:17.146400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:17.146400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:17.146400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:17.146400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:17.146400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:17.146400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:17.146400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:17.146400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:17.146400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:17.146400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:17.146400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:17.146400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:17.146400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:17.146400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:17.147362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:17.147362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:17.147362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:17.147362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:17.147362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:17.147362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:17.147362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:17.147362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:17.147362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:17.147362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:17.147362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:17.147362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:17.147362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:17.147362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:17.147362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:17.147362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:17.147362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:17.148275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:17.148275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:17.148275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:17.148275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:17.148275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 476/957] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:17.148608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5fccf-8fb2-4309-8390-311b0fdf35d3 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:17.159128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:17.188507 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 482/958] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:17.188507 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647927ba-9e21-49c5-a1eb-b08a9956eb4e None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:17.264355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5fccf-8fb2-4309-8390-311b0fdf35d3 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:17.292785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:17.302434 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c559ab0-6537-4c01-84fd-0a64997f0364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:17.303235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c559ab0-6537-4c01-84fd-0a64997f0364 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:17.303513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c559ab0-6537-4c01-84fd-0a64997f0364 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:17.303784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c559ab0-6537-4c01-84fd-0a64997f0364 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:17.306236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c559ab0-6537-4c01-84fd-0a64997f0364 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:17.306236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c559ab0-6537-4c01-84fd-0a64997f0364 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:17.309744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647927ba-9e21-49c5-a1eb-b08a9956eb4e None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:17.318221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-9c559ab0-6537-4c01-84fd-0a64997f0364 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 18:38:17.318221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:17.318221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:17.318221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:17.318221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:17.318221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:17.318221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:17.318221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:17.318221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 18:38:17.318221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:17.318221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:17.318221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:17.318221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:17.318221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:17.318221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:17.318221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:17.318221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:17.319322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:17.319322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:17.319322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:17.319322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:17.319322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:17.319322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:17.319322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:17.319322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:17.319322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:17.319322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:17.319322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:17.319322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:17.319322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:17.319322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:17.319322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:17.319322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:17.320199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:17.320199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:17.320199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:17.320199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:17.320199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:17.320199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:17.320199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:17.320199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:17.320199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:17.320199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:17.320199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:17.320199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:17.320199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 18:38:17.320199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:17.320199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 477/959] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:17.321630 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c559ab0-6537-4c01-84fd-0a64997f0364 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:17.354652 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc92da-b66e-42de-909a-8688bc7e84e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:17.355253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc92da-b66e-42de-909a-8688bc7e84e8 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:17.355538 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc92da-b66e-42de-909a-8688bc7e84e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:17.355818 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc92da-b66e-42de-909a-8688bc7e84e8 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:17.356579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc92da-b66e-42de-909a-8688bc7e84e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:17.356892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc92da-b66e-42de-909a-8688bc7e84e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:17.358269 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc92da-b66e-42de-909a-8688bc7e84e8 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:17.374867 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 483/960] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:17.374867 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc92da-b66e-42de-909a-8688bc7e84e8 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:17.409189 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:17.434900 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c559ab0-6537-4c01-84fd-0a64997f0364 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:17.471626 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c5a8b-615a-46f4-b65c-3cb5b8e184b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:17.472448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c5a8b-615a-46f4-b65c-3cb5b8e184b1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:17.472943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c5a8b-615a-46f4-b65c-3cb5b8e184b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:17.473056 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c5a8b-615a-46f4-b65c-3cb5b8e184b1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:17.473691 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c5a8b-615a-46f4-b65c-3cb5b8e184b1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:17.475098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c5a8b-615a-46f4-b65c-3cb5b8e184b1 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:17.478905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc92da-b66e-42de-909a-8688bc7e84e8 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:17.487379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-b27c5a8b-615a-46f4-b65c-3cb5b8e184b1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:17.487379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:17.487379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:17.487379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:17.487379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:17.487379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:17.487379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:17.487379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:17.487379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:17.487379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:17.487379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:17.487379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:17.487379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:17.487379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:17.487379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:17.487379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:17.487379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:17.488792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:17.488792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:17.488792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:17.488792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:17.488792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:17.488792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:17.488792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:17.488792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:17.488792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:17.488792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:17.488792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:17.488792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:17.488792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:17.488792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:17.488792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:17.488792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:17.490634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:17.490634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:17.490634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:17.490634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:17.490634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:17.490634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:17.490634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:17.490634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:17.490634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:17.490634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:17.490634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:17.490634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:17.490634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:17.490634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:17.490634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 478/961] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Jun 16 18:38:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:17.491475 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c5a8b-615a-46f4-b65c-3cb5b8e184b1 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:17.526671 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a16d1-2b68-4fb2-9bb5-f3db91db7954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:17.527359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a16d1-2b68-4fb2-9bb5-f3db91db7954 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:17.527628 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a16d1-2b68-4fb2-9bb5-f3db91db7954 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:17.527907 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a16d1-2b68-4fb2-9bb5-f3db91db7954 None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:17.528648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a16d1-2b68-4fb2-9bb5-f3db91db7954 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:17.528963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a16d1-2b68-4fb2-9bb5-f3db91db7954 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:17.530771 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a16d1-2b68-4fb2-9bb5-f3db91db7954 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:17.540747 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 484/962] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Jun 16 18:38:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:17.541610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a16d1-2b68-4fb2-9bb5-f3db91db7954 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:17.547322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:17.599267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c5a8b-615a-46f4-b65c-3cb5b8e184b1 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:17.637389 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a87776-e9d2-47af-8873-e86f9cb03188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:17.638320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a87776-e9d2-47af-8873-e86f9cb03188 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:17.638824 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a87776-e9d2-47af-8873-e86f9cb03188 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:17.639321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a87776-e9d2-47af-8873-e86f9cb03188 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:17.649079 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:17.651536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a87776-e9d2-47af-8873-e86f9cb03188 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:17.652262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a16d1-2b68-4fb2-9bb5-f3db91db7954 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:17.653987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a87776-e9d2-47af-8873-e86f9cb03188 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:17.670065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-d4a87776-e9d2-47af-8873-e86f9cb03188 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:38:17.670065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:17.670065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:17.670065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:17.670065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:17.670065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:17.670065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:17.670065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:17.670065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:17.670065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:17.670065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:17.670065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:17.670065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:38:17.670065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:38:17.670065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:38:17.670065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:38:17.671414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:17.671414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:17.671414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:38:17.671414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:17.671414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:38:17.671414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:17.671414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:17.671414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:17.671414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:17.671414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:17.671414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:17.671414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:17.671414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:17.671414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:17.671414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:17.671414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:17.671414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:17.671414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:17.672723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:17.672723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:17.672723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:38:17.672723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:38:17.672723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:38:17.672723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:38:17.672723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:38:17.672723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:38:17.672723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:38:17.672723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:17.672723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 479/963] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Jun 16 18:38:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:17.672723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a87776-e9d2-47af-8873-e86f9cb03188 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:17.700358 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40341570-b548-406b-a9f3-d363fab12e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:17.701132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40341570-b548-406b-a9f3-d363fab12e9c None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:17.701354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40341570-b548-406b-a9f3-d363fab12e9c None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:17.701636 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40341570-b548-406b-a9f3-d363fab12e9c None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:17.702349 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40341570-b548-406b-a9f3-d363fab12e9c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:17.702659 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40341570-b548-406b-a9f3-d363fab12e9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:17.704042 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40341570-b548-406b-a9f3-d363fab12e9c None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:17.709615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 485/964] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Jun 16 18:38:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:17.710234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40341570-b548-406b-a9f3-d363fab12e9c None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:17.778048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a87776-e9d2-47af-8873-e86f9cb03188 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:17.791318 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:17.808743 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40341570-b548-406b-a9f3-d363fab12e9c None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:17.811907 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a4913-8930-4864-b692-f11aa4bf033c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:17.812665 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a4913-8930-4864-b692-f11aa4bf033c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:17.812943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a4913-8930-4864-b692-f11aa4bf033c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:17.813217 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a4913-8930-4864-b692-f11aa4bf033c None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:17.813933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a4913-8930-4864-b692-f11aa4bf033c None admin] RBAC: Adding query filter params (type=compute) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:17.814235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a4913-8930-4864-b692-f11aa4bf033c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:17.815588 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a4913-8930-4864-b692-f11aa4bf033c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:17.820141 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 480/965] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Jun 16 18:38:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:17.821354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84cfeb-50f9-4833-8b08-2e71d9a98505 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:17.821640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84cfeb-50f9-4833-8b08-2e71d9a98505 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:17.821917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84cfeb-50f9-4833-8b08-2e71d9a98505 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:17.827320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 481/966] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:17.827320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84cfeb-50f9-4833-8b08-2e71d9a98505 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:17.847800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f665ad5-2225-4598-bc6d-895e645bfcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:17.848538 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f665ad5-2225-4598-bc6d-895e645bfcb7 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:17.848827 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f665ad5-2225-4598-bc6d-895e645bfcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:17.849103 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f665ad5-2225-4598-bc6d-895e645bfcb7 None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:17.850564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f665ad5-2225-4598-bc6d-895e645bfcb7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:17.850877 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f665ad5-2225-4598-bc6d-895e645bfcb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:17.852376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f665ad5-2225-4598-bc6d-895e645bfcb7 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:17.874077 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 486/967] 10.222.0.93 () {56 vars in 1149 bytes} [Thu Jun 16 18:38:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:17.875677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19add2ca-9ca9-4e4b-82b7-f7f8edeef871 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:17.875971 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19add2ca-9ca9-4e4b-82b7-f7f8edeef871 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:17.876247 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19add2ca-9ca9-4e4b-82b7-f7f8edeef871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:17.893747 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-19add2ca-9ca9-4e4b-82b7-f7f8edeef871 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:17.894870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-19add2ca-9ca9-4e4b-82b7-f7f8edeef871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:17.914373 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:17.964061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84cfeb-50f9-4833-8b08-2e71d9a98505 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:17.973393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 487/968] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:17.975710 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19add2ca-9ca9-4e4b-82b7-f7f8edeef871 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:18.011082 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be320b7c-e61c-46f9-aabb-b5d021970231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:18.011750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be320b7c-e61c-46f9-aabb-b5d021970231 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:18.012032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be320b7c-e61c-46f9-aabb-b5d021970231 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:18.012306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be320b7c-e61c-46f9-aabb-b5d021970231 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:18.013042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be320b7c-e61c-46f9-aabb-b5d021970231 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:18.013350 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be320b7c-e61c-46f9-aabb-b5d021970231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:18.014726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be320b7c-e61c-46f9-aabb-b5d021970231 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:18.022912 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 482/969] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Jun 16 18:38:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:18.022912 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be320b7c-e61c-46f9-aabb-b5d021970231 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:18.068853 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:18.098561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19add2ca-9ca9-4e4b-82b7-f7f8edeef871 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:18.126940 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be320b7c-e61c-46f9-aabb-b5d021970231 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:18.140125 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb95dc-ed18-443a-aa5d-0d9b60f7fba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:18.140817 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb95dc-ed18-443a-aa5d-0d9b60f7fba3 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:18.141106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb95dc-ed18-443a-aa5d-0d9b60f7fba3 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:18.141387 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb95dc-ed18-443a-aa5d-0d9b60f7fba3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:18.162647 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c2eb2-cee2-46d0-9ccb-aebe83c55b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:18.163243 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c2eb2-cee2-46d0-9ccb-aebe83c55b04 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:18.163525 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c2eb2-cee2-46d0-9ccb-aebe83c55b04 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:18.164060 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c2eb2-cee2-46d0-9ccb-aebe83c55b04 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:18.164548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c2eb2-cee2-46d0-9ccb-aebe83c55b04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:18.165353 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:18.165976 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c2eb2-cee2-46d0-9ccb-aebe83c55b04 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:18.167709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: WARNING keystone.server.flask.common [None req-4b8c2eb2-cee2-46d0-9ccb-aebe83c55b04 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 18:38:18.210875 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb95dc-ed18-443a-aa5d-0d9b60f7fba3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:18.212623 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb95dc-ed18-443a-aa5d-0d9b60f7fba3 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:18.219796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.sql.core [None req-4b8c2eb2-cee2-46d0-9ccb-aebe83c55b04 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 18:38:18.219796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 18:38:18.219796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [parameters: {'user_id': 'a070c9b7ed584d97b0eee8b0c075062a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 18:38:18.219796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86942) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 18:38:18.237722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-4b8c2eb2-cee2-46d0-9ccb-aebe83c55b04 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 18:38:18.237722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:18.237722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 18:38:18.237722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 18:38:18.237722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 18:38:18.237722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 18:38:18.237722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 18:38:18.237722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 18:38:18.237722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 18:38:18.237722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application conn.query(q) Jun 16 18:38:18.237722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 18:38:18.237722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 18:38:18.237722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 18:38:18.237722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application result.read() Jun 16 18:38:18.237722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 18:38:18.238705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 18:38:18.238705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 18:38:18.238705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 18:38:18.238705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 18:38:18.238705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 18:38:18.238705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 18:38:18.238705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 18:38:18.238705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 18:38:18.238705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:18.238705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 18:38:18.238705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:18.238705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:18.238705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 18:38:18.238705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 18:38:18.238705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 16 18:38:18.238705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 16 18:38:18.238705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 18:38:18.238705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application next(self.gen) Jun 16 18:38:18.239638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 18:38:18.239638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application yield resource Jun 16 18:38:18.239638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 18:38:18.239638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application next(self.gen) Jun 16 18:38:18.239638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 18:38:18.239638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 18:38:18.239638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:38:18.239638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 18:38:18.239638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:38:18.239638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise self.value Jun 16 18:38:18.239638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 18:38:18.239638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 18:38:18.239638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 18:38:18.239638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application session.commit() Jun 16 18:38:18.239638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 18:38:18.239638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 18:38:18.239638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 18:38:18.240587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 18:38:18.240587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 18:38:18.240587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self.session.flush() Jun 16 18:38:18.240587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 18:38:18.240587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 18:38:18.240587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 18:38:18.240587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 18:38:18.240587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 18:38:18.240587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application compat.raise_( Jun 16 18:38:18.240587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 18:38:18.240587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception Jun 16 18:38:18.240587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 18:38:18.240587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 18:38:18.240587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 18:38:18.240587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 18:38:18.240587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 18:38:18.240587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 18:38:18.241483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 18:38:18.241483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 18:38:18.241483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 18:38:18.241483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 16 18:38:18.241483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 18:38:18.241483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 18:38:18.241483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 18:38:18.241483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 18:38:18.241483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 18:38:18.241483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 18:38:18.241483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 18:38:18.241483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 18:38:18.241483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 18:38:18.241483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 18:38:18.241483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 18:38:18.241483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception Jun 16 18:38:18.242373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 18:38:18.242373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 18:38:18.242373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 18:38:18.242373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 18:38:18.242373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 18:38:18.242373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 18:38:18.242373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 18:38:18.242373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application conn.query(q) Jun 16 18:38:18.242373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 18:38:18.242373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 18:38:18.242373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 18:38:18.242373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application result.read() Jun 16 18:38:18.242373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 18:38:18.242373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 18:38:18.242373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 18:38:18.242373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 18:38:18.243234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 18:38:18.243234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 18:38:18.243234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 18:38:18.243234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 18:38:18.243234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 18:38:18.243234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 18:38:18.243234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a070c9b7ed584d97b0eee8b0c075062a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 18:38:18.243234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 18:38:18.243234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:18.243234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:18.243234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:18.243234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:18.243234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:18.243234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:18.243234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:18.244664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:18.244664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:18.244664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:18.244664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:18.244664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:18.244664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:18.244664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:18.244664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 16 18:38:18.244664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 16 18:38:18.244664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:18.244664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:18.244664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:38:18.244664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:18.244664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:38:18.244664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:18.244664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 16 18:38:18.244664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 16 18:38:18.246627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 16 18:38:18.246627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 16 18:38:18.246627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 18:38:18.246627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 18:38:18.246627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 18:38:18.246627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:18.246627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 483/970] 10.222.0.93 () {60 vars in 1131 bytes} [Thu Jun 16 18:38:18 2022] POST /identity/v3/users => generated 160 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:18.246627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c2eb2-cee2-46d0-9ccb-aebe83c55b04 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:18.332234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 488/971] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:17 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:38:18.334826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb95dc-ed18-443a-aa5d-0d9b60f7fba3 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:18.365569 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c2eb2-cee2-46d0-9ccb-aebe83c55b04 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:18.368209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:18.390724 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:18.402623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039da38-cbc1-418d-9191-50a551a6a96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:18.403294 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039da38-cbc1-418d-9191-50a551a6a96c None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:18.403578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039da38-cbc1-418d-9191-50a551a6a96c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:18.403854 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039da38-cbc1-418d-9191-50a551a6a96c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:18.404633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039da38-cbc1-418d-9191-50a551a6a96c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:18.406202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039da38-cbc1-418d-9191-50a551a6a96c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:18.439701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb95dc-ed18-443a-aa5d-0d9b60f7fba3 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:18.475792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 484/972] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Jun 16 18:38:18 2022] POST /identity/v3/endpoints => generated 349 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:18.476856 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039da38-cbc1-418d-9191-50a551a6a96c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:18.481348 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44f797-c016-4a9a-a081-bfe3607d3533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:18.482177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44f797-c016-4a9a-a081-bfe3607d3533 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:18.482463 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44f797-c016-4a9a-a081-bfe3607d3533 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:18.482739 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44f797-c016-4a9a-a081-bfe3607d3533 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:18.495075 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44f797-c016-4a9a-a081-bfe3607d3533 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:18.497138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44f797-c016-4a9a-a081-bfe3607d3533 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:18.516956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-fe44f797-c016-4a9a-a081-bfe3607d3533 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 18:38:18.516956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:18.516956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:18.516956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:18.516956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:18.516956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:18.516956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:18.516956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:18.516956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:18.516956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:18.516956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:18.516956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:18.516956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:38:18.516956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:38:18.516956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:38:18.516956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:38:18.518217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:18.518217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:18.518217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:38:18.518217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:18.518217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:38:18.518217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:18.518217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:18.518217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:18.518217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:18.518217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:18.518217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:18.518217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:18.518217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:18.518217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:18.518217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:18.518217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:18.518217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:18.518217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:18.519346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:18.519346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:18.519346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:38:18.519346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:38:18.519346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:38:18.519346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:38:18.519346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:38:18.519346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:38:18.519346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 18:38:18.519346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:18.523418 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 489/973] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:38:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:18.524367 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44f797-c016-4a9a-a081-bfe3607d3533 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:18.626560 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039da38-cbc1-418d-9191-50a551a6a96c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:18.650296 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44f797-c016-4a9a-a081-bfe3607d3533 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:18.662387 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:18.674011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e275cd-e588-455a-9501-3dc6c49bb7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:18.674818 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e275cd-e588-455a-9501-3dc6c49bb7c7 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:18.675104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e275cd-e588-455a-9501-3dc6c49bb7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:18.676564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e275cd-e588-455a-9501-3dc6c49bb7c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:18.688543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e275cd-e588-455a-9501-3dc6c49bb7c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:18.690232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e275cd-e588-455a-9501-3dc6c49bb7c7 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:18.696263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83ec26-09dc-441d-b03c-cd95991ddf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:18.697025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83ec26-09dc-441d-b03c-cd95991ddf9b None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:18.697726 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83ec26-09dc-441d-b03c-cd95991ddf9b None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:18.698018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83ec26-09dc-441d-b03c-cd95991ddf9b None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:18.698826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83ec26-09dc-441d-b03c-cd95991ddf9b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:18.699528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83ec26-09dc-441d-b03c-cd95991ddf9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:18.701295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83ec26-09dc-441d-b03c-cd95991ddf9b None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:18.707995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-41e275cd-e588-455a-9501-3dc6c49bb7c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:18.707995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:18.707995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:18.707995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:18.707995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:18.707995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:18.707995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:18.707995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:18.707995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:18.707995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:18.707995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:18.707995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:18.707995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:18.707995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:18.707995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:18.708943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:18.708943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:18.708943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:18.708943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:18.708943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:18.708943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:18.708943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:18.708943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:18.708943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:18.708943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:18.708943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:18.708943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:18.708943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:18.708943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:18.708943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:18.708943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:18.708943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:18.710403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:18.710403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:18.710403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:18.710403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:18.710403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 485/974] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:18.717292 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e275cd-e588-455a-9501-3dc6c49bb7c7 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:18.732539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:18.744167 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 490/975] 10.222.0.93 () {56 vars in 1101 bytes} [Thu Jun 16 18:38:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:18.835284 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e275cd-e588-455a-9501-3dc6c49bb7c7 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:18.873120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd8444-6b6c-4aa3-901c-6d90e0e2b1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:18.873860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd8444-6b6c-4aa3-901c-6d90e0e2b1cd None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:18.874147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd8444-6b6c-4aa3-901c-6d90e0e2b1cd None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:18.874423 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd8444-6b6c-4aa3-901c-6d90e0e2b1cd None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:18.875167 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd8444-6b6c-4aa3-901c-6d90e0e2b1cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:18.875474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd8444-6b6c-4aa3-901c-6d90e0e2b1cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:18.876982 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd8444-6b6c-4aa3-901c-6d90e0e2b1cd None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:18.893105 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 486/976] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:18.898587 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83ec26-09dc-441d-b03c-cd95991ddf9b None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:19.012066 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83ec26-09dc-441d-b03c-cd95991ddf9b None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:19.047699 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fb39e-41bf-433b-8e64-65c5f75f3367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:19.048538 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fb39e-41bf-433b-8e64-65c5f75f3367 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:19.048829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fb39e-41bf-433b-8e64-65c5f75f3367 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:19.049108 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fb39e-41bf-433b-8e64-65c5f75f3367 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:19.056117 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fb39e-41bf-433b-8e64-65c5f75f3367 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:19.057616 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fb39e-41bf-433b-8e64-65c5f75f3367 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:19.071781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-678fb39e-41bf-433b-8e64-65c5f75f3367 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:19.071781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:19.071781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:19.071781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:19.071781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:19.071781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:19.071781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:19.071781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:19.071781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:19.071781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:19.071781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:19.071781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:19.071781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:38:19.071781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:38:19.071781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:38:19.072844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:38:19.072844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:19.072844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:19.072844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:19.072844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:19.072844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:19.072844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:19.072844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:19.072844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:19.072844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:19.072844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:19.072844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:19.072844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:19.072844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:19.072844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:19.072844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:19.072844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:19.074080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:38:19.074080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:38:19.074080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:38:19.074080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:38:19.074080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:38:19.074080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:38:19.074080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:19.074080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:19.074080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 491/977] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:19.078947 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd8444-6b6c-4aa3-901c-6d90e0e2b1cd None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:19.151703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:19.181895 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd8444-6b6c-4aa3-901c-6d90e0e2b1cd None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:19.217197 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe8628-dd16-4cd0-919f-1edadb7c87f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:19.217872 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe8628-dd16-4cd0-919f-1edadb7c87f2 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:19.218160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe8628-dd16-4cd0-919f-1edadb7c87f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:19.218439 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe8628-dd16-4cd0-919f-1edadb7c87f2 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:19.219226 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe8628-dd16-4cd0-919f-1edadb7c87f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:19.219537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe8628-dd16-4cd0-919f-1edadb7c87f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:19.221001 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe8628-dd16-4cd0-919f-1edadb7c87f2 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:19.233309 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 487/978] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:38:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:19.238954 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fb39e-41bf-433b-8e64-65c5f75f3367 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:19.273375 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:19.345972 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fb39e-41bf-433b-8e64-65c5f75f3367 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:19.381983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9938367-e6ba-4c61-88e5-a3878b70c0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:19.382643 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9938367-e6ba-4c61-88e5-a3878b70c0d2 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:19.382927 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9938367-e6ba-4c61-88e5-a3878b70c0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:19.383200 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9938367-e6ba-4c61-88e5-a3878b70c0d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:19.384020 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9938367-e6ba-4c61-88e5-a3878b70c0d2 None admin] RBAC: Adding query filter params (role.id=4b8942e18cb04e18bc69029f7203d9c0, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=1eefe0d721484433b72afca03a2c1bb6) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:19.384328 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9938367-e6ba-4c61-88e5-a3878b70c0d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:19.385777 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9938367-e6ba-4c61-88e5-a3878b70c0d2 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:19.400542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 492/979] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:19 2022] GET /identity/v3/role_assignments?user.id=1eefe0d721484433b72afca03a2c1bb6&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=4b8942e18cb04e18bc69029f7203d9c0 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:19.991330 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c856f9d-77c6-41b4-a167-e78b91600bc7 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:19.992386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c856f9d-77c6-41b4-a167-e78b91600bc7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:19.992386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c856f9d-77c6-41b4-a167-e78b91600bc7 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:19.993942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 488/980] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:19.998801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235c114-ed69-4ae0-8e22-15b54e4d136a None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:19.999258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235c114-ed69-4ae0-8e22-15b54e4d136a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:19.999445 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235c114-ed69-4ae0-8e22-15b54e4d136a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:20.015892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-0235c114-ed69-4ae0-8e22-15b54e4d136a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:20.017088 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-0235c114-ed69-4ae0-8e22-15b54e4d136a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:20.082671 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 493/981] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:20.105120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c856f9d-77c6-41b4-a167-e78b91600bc7 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:20.207003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c856f9d-77c6-41b4-a167-e78b91600bc7 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:20.235155 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:20.239960 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee552cf-b751-41d0-b46b-3c2c80949a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:20.240659 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee552cf-b751-41d0-b46b-3c2c80949a09 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:20.240948 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee552cf-b751-41d0-b46b-3c2c80949a09 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:20.241224 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee552cf-b751-41d0-b46b-3c2c80949a09 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:20.242549 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee552cf-b751-41d0-b46b-3c2c80949a09 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:20.243859 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee552cf-b751-41d0-b46b-3c2c80949a09 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:20.336465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 489/982] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Jun 16 18:38:20 2022] POST /identity/v3/services => generated 242 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:20.700168 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407e8ab-6336-46f7-a2c2-3dd5d5e7ca71 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:20.700566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407e8ab-6336-46f7-a2c2-3dd5d5e7ca71 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:20.700775 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407e8ab-6336-46f7-a2c2-3dd5d5e7ca71 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:20.702298 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 494/983] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:20.707286 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf886f0-ed6d-44c5-8af0-a080b2205aea None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:20.707591 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf886f0-ed6d-44c5-8af0-a080b2205aea None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:20.707878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf886f0-ed6d-44c5-8af0-a080b2205aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:20.724865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6bf886f0-ed6d-44c5-8af0-a080b2205aea None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:20.726379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6bf886f0-ed6d-44c5-8af0-a080b2205aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:20.799148 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 490/984] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:20.822082 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407e8ab-6336-46f7-a2c2-3dd5d5e7ca71 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:20.844162 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:20.922442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407e8ab-6336-46f7-a2c2-3dd5d5e7ca71 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:20.956773 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d267f-8ac1-4ecc-9e40-b9c75571f9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:20.957413 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d267f-8ac1-4ecc-9e40-b9c75571f9d7 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:20.957694 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d267f-8ac1-4ecc-9e40-b9c75571f9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:20.957968 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d267f-8ac1-4ecc-9e40-b9c75571f9d7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:20.958621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d267f-8ac1-4ecc-9e40-b9c75571f9d7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:20.959992 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d267f-8ac1-4ecc-9e40-b9c75571f9d7 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:20.972969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-8a9d267f-8ac1-4ecc-9e40-b9c75571f9d7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:20.972969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:20.972969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:20.972969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:20.972969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:20.972969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:20.972969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:20.972969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:20.972969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:20.972969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:20.972969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:20.972969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:20.972969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:20.972969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:20.972969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:20.972969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:20.972969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:20.974005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:20.974005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:20.974005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:20.974005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:20.974005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:20.974005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:20.974005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:20.974005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:20.974005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:20.974005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:20.974005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:20.974005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:20.974005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:20.974005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:20.974005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:20.974005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:20.974884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:20.974884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:20.974884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:20.974884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:20.974884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:20.974884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:20.974884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:20.974884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:20.974884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:20.974884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:20.974884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:20.974884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:20.974884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:20.974884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:20.976325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 495/985] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Jun 16 18:38:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:20.980711 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf886f0-ed6d-44c5-8af0-a080b2205aea None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:21.080013 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf886f0-ed6d-44c5-8af0-a080b2205aea None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:21.098125 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:21.115132 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f17076-4e52-4092-9b0b-153d11a278df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:21.115810 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f17076-4e52-4092-9b0b-153d11a278df None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:21.116098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f17076-4e52-4092-9b0b-153d11a278df None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:21.116380 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f17076-4e52-4092-9b0b-153d11a278df None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:21.118153 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f17076-4e52-4092-9b0b-153d11a278df None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:21.118153 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f17076-4e52-4092-9b0b-153d11a278df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:21.119441 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f17076-4e52-4092-9b0b-153d11a278df None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:21.127403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 491/986] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Jun 16 18:38:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:21.130087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d267f-8ac1-4ecc-9e40-b9c75571f9d7 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:21.217712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:21.233757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d267f-8ac1-4ecc-9e40-b9c75571f9d7 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:21.272224 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779b811-6b23-4717-8838-0957d2527639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:21.272926 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779b811-6b23-4717-8838-0957d2527639 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:21.273210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779b811-6b23-4717-8838-0957d2527639 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:21.273485 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779b811-6b23-4717-8838-0957d2527639 None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:21.274776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779b811-6b23-4717-8838-0957d2527639 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:21.275081 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779b811-6b23-4717-8838-0957d2527639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:21.276485 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779b811-6b23-4717-8838-0957d2527639 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:21.281754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 496/987] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Jun 16 18:38:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:21.287412 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f17076-4e52-4092-9b0b-153d11a278df None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:21.394412 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f17076-4e52-4092-9b0b-153d11a278df None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:21.428357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f455e-4650-420b-8137-b62f4d44213a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:21.429074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f455e-4650-420b-8137-b62f4d44213a None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:21.429355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f455e-4650-420b-8137-b62f4d44213a None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:21.429628 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f455e-4650-420b-8137-b62f4d44213a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:21.430995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f455e-4650-420b-8137-b62f4d44213a None admin] RBAC: Adding query filter params (interface=admin, service_id=d87b2f9d4afb4755ad6cf5a6a5f2a9d2, region_id=RegionOne) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:21.431312 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f455e-4650-420b-8137-b62f4d44213a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:21.432752 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f455e-4650-420b-8137-b62f4d44213a None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:21.438915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 492/988] 10.222.0.93 () {56 vars in 1249 bytes} [Thu Jun 16 18:38:21 2022] GET /identity/v3/endpoints?service_id=d87b2f9d4afb4755ad6cf5a6a5f2a9d2&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:21.444532 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779b811-6b23-4717-8838-0957d2527639 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:21.550786 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779b811-6b23-4717-8838-0957d2527639 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:21.574366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b11cd-9d90-4f5b-b560-04ae1e812aa0 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:21.574750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b11cd-9d90-4f5b-b560-04ae1e812aa0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:21.575143 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b11cd-9d90-4f5b-b560-04ae1e812aa0 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:21.576813 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 493/989] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:38:21.581441 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee4be1-665f-4582-bb57-373d25d34bd7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:21.581799 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee4be1-665f-4582-bb57-373d25d34bd7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:21.582153 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee4be1-665f-4582-bb57-373d25d34bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:21.586350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f327cc-35e5-4cd6-882d-1605cf574549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:21.587342 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f327cc-35e5-4cd6-882d-1605cf574549 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:21.587634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f327cc-35e5-4cd6-882d-1605cf574549 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:21.587916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f327cc-35e5-4cd6-882d-1605cf574549 None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:21.589573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f327cc-35e5-4cd6-882d-1605cf574549 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:21.591217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f327cc-35e5-4cd6-882d-1605cf574549 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:21.598733 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 497/990] 10.222.0.93 () {56 vars in 1087 bytes} [Thu Jun 16 18:38:21 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:38:21.605733 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-1cee4be1-665f-4582-bb57-373d25d34bd7 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:21.607081 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1cee4be1-665f-4582-bb57-373d25d34bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:21.658475 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:21.686698 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 494/991] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:21.717578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f327cc-35e5-4cd6-882d-1605cf574549 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:21.739883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:21.831574 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f327cc-35e5-4cd6-882d-1605cf574549 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:21.866764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d1873-3d84-4cb1-bb32-58e5dfe074ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:21.867571 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d1873-3d84-4cb1-bb32-58e5dfe074ea None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:21.867857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d1873-3d84-4cb1-bb32-58e5dfe074ea None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:21.868164 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d1873-3d84-4cb1-bb32-58e5dfe074ea None admin] PATH_INFO: `/v3/services/image` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:21.868848 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d1873-3d84-4cb1-bb32-58e5dfe074ea None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:21.870216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d1873-3d84-4cb1-bb32-58e5dfe074ea None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:21.881815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-5f1d1873-3d84-4cb1-bb32-58e5dfe074ea None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 18:38:21.881815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:21.881815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:21.881815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:21.881815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:21.881815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:21.881815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:21.881815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:21.881815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 18:38:21.881815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:21.881815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:21.881815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:21.881815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:21.881815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:21.881815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:21.881815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:21.881815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:21.882828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:21.882828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:21.882828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:21.882828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:21.882828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:21.882828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:21.882828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:21.882828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:21.882828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:21.882828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:21.882828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:21.882828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:21.882828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:21.882828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:21.882828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:21.882828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:21.883693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:21.883693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:21.883693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:21.883693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:21.883693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:21.883693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:21.883693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:21.883693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:21.883693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:21.883693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:21.883693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:21.883693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:21.883693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 18:38:21.883693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:21.883693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 498/992] 10.222.0.93 () {56 vars in 1105 bytes} [Thu Jun 16 18:38:21 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:21.891287 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee4be1-665f-4582-bb57-373d25d34bd7 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:21.992370 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee4be1-665f-4582-bb57-373d25d34bd7 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:22.029870 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559fa19-9351-4115-869e-7e948917756f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:22.030546 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559fa19-9351-4115-869e-7e948917756f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:22.030830 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559fa19-9351-4115-869e-7e948917756f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:22.031158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559fa19-9351-4115-869e-7e948917756f None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:22.031881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559fa19-9351-4115-869e-7e948917756f None admin] RBAC: Adding query filter params (name=image) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:22.032276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559fa19-9351-4115-869e-7e948917756f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:22.033683 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559fa19-9351-4115-869e-7e948917756f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:22.043486 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 495/993] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:22.044795 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d1873-3d84-4cb1-bb32-58e5dfe074ea None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:22.125491 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:22.149169 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d1873-3d84-4cb1-bb32-58e5dfe074ea None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:22.183969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babd2ae-a246-48d4-a33f-df3a9e5bdcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:22.184670 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babd2ae-a246-48d4-a33f-df3a9e5bdcf2 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:22.184959 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babd2ae-a246-48d4-a33f-df3a9e5bdcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:22.185291 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babd2ae-a246-48d4-a33f-df3a9e5bdcf2 None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:22.186000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babd2ae-a246-48d4-a33f-df3a9e5bdcf2 None admin] RBAC: Adding query filter params (type=image) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:22.186316 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babd2ae-a246-48d4-a33f-df3a9e5bdcf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:22.187692 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babd2ae-a246-48d4-a33f-df3a9e5bdcf2 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:22.196700 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 499/994] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:22.486079 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e95b01-f075-42bb-9d96-fd265aa60a58 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:22.486579 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e95b01-f075-42bb-9d96-fd265aa60a58 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:22.486579 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e95b01-f075-42bb-9d96-fd265aa60a58 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:22.488035 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 496/995] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:22.492895 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279215c-cebb-41f3-a4dc-7f99b6f385c3 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:22.493181 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279215c-cebb-41f3-a4dc-7f99b6f385c3 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:22.493457 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279215c-cebb-41f3-a4dc-7f99b6f385c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:22.511092 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-f279215c-cebb-41f3-a4dc-7f99b6f385c3 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:22.512260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f279215c-cebb-41f3-a4dc-7f99b6f385c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:22.578111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 500/996] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:22.600336 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e95b01-f075-42bb-9d96-fd265aa60a58 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:22.645252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:22.707143 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e95b01-f075-42bb-9d96-fd265aa60a58 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:22.742368 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1c302-69d6-4c0e-94d9-e2c0d2eaecac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:22.742952 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1c302-69d6-4c0e-94d9-e2c0d2eaecac None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:22.743232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1c302-69d6-4c0e-94d9-e2c0d2eaecac None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:22.743507 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1c302-69d6-4c0e-94d9-e2c0d2eaecac None admin] PATH_INFO: `/v3/services/compute` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:22.744209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1c302-69d6-4c0e-94d9-e2c0d2eaecac None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:22.745595 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1c302-69d6-4c0e-94d9-e2c0d2eaecac None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:22.757314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-04e1c302-69d6-4c0e-94d9-e2c0d2eaecac None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 18:38:22.757314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:22.757314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:22.757314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:22.757314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:22.757314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:22.757314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:22.757314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:22.757314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 18:38:22.757314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:22.757314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:22.757314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:22.757314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:22.757314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:22.757314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:22.757314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:22.757314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:22.758324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:22.758324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:22.758324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:22.758324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:22.758324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:22.758324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:22.758324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:22.758324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:22.758324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:22.758324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:22.758324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:22.758324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:22.758324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:22.758324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:22.758324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:22.758324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:22.759185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:22.759185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:22.759185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:22.759185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:22.759185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:22.759185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:22.759185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:22.759185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:22.759185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:22.759185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:22.759185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:22.759185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:22.759185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 18:38:22.759185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:22.761223 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 497/997] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:22.764903 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279215c-cebb-41f3-a4dc-7f99b6f385c3 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:22.835452 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:22.866210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279215c-cebb-41f3-a4dc-7f99b6f385c3 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:22.901696 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca30ec-84d3-44e4-b888-d9d6d0b1eee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:22.902479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca30ec-84d3-44e4-b888-d9d6d0b1eee2 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:22.902766 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca30ec-84d3-44e4-b888-d9d6d0b1eee2 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:22.903042 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca30ec-84d3-44e4-b888-d9d6d0b1eee2 None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:22.903744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca30ec-84d3-44e4-b888-d9d6d0b1eee2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:22.904051 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca30ec-84d3-44e4-b888-d9d6d0b1eee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:22.905452 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca30ec-84d3-44e4-b888-d9d6d0b1eee2 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:22.914935 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 501/998] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Jun 16 18:38:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:22.916580 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1c302-69d6-4c0e-94d9-e2c0d2eaecac None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:23.016770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1c302-69d6-4c0e-94d9-e2c0d2eaecac None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:23.019040 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:23.050045 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dd6bd-74e4-47f4-9217-fd653effe7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:23.051051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dd6bd-74e4-47f4-9217-fd653effe7ee None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:23.051051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dd6bd-74e4-47f4-9217-fd653effe7ee None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:23.051306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dd6bd-74e4-47f4-9217-fd653effe7ee None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:23.051951 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582dd6bd-74e4-47f4-9217-fd653effe7ee None admin] RBAC: Adding query filter params (type=compute) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:23.052255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582dd6bd-74e4-47f4-9217-fd653effe7ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:23.054024 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582dd6bd-74e4-47f4-9217-fd653effe7ee None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:23.060325 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 498/999] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Jun 16 18:38:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:23.066098 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca30ec-84d3-44e4-b888-d9d6d0b1eee2 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:23.169038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca30ec-84d3-44e4-b888-d9d6d0b1eee2 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:23.202531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e386280-81cc-44e5-82c1-864ce1779814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:23.203188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e386280-81cc-44e5-82c1-864ce1779814 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:23.203471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e386280-81cc-44e5-82c1-864ce1779814 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:23.203745 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e386280-81cc-44e5-82c1-864ce1779814 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:23.204550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e386280-81cc-44e5-82c1-864ce1779814 None admin] RBAC: Adding query filter params (interface=public, service_id=7425b2f765304e84973de5cbd29a9e6b, region_id=RegionOne) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:23.204863 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e386280-81cc-44e5-82c1-864ce1779814 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:23.206351 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e386280-81cc-44e5-82c1-864ce1779814 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:23.207912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:23.216106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 502/1000] 10.222.0.93 () {56 vars in 1251 bytes} [Thu Jun 16 18:38:23 2022] GET /identity/v3/endpoints?service_id=7425b2f765304e84973de5cbd29a9e6b&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:23.219544 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dd6bd-74e4-47f4-9217-fd653effe7ee None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:23.331638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dd6bd-74e4-47f4-9217-fd653effe7ee None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:23.366599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98247648-9727-4bce-9a7b-141df9ac0a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:23.367272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98247648-9727-4bce-9a7b-141df9ac0a16 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:23.367636 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98247648-9727-4bce-9a7b-141df9ac0a16 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:23.367915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98247648-9727-4bce-9a7b-141df9ac0a16 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:23.368638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98247648-9727-4bce-9a7b-141df9ac0a16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:23.370560 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98247648-9727-4bce-9a7b-141df9ac0a16 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:23.384730 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 499/1001] 10.222.0.93 () {56 vars in 1087 bytes} [Thu Jun 16 18:38:23 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:38:23.759655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20a4c2-4b62-4877-bd86-fefd94c587ad None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:23.760029 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20a4c2-4b62-4877-bd86-fefd94c587ad None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:23.760283 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20a4c2-4b62-4877-bd86-fefd94c587ad None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:23.761830 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 503/1002] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:23.766979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d40057-de5e-4e87-a3ce-2adc93f3000a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:23.767418 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d40057-de5e-4e87-a3ce-2adc93f3000a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:23.767535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d40057-de5e-4e87-a3ce-2adc93f3000a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:23.784548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-40d40057-de5e-4e87-a3ce-2adc93f3000a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:23.785735 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-40d40057-de5e-4e87-a3ce-2adc93f3000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:23.812675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:23.854814 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 500/1003] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:23.878151 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20a4c2-4b62-4877-bd86-fefd94c587ad None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:23.981571 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20a4c2-4b62-4877-bd86-fefd94c587ad None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:24.015048 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99b16a-cf72-4a92-8c72-a12c1b53edf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:24.015779 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99b16a-cf72-4a92-8c72-a12c1b53edf4 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:24.016068 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99b16a-cf72-4a92-8c72-a12c1b53edf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:24.016347 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99b16a-cf72-4a92-8c72-a12c1b53edf4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:24.017027 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99b16a-cf72-4a92-8c72-a12c1b53edf4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:24.018410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99b16a-cf72-4a92-8c72-a12c1b53edf4 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:24.030883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-ae99b16a-cf72-4a92-8c72-a12c1b53edf4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:24.030883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:24.030883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:24.030883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:24.030883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:24.030883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:24.030883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:24.030883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:24.030883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:24.030883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:24.030883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:24.030883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:24.030883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:24.030883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:24.030883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:24.030883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:24.030883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:24.031908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:24.031908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:24.031908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:24.031908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:24.031908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:24.031908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:24.031908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:24.031908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:24.031908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:24.031908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:24.031908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:24.031908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:24.031908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:24.031908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:24.031908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:24.031908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:24.033222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:24.033222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:24.033222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:24.033222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:24.033222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:24.033222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:24.033222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:24.033222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:24.033222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:24.033222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:24.033222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:24.033222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:24.033222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:24.033222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:24.036513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 504/1004] 10.222.0.93 () {56 vars in 1126 bytes} [Thu Jun 16 18:38:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:24.038399 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d40057-de5e-4e87-a3ce-2adc93f3000a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:24.139973 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d40057-de5e-4e87-a3ce-2adc93f3000a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:24.175543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c9d9b-0d69-4f64-b57d-342712e84e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:24.176218 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c9d9b-0d69-4f64-b57d-342712e84e53 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:24.176541 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c9d9b-0d69-4f64-b57d-342712e84e53 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:24.176824 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c9d9b-0d69-4f64-b57d-342712e84e53 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:24.177542 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c9d9b-0d69-4f64-b57d-342712e84e53 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:24.177854 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c9d9b-0d69-4f64-b57d-342712e84e53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:24.179218 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c9d9b-0d69-4f64-b57d-342712e84e53 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:24.184359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 501/1005] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Jun 16 18:38:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:24.189938 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99b16a-cf72-4a92-8c72-a12c1b53edf4 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:24.255266 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:24.303786 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99b16a-cf72-4a92-8c72-a12c1b53edf4 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:24.336493 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba112df5-f125-46fd-808c-fda8f427a3bf None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:24.336781 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba112df5-f125-46fd-808c-fda8f427a3bf None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:24.337064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba112df5-f125-46fd-808c-fda8f427a3bf None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:24.338561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 502/1006] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:24.339320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c9a7f-c213-49ae-b2dc-fa8733f643f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:24.339805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c9a7f-c213-49ae-b2dc-fa8733f643f8 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:24.340092 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c9a7f-c213-49ae-b2dc-fa8733f643f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:24.340371 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c9a7f-c213-49ae-b2dc-fa8733f643f8 None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:24.341119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c9a7f-c213-49ae-b2dc-fa8733f643f8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:24.341433 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c9a7f-c213-49ae-b2dc-fa8733f643f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:24.343080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c9a7f-c213-49ae-b2dc-fa8733f643f8 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:24.344257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbd963-1d14-443d-a076-8ef352a34463 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:24.344588 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbd963-1d14-443d-a076-8ef352a34463 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:24.344878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbd963-1d14-443d-a076-8ef352a34463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:24.348917 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 505/1007] 10.222.0.93 () {56 vars in 1122 bytes} [Thu Jun 16 18:38:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:24.354340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c9a7f-c213-49ae-b2dc-fa8733f643f8 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:24.365696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-83dbd963-1d14-443d-a076-8ef352a34463 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:24.367073 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-83dbd963-1d14-443d-a076-8ef352a34463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:24.388630 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:24.447891 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 503/1008] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:24.468707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c9a7f-c213-49ae-b2dc-fa8733f643f8 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:24.471556 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbd963-1d14-443d-a076-8ef352a34463 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:24.497588 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:24.506419 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee6d48-d84c-4859-a8b2-880ea0d1df0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:24.507141 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee6d48-d84c-4859-a8b2-880ea0d1df0b None admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:24.507437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee6d48-d84c-4859-a8b2-880ea0d1df0b None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:24.507716 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee6d48-d84c-4859-a8b2-880ea0d1df0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:24.508496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee6d48-d84c-4859-a8b2-880ea0d1df0b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:24.509894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee6d48-d84c-4859-a8b2-880ea0d1df0b None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:24.573571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbd963-1d14-443d-a076-8ef352a34463 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:24.609085 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 506/1009] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Jun 16 18:38:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:38:24.615354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf530c5-e5d2-477e-911e-0584a43ba38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:24.616049 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf530c5-e5d2-477e-911e-0584a43ba38c None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:24.616334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf530c5-e5d2-477e-911e-0584a43ba38c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:24.616641 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf530c5-e5d2-477e-911e-0584a43ba38c None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:24.617485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf530c5-e5d2-477e-911e-0584a43ba38c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:24.618899 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf530c5-e5d2-477e-911e-0584a43ba38c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:24.728484 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 504/1010] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Jun 16 18:38:24 2022] POST /identity/v3/services => generated 242 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:25.521128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ea618-b82e-4486-b099-4be875bd316f None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:25.521692 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ea618-b82e-4486-b099-4be875bd316f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:25.521692 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ea618-b82e-4486-b099-4be875bd316f None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:25.522999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 507/1011] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:25.528630 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e58c6-b0b8-4f72-8ca4-f5b7f5117835 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:25.529021 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e58c6-b0b8-4f72-8ca4-f5b7f5117835 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:25.529201 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e58c6-b0b8-4f72-8ca4-f5b7f5117835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:25.546051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-625e58c6-b0b8-4f72-8ca4-f5b7f5117835 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:25.547235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-625e58c6-b0b8-4f72-8ca4-f5b7f5117835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:25.554547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:25.625553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 505/1012] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:25 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:25.648417 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ea618-b82e-4486-b099-4be875bd316f None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:25.764742 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ea618-b82e-4486-b099-4be875bd316f None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:25.799991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80528bf-666c-46a3-b9eb-b6f90c2a4352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:25.800773 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80528bf-666c-46a3-b9eb-b6f90c2a4352 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:25.801113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80528bf-666c-46a3-b9eb-b6f90c2a4352 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:25.801308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80528bf-666c-46a3-b9eb-b6f90c2a4352 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:25.801964 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80528bf-666c-46a3-b9eb-b6f90c2a4352 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:25.803421 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80528bf-666c-46a3-b9eb-b6f90c2a4352 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:25.815512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-d80528bf-666c-46a3-b9eb-b6f90c2a4352 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 18:38:25.815512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:25.815512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:25.815512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:25.815512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:25.815512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:25.815512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:25.815512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:25.815512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 18:38:25.815512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:25.815512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:25.815512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:25.815512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:25.815512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:25.815512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:25.815512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:25.815512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:25.816829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:25.816829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:25.816829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:25.816829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:25.816829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:25.816829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:25.816829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:25.816829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:25.816829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:25.816829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:25.816829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:25.816829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:25.816829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:25.816829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:25.816829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:25.816829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:25.817712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:25.817712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:25.817712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:25.817712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:25.817712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:25.817712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:25.817712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:25.817712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:25.817712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:25.817712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:25.817712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:25.817712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:25.817712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 18:38:25.817712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:25.817712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 508/1013] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:25.826016 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e58c6-b0b8-4f72-8ca4-f5b7f5117835 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:25.929103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e58c6-b0b8-4f72-8ca4-f5b7f5117835 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:25.963227 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b0a5b-8b69-423e-b453-1e3eea817829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:25.963897 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b0a5b-8b69-423e-b453-1e3eea817829 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:25.964180 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b0a5b-8b69-423e-b453-1e3eea817829 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:25.964540 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b0a5b-8b69-423e-b453-1e3eea817829 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:25.965286 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b0a5b-8b69-423e-b453-1e3eea817829 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:25.965641 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b0a5b-8b69-423e-b453-1e3eea817829 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:25.967013 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b0a5b-8b69-423e-b453-1e3eea817829 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:25.976802 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 506/1014] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Jun 16 18:38:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:25.978015 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80528bf-666c-46a3-b9eb-b6f90c2a4352 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:26.029908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:26.088602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80528bf-666c-46a3-b9eb-b6f90c2a4352 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:26.114379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44805257-6dda-4f71-9770-627f32262c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:26.115045 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44805257-6dda-4f71-9770-627f32262c31 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:26.115332 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44805257-6dda-4f71-9770-627f32262c31 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:26.115612 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44805257-6dda-4f71-9770-627f32262c31 None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:26.116328 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44805257-6dda-4f71-9770-627f32262c31 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:26.116667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44805257-6dda-4f71-9770-627f32262c31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:26.118043 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44805257-6dda-4f71-9770-627f32262c31 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:26.128469 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 509/1015] 10.222.0.93 () {56 vars in 1112 bytes} [Thu Jun 16 18:38:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:26.129385 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b0a5b-8b69-423e-b453-1e3eea817829 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:26.132193 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:26.230152 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b0a5b-8b69-423e-b453-1e3eea817829 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:26.275270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cd7f3-95d5-4b24-9d10-4a6fcb076690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:26.275945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cd7f3-95d5-4b24-9d10-4a6fcb076690 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:26.276231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cd7f3-95d5-4b24-9d10-4a6fcb076690 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:26.276545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cd7f3-95d5-4b24-9d10-4a6fcb076690 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:26.277310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cd7f3-95d5-4b24-9d10-4a6fcb076690 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:26.278722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cd7f3-95d5-4b24-9d10-4a6fcb076690 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:26.373092 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 507/1016] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Jun 16 18:38:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:38:26.759966 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9ee97-5908-460c-86ec-1ab72a26dee3 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:26.760522 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9ee97-5908-460c-86ec-1ab72a26dee3 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:26.760522 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9ee97-5908-460c-86ec-1ab72a26dee3 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:26.761940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 510/1017] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:26.767067 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc5a12-313c-487c-93a4-6589866707f0 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:26.767477 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc5a12-313c-487c-93a4-6589866707f0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:26.767643 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc5a12-313c-487c-93a4-6589866707f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:26.784970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-0acc5a12-313c-487c-93a4-6589866707f0 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:26.786144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0acc5a12-313c-487c-93a4-6589866707f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:26.845525 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:26.866980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 508/1018] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:26.889634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9ee97-5908-460c-86ec-1ab72a26dee3 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:26.892553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b709429-7ac7-42ab-a50d-c8912a77c530 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:26.892852 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b709429-7ac7-42ab-a50d-c8912a77c530 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:26.893191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b709429-7ac7-42ab-a50d-c8912a77c530 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:26.894695 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 509/1019] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:26.899408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e315e9b-ced0-4a92-8432-d175a23c900e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:26.899703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e315e9b-ced0-4a92-8432-d175a23c900e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:26.899987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e315e9b-ced0-4a92-8432-d175a23c900e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:26.916982 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5e315e9b-ced0-4a92-8432-d175a23c900e None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:26.919885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5e315e9b-ced0-4a92-8432-d175a23c900e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:26.992399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9ee97-5908-460c-86ec-1ab72a26dee3 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:26.993297 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 510/1020] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:27.006685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:27.019036 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e315e9b-ced0-4a92-8432-d175a23c900e None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:27.026911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c0cdf-fc07-4952-9fbe-f3cc0b547e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:27.027721 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c0cdf-fc07-4952-9fbe-f3cc0b547e2b None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:27.028552 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c0cdf-fc07-4952-9fbe-f3cc0b547e2b None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:27.028851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c0cdf-fc07-4952-9fbe-f3cc0b547e2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:27.030045 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c0cdf-fc07-4952-9fbe-f3cc0b547e2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:27.031529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c0cdf-fc07-4952-9fbe-f3cc0b547e2b None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:27.033191 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 511/1021] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:27.038997 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c0cdf-fc07-4952-9fbe-f3cc0b547e2b None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:27.130146 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e315e9b-ced0-4a92-8432-d175a23c900e None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:27.145892 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:27.150698 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c0cdf-fc07-4952-9fbe-f3cc0b547e2b None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:27.170695 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b783eca-7947-4f88-867a-05084714bf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:27.171496 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b783eca-7947-4f88-867a-05084714bf01 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:27.171779 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b783eca-7947-4f88-867a-05084714bf01 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:27.172052 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b783eca-7947-4f88-867a-05084714bf01 None admin] PATH_INFO: `/v3/services/image` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:27.172745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b783eca-7947-4f88-867a-05084714bf01 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:27.174114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b783eca-7947-4f88-867a-05084714bf01 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:27.186290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-1b783eca-7947-4f88-867a-05084714bf01 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 18:38:27.186290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:27.186290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:27.186290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:27.186290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:27.186290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:27.186290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:27.186290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:27.186290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 18:38:27.186290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:27.186290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:27.186290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:27.186290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:27.186290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:27.186290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:27.186290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:27.186290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:27.187320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:27.187320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:27.187320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:27.187320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:27.187320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:27.187320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:27.187320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:27.187320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:27.187320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:27.187320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:27.187320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:27.187320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:27.187320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:27.187320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:27.187320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:27.187320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:27.188512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:27.188512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:27.188512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:27.188512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:27.188512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:27.188512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:27.188512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:27.188512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:27.188512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:27.188512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:27.188512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:27.188512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:27.188512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 18:38:27.188512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:27.188512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 511/1022] 10.222.0.93 () {56 vars in 1105 bytes} [Thu Jun 16 18:38:27 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:27.190106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62611a-583f-448f-8199-9c981af7e9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:27.190786 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62611a-583f-448f-8199-9c981af7e9f6 None admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:27.191076 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62611a-583f-448f-8199-9c981af7e9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:27.191358 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62611a-583f-448f-8199-9c981af7e9f6 None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:27.192338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62611a-583f-448f-8199-9c981af7e9f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:27.193195 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b783eca-7947-4f88-867a-05084714bf01 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:27.193566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62611a-583f-448f-8199-9c981af7e9f6 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:27.298207 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 512/1023] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Jun 16 18:38:27 2022] POST /identity/v3/projects => generated 311 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:38:27.303077 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b783eca-7947-4f88-867a-05084714bf01 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:27.340394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d29cb2-4b0c-4667-bccf-2677a92226eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:27.341867 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d29cb2-4b0c-4667-bccf-2677a92226eb None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:27.342156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d29cb2-4b0c-4667-bccf-2677a92226eb None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:27.342435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d29cb2-4b0c-4667-bccf-2677a92226eb None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:27.343173 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d29cb2-4b0c-4667-bccf-2677a92226eb None admin] RBAC: Adding query filter params (name=image) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:27.343506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d29cb2-4b0c-4667-bccf-2677a92226eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:27.345221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d29cb2-4b0c-4667-bccf-2677a92226eb None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:27.351145 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 512/1024] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:27.357128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62611a-583f-448f-8199-9c981af7e9f6 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:27.466435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:27.534637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62611a-583f-448f-8199-9c981af7e9f6 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:27.573037 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987c172-ed68-4a79-820b-6d0fa3c10104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:27.573641 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987c172-ed68-4a79-820b-6d0fa3c10104 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:27.573929 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987c172-ed68-4a79-820b-6d0fa3c10104 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:27.574211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987c172-ed68-4a79-820b-6d0fa3c10104 None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:27.574928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987c172-ed68-4a79-820b-6d0fa3c10104 None admin] RBAC: Adding query filter params (type=image) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:27.575239 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987c172-ed68-4a79-820b-6d0fa3c10104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:27.577216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987c172-ed68-4a79-820b-6d0fa3c10104 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:27.582395 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 513/1025] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:27.588345 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d29cb2-4b0c-4667-bccf-2677a92226eb None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:27.634267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:27.694115 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d29cb2-4b0c-4667-bccf-2677a92226eb None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:27.727868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9071f4-4d39-4b66-9f37-af8808f68650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:27.728552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9071f4-4d39-4b66-9f37-af8808f68650 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:27.728838 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9071f4-4d39-4b66-9f37-af8808f68650 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:27.729114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9071f4-4d39-4b66-9f37-af8808f68650 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:27.729898 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9071f4-4d39-4b66-9f37-af8808f68650 None admin] RBAC: Adding query filter params (interface=public, service_id=1889ab491fdf41f48351890b9e53b132, region_id=RegionOne) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:27.730210 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9071f4-4d39-4b66-9f37-af8808f68650 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:27.731572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9071f4-4d39-4b66-9f37-af8808f68650 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:27.745168 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 513/1026] 10.222.0.93 () {56 vars in 1251 bytes} [Thu Jun 16 18:38:27 2022] GET /identity/v3/endpoints?service_id=1889ab491fdf41f48351890b9e53b132&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:27.746327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987c172-ed68-4a79-820b-6d0fa3c10104 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:27.845905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:27.850646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987c172-ed68-4a79-820b-6d0fa3c10104 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:27.884667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13481a00-65da-4a9e-ac00-ba4ffaa8093f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:27.885336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13481a00-65da-4a9e-ac00-ba4ffaa8093f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:27.885620 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13481a00-65da-4a9e-ac00-ba4ffaa8093f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:27.885894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13481a00-65da-4a9e-ac00-ba4ffaa8093f None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:27.886574 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13481a00-65da-4a9e-ac00-ba4ffaa8093f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:27.887935 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13481a00-65da-4a9e-ac00-ba4ffaa8093f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:27.901057 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 514/1027] 10.222.0.93 () {56 vars in 1087 bytes} [Thu Jun 16 18:38:27 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:38:28.587968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0ca3b-3606-45e6-8e89-c8ab6927065f None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:28.588844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0ca3b-3606-45e6-8e89-c8ab6927065f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:28.588844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0ca3b-3606-45e6-8e89-c8ab6927065f None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:28.590099 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 514/1028] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:28.596282 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adc5b1-0e49-4a63-9e6a-c0070651ad69 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:28.596603 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adc5b1-0e49-4a63-9e6a-c0070651ad69 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:28.596886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adc5b1-0e49-4a63-9e6a-c0070651ad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:28.613130 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-c0adc5b1-0e49-4a63-9e6a-c0070651ad69 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:28.614291 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c0adc5b1-0e49-4a63-9e6a-c0070651ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:28.684012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 515/1029] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:28.712659 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0ca3b-3606-45e6-8e89-c8ab6927065f None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:28.816097 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0ca3b-3606-45e6-8e89-c8ab6927065f None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:28.822755 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:28.850284 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdffa5-4f1b-4945-a94f-197b208e0fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:28.851025 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdffa5-4f1b-4945-a94f-197b208e0fb7 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:28.851306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdffa5-4f1b-4945-a94f-197b208e0fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:28.851581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdffa5-4f1b-4945-a94f-197b208e0fb7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:28.862285 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdffa5-4f1b-4945-a94f-197b208e0fb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:28.870435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-94fdffa5-4f1b-4945-a94f-197b208e0fb7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:28.870435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:28.870435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:28.870435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:28.870435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:28.870435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:28.870435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:28.870435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:28.870435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:28.870435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:28.870435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:28.870435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:28.870435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:28.870435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:28.870435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:28.870435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:28.871381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:28.871381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:28.871381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:28.871381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:28.871381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:28.871381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:28.871381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:28.871381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:28.871381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:28.871381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:28.871381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:28.871381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:28.871381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:28.871381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:28.871381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:28.871381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:28.872239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:28.872239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:28.872239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:28.872239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:28.872239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:28.872239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:28.872239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:28.872239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:28.872239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:28.872239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:28.872239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:28.872239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:28.873657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 515/1030] 10.222.0.93 () {56 vars in 1120 bytes} [Thu Jun 16 18:38:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:28.877557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adc5b1-0e49-4a63-9e6a-c0070651ad69 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:28.972411 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:28.982565 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adc5b1-0e49-4a63-9e6a-c0070651ad69 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:29.025403 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc609133-d7a6-4416-a55d-b54de7dc5cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:29.026804 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc609133-d7a6-4416-a55d-b54de7dc5cae None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:29.027285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc609133-d7a6-4416-a55d-b54de7dc5cae None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:29.028125 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc609133-d7a6-4416-a55d-b54de7dc5cae None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:29.029118 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc609133-d7a6-4416-a55d-b54de7dc5cae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:29.029701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc609133-d7a6-4416-a55d-b54de7dc5cae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:29.031880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc609133-d7a6-4416-a55d-b54de7dc5cae None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:29.047114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 516/1031] 10.222.0.93 () {56 vars in 1115 bytes} [Thu Jun 16 18:38:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:29.048641 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdffa5-4f1b-4945-a94f-197b208e0fb7 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:29.151933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdffa5-4f1b-4945-a94f-197b208e0fb7 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:29.187552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed772d-9c1d-4a03-9ced-c928b6dc2916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:29.188344 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed772d-9c1d-4a03-9ced-c928b6dc2916 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:29.188650 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed772d-9c1d-4a03-9ced-c928b6dc2916 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:29.188917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed772d-9c1d-4a03-9ced-c928b6dc2916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:29.199630 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed772d-9c1d-4a03-9ced-c928b6dc2916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:29.201094 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed772d-9c1d-4a03-9ced-c928b6dc2916 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:29.218945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-8eed772d-9c1d-4a03-9ced-c928b6dc2916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:29.218945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:29.218945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:29.218945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:29.218945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:29.218945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:29.218945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:29.218945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:29.218945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:29.218945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:29.218945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:29.218945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:29.218945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:29.218945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:29.218945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:29.219840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:29.219840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:29.219840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:29.219840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:29.219840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:29.219840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:29.219840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:29.219840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:29.219840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:29.219840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:29.219840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:29.219840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:29.219840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:29.219840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:29.219840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:29.219840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:29.219840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:29.221400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:29.221400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:29.221400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:29.221400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:29.224745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 516/1032] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:29.226001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc609133-d7a6-4416-a55d-b54de7dc5cae None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:29.336083 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc609133-d7a6-4416-a55d-b54de7dc5cae None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:29.370859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c6780-5393-44d6-a52b-4610b4472d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:29.371528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c6780-5393-44d6-a52b-4610b4472d8d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:29.371808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c6780-5393-44d6-a52b-4610b4472d8d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:29.372083 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c6780-5393-44d6-a52b-4610b4472d8d None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:29.372862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c6780-5393-44d6-a52b-4610b4472d8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:29.373163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c6780-5393-44d6-a52b-4610b4472d8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:29.374566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c6780-5393-44d6-a52b-4610b4472d8d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:29.386645 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 517/1033] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:29.392890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed772d-9c1d-4a03-9ced-c928b6dc2916 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:29.414226 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:29.494936 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c9bd0-f2fb-4afd-8141-95ca9a7be2ab None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:29.495351 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c9bd0-f2fb-4afd-8141-95ca9a7be2ab None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:29.495637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c9bd0-f2fb-4afd-8141-95ca9a7be2ab None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:29.497176 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 518/1034] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:38:29.501955 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166a513-5865-4805-a0e7-b7ecbd34d766 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:29.502245 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166a513-5865-4805-a0e7-b7ecbd34d766 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:29.502594 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166a513-5865-4805-a0e7-b7ecbd34d766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:29.506489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed772d-9c1d-4a03-9ced-c928b6dc2916 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:29.519605 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-8166a513-5865-4805-a0e7-b7ecbd34d766 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:29.520886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-8166a513-5865-4805-a0e7-b7ecbd34d766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:29.531346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:29.544492 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d605cf6-66b0-4bfc-8be2-a232d9c3a570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:29.550148 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d605cf6-66b0-4bfc-8be2-a232d9c3a570 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:29.550148 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d605cf6-66b0-4bfc-8be2-a232d9c3a570 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:29.550148 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d605cf6-66b0-4bfc-8be2-a232d9c3a570 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:29.553736 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d605cf6-66b0-4bfc-8be2-a232d9c3a570 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:29.555182 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d605cf6-66b0-4bfc-8be2-a232d9c3a570 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:29.569619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-8d605cf6-66b0-4bfc-8be2-a232d9c3a570 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:38:29.569619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:29.569619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:29.569619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:29.569619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:29.569619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:29.569619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:29.569619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:29.569619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:29.569619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:29.569619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:29.569619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:29.569619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:38:29.569619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:38:29.569619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:38:29.569619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:38:29.570623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:29.570623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:29.570623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:38:29.570623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:29.570623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:38:29.570623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:29.570623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:29.570623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:29.570623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:29.570623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:29.570623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:29.570623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:29.570623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:29.570623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:29.570623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:29.570623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:29.570623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:29.570623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:29.571844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:29.571844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:29.571844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:38:29.571844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:38:29.571844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:38:29.571844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:38:29.571844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:38:29.571844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:38:29.571844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:38:29.571844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:29.571844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 517/1035] 10.222.0.93 () {56 vars in 1093 bytes} [Thu Jun 16 18:38:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:29.579166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d605cf6-66b0-4bfc-8be2-a232d9c3a570 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:29.595682 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 519/1036] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:29.619822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166a513-5865-4805-a0e7-b7ecbd34d766 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:29.659547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:29.682391 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d605cf6-66b0-4bfc-8be2-a232d9c3a570 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:29.717896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a209e-d255-40a1-b935-2899ccfab91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:29.718576 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a209e-d255-40a1-b935-2899ccfab91d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:29.718862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a209e-d255-40a1-b935-2899ccfab91d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:29.719141 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a209e-d255-40a1-b935-2899ccfab91d None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:29.719981 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a209e-d255-40a1-b935-2899ccfab91d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:29.720292 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a209e-d255-40a1-b935-2899ccfab91d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:29.722025 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a209e-d255-40a1-b935-2899ccfab91d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:29.727525 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166a513-5865-4805-a0e7-b7ecbd34d766 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:29.740112 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 518/1037] 10.222.0.93 () {56 vars in 1133 bytes} [Thu Jun 16 18:38:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:29.745675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a209e-d255-40a1-b935-2899ccfab91d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:29.768630 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b530355-5fd4-419a-b7ba-2ce4a419e787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:29.769760 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b530355-5fd4-419a-b7ba-2ce4a419e787 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:29.770046 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b530355-5fd4-419a-b7ba-2ce4a419e787 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:29.770486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b530355-5fd4-419a-b7ba-2ce4a419e787 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:29.772058 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b530355-5fd4-419a-b7ba-2ce4a419e787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:29.774433 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b530355-5fd4-419a-b7ba-2ce4a419e787 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:29.780469 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 520/1038] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:29.782154 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b530355-5fd4-419a-b7ba-2ce4a419e787 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:29.799027 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:29.855870 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a209e-d255-40a1-b935-2899ccfab91d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:29.885918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b530355-5fd4-419a-b7ba-2ce4a419e787 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:29.892366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c97246-0a32-4630-8737-0d331a91831d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:29.893062 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c97246-0a32-4630-8737-0d331a91831d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:29.893348 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c97246-0a32-4630-8737-0d331a91831d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:29.893626 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c97246-0a32-4630-8737-0d331a91831d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:29.897174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:29.923444 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce65e54-3e4a-47ef-8ee0-6938a427af13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:29.924066 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce65e54-3e4a-47ef-8ee0-6938a427af13 None admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:29.924347 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce65e54-3e4a-47ef-8ee0-6938a427af13 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:29.924669 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce65e54-3e4a-47ef-8ee0-6938a427af13 None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:29.925432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce65e54-3e4a-47ef-8ee0-6938a427af13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:29.926872 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce65e54-3e4a-47ef-8ee0-6938a427af13 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:29.969921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c97246-0a32-4630-8737-0d331a91831d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:29.971570 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c97246-0a32-4630-8737-0d331a91831d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:30.036425 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 521/1039] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Jun 16 18:38:29 2022] POST /identity/v3/users => generated 285 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:30.037830 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28860420-bfcc-43f5-a841-d8cb01bc8577 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:30.038125 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28860420-bfcc-43f5-a841-d8cb01bc8577 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:30.038408 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28860420-bfcc-43f5-a841-d8cb01bc8577 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:30.039855 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 522/1040] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:30.045389 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff014ad7-1e72-4c8c-b94a-6e60d677e4fa None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:30.049751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff014ad7-1e72-4c8c-b94a-6e60d677e4fa None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:30.050159 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff014ad7-1e72-4c8c-b94a-6e60d677e4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:30.073170 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-ff014ad7-1e72-4c8c-b94a-6e60d677e4fa None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:30.074405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-ff014ad7-1e72-4c8c-b94a-6e60d677e4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:30.100174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 519/1041] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:29 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 18:38:30.106267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c97246-0a32-4630-8737-0d331a91831d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:30.145709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:30.153960 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:30.159850 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 523/1042] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:30.183800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff014ad7-1e72-4c8c-b94a-6e60d677e4fa None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:30.217550 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c97246-0a32-4630-8737-0d331a91831d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:30.258610 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e7cc1-3931-465d-a1ae-969d4bf28759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:30.258811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e7cc1-3931-465d-a1ae-969d4bf28759 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:30.259100 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e7cc1-3931-465d-a1ae-969d4bf28759 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:30.259307 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e7cc1-3931-465d-a1ae-969d4bf28759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:30.274292 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e7cc1-3931-465d-a1ae-969d4bf28759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:30.276066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e7cc1-3931-465d-a1ae-969d4bf28759 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:30.298120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-565e7cc1-3931-465d-a1ae-969d4bf28759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:30.298120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:30.298120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:30.298120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:30.298120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:30.298120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:30.298120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:30.298120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:30.298120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:30.298120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:30.298120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:30.298120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:30.298120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:30.298120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:30.298120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:30.299258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:30.299258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:30.299258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:30.299258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:30.299258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:30.299258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:30.299258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:30.299258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:30.299258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:30.299258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:30.299258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:30.299258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:30.299258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:30.299258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:30.299258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:30.299258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:30.299258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:30.300186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:30.300186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:30.300186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:30.300186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:30.300186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 520/1043] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:30.305589 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e7cc1-3931-465d-a1ae-969d4bf28759 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:30.312876 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff014ad7-1e72-4c8c-b94a-6e60d677e4fa None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:30.347954 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1567420-c409-4b6f-8ee8-4a7734421dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:30.348785 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1567420-c409-4b6f-8ee8-4a7734421dfa None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:30.349118 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1567420-c409-4b6f-8ee8-4a7734421dfa None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:30.349441 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1567420-c409-4b6f-8ee8-4a7734421dfa None admin] PATH_INFO: `/v3/services/image` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:30.350132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1567420-c409-4b6f-8ee8-4a7734421dfa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:30.351502 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1567420-c409-4b6f-8ee8-4a7734421dfa None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:30.364096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-d1567420-c409-4b6f-8ee8-4a7734421dfa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 18:38:30.364096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:30.364096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:30.364096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:30.364096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:30.364096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:30.364096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:30.364096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:30.364096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 18:38:30.364096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:30.364096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:30.364096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:30.364096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:30.364096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:30.364096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:30.364096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:30.364096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:30.365206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:30.365206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:30.365206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:30.365206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:30.365206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:30.365206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:30.365206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:30.365206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:30.365206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:30.365206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:30.365206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:30.365206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:30.365206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:30.365206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:30.365206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:30.365206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:30.366281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:30.366281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:30.366281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:30.366281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:30.366281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:30.366281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:30.366281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:30.366281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:30.366281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:30.366281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:30.366281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:30.366281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:30.366281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 18:38:30.366281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:30.366281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 524/1044] 10.222.0.93 () {56 vars in 1105 bytes} [Thu Jun 16 18:38:30 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:30.371247 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1567420-c409-4b6f-8ee8-4a7734421dfa None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:30.407840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:30.420855 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e7cc1-3931-465d-a1ae-969d4bf28759 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:30.438833 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:30.460722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04392bf9-da6f-48d3-9eb7-3acf97fbcb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:30.461462 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04392bf9-da6f-48d3-9eb7-3acf97fbcb74 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:30.461743 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04392bf9-da6f-48d3-9eb7-3acf97fbcb74 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:30.462015 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04392bf9-da6f-48d3-9eb7-3acf97fbcb74 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:30.462799 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04392bf9-da6f-48d3-9eb7-3acf97fbcb74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:30.463076 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04392bf9-da6f-48d3-9eb7-3acf97fbcb74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:30.464428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04392bf9-da6f-48d3-9eb7-3acf97fbcb74 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:30.482159 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 521/1045] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:30.482349 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1567420-c409-4b6f-8ee8-4a7734421dfa None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:30.483329 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04392bf9-da6f-48d3-9eb7-3acf97fbcb74 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:30.519581 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f75e5-bd2d-4b33-b516-87f4a6f56b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:30.520167 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f75e5-bd2d-4b33-b516-87f4a6f56b9c None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:30.520471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f75e5-bd2d-4b33-b516-87f4a6f56b9c None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:30.520750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f75e5-bd2d-4b33-b516-87f4a6f56b9c None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:30.521451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f75e5-bd2d-4b33-b516-87f4a6f56b9c None admin] RBAC: Adding query filter params (name=image) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:30.521756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f75e5-bd2d-4b33-b516-87f4a6f56b9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:30.523120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f75e5-bd2d-4b33-b516-87f4a6f56b9c None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:30.528400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 525/1046] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:30.534226 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f75e5-bd2d-4b33-b516-87f4a6f56b9c None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:30.590766 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04392bf9-da6f-48d3-9eb7-3acf97fbcb74 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:30.629394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836e1dc-00b1-4f0c-932f-f4a44503d763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:30.630193 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836e1dc-00b1-4f0c-932f-f4a44503d763 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:30.630479 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836e1dc-00b1-4f0c-932f-f4a44503d763 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:30.630756 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836e1dc-00b1-4f0c-932f-f4a44503d763 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:30.637649 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836e1dc-00b1-4f0c-932f-f4a44503d763 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:30.638796 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f75e5-bd2d-4b33-b516-87f4a6f56b9c None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:30.639093 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836e1dc-00b1-4f0c-932f-f4a44503d763 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:30.655407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-b836e1dc-00b1-4f0c-932f-f4a44503d763 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:30.655407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:30.655407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:30.655407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:30.655407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:30.655407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:30.655407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:30.655407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:30.655407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:30.655407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:30.655407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:30.655407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:30.655407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:38:30.655407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:38:30.655407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:38:30.656983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:38:30.656983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:30.656983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:30.656983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:30.656983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:30.656983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:30.656983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:30.656983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:30.656983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:30.656983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:30.656983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:30.656983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:30.656983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:30.656983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:30.656983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:30.656983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:30.656983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:30.657915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:38:30.657915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:38:30.657915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:38:30.657915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:38:30.657915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:38:30.657915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:38:30.657915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:30.657915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:30.657915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 522/1047] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:30.662848 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836e1dc-00b1-4f0c-932f-f4a44503d763 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:30.668149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:30.674369 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:30.679131 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279ef92-5925-46a7-9bb3-f0c682674fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:30.679864 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279ef92-5925-46a7-9bb3-f0c682674fbb None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:30.680151 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279ef92-5925-46a7-9bb3-f0c682674fbb None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:30.683523 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279ef92-5925-46a7-9bb3-f0c682674fbb None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:30.683523 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279ef92-5925-46a7-9bb3-f0c682674fbb None admin] RBAC: Adding query filter params (type=image) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:30.683523 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279ef92-5925-46a7-9bb3-f0c682674fbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:30.683523 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279ef92-5925-46a7-9bb3-f0c682674fbb None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:30.688080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 526/1048] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:30.693545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279ef92-5925-46a7-9bb3-f0c682674fbb None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:30.771674 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836e1dc-00b1-4f0c-932f-f4a44503d763 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:30.801898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279ef92-5925-46a7-9bb3-f0c682674fbb None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:30.808378 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea3a3b-4656-42d0-a25a-7318c24b92f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:30.809137 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea3a3b-4656-42d0-a25a-7318c24b92f7 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:30.809419 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea3a3b-4656-42d0-a25a-7318c24b92f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:30.809697 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea3a3b-4656-42d0-a25a-7318c24b92f7 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:30.817740 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea3a3b-4656-42d0-a25a-7318c24b92f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:30.818091 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea3a3b-4656-42d0-a25a-7318c24b92f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:30.819546 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea3a3b-4656-42d0-a25a-7318c24b92f7 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:30.831919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 523/1049] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:38:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:30.838591 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea3a3b-4656-42d0-a25a-7318c24b92f7 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:30.845844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5ed88-bee0-46d5-b9e4-22c9329df52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:30.846510 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5ed88-bee0-46d5-b9e4-22c9329df52b None admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:30.847050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5ed88-bee0-46d5-b9e4-22c9329df52b None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:30.847329 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5ed88-bee0-46d5-b9e4-22c9329df52b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:30.848075 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5ed88-bee0-46d5-b9e4-22c9329df52b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:30.849901 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5ed88-bee0-46d5-b9e4-22c9329df52b None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:30.906659 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:30.940032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea3a3b-4656-42d0-a25a-7318c24b92f7 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:30.960463 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 527/1050] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Jun 16 18:38:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:38:30.994304 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac697f-2341-46eb-970b-0a7d9d7e1cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:30.994972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac697f-2341-46eb-970b-0a7d9d7e1cea None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:30.995257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac697f-2341-46eb-970b-0a7d9d7e1cea None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:30.995535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac697f-2341-46eb-970b-0a7d9d7e1cea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:30.996369 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac697f-2341-46eb-970b-0a7d9d7e1cea None admin] RBAC: Adding query filter params (role.id=4b8942e18cb04e18bc69029f7203d9c0, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=3503ec98bea14693a17a84e686586bad) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:30.996711 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac697f-2341-46eb-970b-0a7d9d7e1cea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:30.998160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac697f-2341-46eb-970b-0a7d9d7e1cea None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:31.005107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 524/1051] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:30 2022] GET /identity/v3/role_assignments?user.id=3503ec98bea14693a17a84e686586bad&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=4b8942e18cb04e18bc69029f7203d9c0 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:32.244696 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84022a4c-a1b5-4394-abcc-a0200c5e9b22 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:32.245261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84022a4c-a1b5-4394-abcc-a0200c5e9b22 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:32.245261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84022a4c-a1b5-4394-abcc-a0200c5e9b22 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:32.248640 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 528/1052] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:32.252132 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ebabc-a791-489c-82f6-910d7117b4bd None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:32.252590 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ebabc-a791-489c-82f6-910d7117b4bd None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:32.252778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ebabc-a791-489c-82f6-910d7117b4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:32.272565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-857ebabc-a791-489c-82f6-910d7117b4bd None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:32.273808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-857ebabc-a791-489c-82f6-910d7117b4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:32.341538 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 525/1053] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:32.365816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84022a4c-a1b5-4394-abcc-a0200c5e9b22 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:32.413389 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:32.466664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84022a4c-a1b5-4394-abcc-a0200c5e9b22 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:32.500829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200efae8-510f-41a9-a66a-fba1da2c762a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:32.501640 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200efae8-510f-41a9-a66a-fba1da2c762a None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:32.501920 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200efae8-510f-41a9-a66a-fba1da2c762a None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:32.502187 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200efae8-510f-41a9-a66a-fba1da2c762a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:32.512729 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200efae8-510f-41a9-a66a-fba1da2c762a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:32.520697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-200efae8-510f-41a9-a66a-fba1da2c762a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:32.520697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:32.520697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:32.520697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:32.520697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:32.520697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:32.520697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:32.520697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:32.520697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:32.520697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:32.520697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:32.520697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:32.520697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:32.520697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:32.520697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:32.520697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:32.521684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:32.521684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:32.521684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:32.521684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:32.521684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:32.521684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:32.521684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:32.521684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:32.521684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:32.521684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:32.521684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:32.521684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:32.521684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:32.521684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:32.521684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:32.521684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:32.522531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:32.522531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:32.522531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:32.522531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:32.522531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:32.522531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:32.522531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:32.522531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:32.522531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:32.522531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:32.522531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:32.522531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:32.524756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 529/1054] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:38:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:32.527747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ebabc-a791-489c-82f6-910d7117b4bd None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:32.585643 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:32.628465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ebabc-a791-489c-82f6-910d7117b4bd None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:32.662691 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ba828-1fbc-4425-bbb8-0b66c1656a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:32.663377 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ba828-1fbc-4425-bbb8-0b66c1656a84 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:32.663661 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ba828-1fbc-4425-bbb8-0b66c1656a84 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:32.663933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ba828-1fbc-4425-bbb8-0b66c1656a84 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:32.664709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ba828-1fbc-4425-bbb8-0b66c1656a84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:32.665017 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ba828-1fbc-4425-bbb8-0b66c1656a84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:32.666369 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ba828-1fbc-4425-bbb8-0b66c1656a84 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:32.680128 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 526/1055] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:38:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:32.681367 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200efae8-510f-41a9-a66a-fba1da2c762a None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:32.785254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200efae8-510f-41a9-a66a-fba1da2c762a None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:32.792322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:32.818769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de263ba-8ffa-43ab-a040-ddb2b2c9c6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:32.819684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de263ba-8ffa-43ab-a040-ddb2b2c9c6bf None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:32.820005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de263ba-8ffa-43ab-a040-ddb2b2c9c6bf None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:32.820240 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de263ba-8ffa-43ab-a040-ddb2b2c9c6bf None admin] PATH_INFO: `/v3/users/4d6782cac8d64a8382baf8a02e1513af` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:32.835136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de263ba-8ffa-43ab-a040-ddb2b2c9c6bf None admin] RBAC: Authorizing `identity:get_user(user_id=4d6782cac8d64a8382baf8a02e1513af)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:32.836614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de263ba-8ffa-43ab-a040-ddb2b2c9c6bf None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:32.838482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 530/1056] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:32 2022] GET /identity/v3/users/4d6782cac8d64a8382baf8a02e1513af => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:32.844068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ba828-1fbc-4425-bbb8-0b66c1656a84 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:32.944670 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ba828-1fbc-4425-bbb8-0b66c1656a84 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:32.964747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:32.979777 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455c255-b3a6-4ec4-ad1c-1390bec9507c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:32.980453 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455c255-b3a6-4ec4-ad1c-1390bec9507c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:32.982644 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455c255-b3a6-4ec4-ad1c-1390bec9507c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:32.982644 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455c255-b3a6-4ec4-ad1c-1390bec9507c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:33.053760 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455c255-b3a6-4ec4-ad1c-1390bec9507c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:33.055178 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455c255-b3a6-4ec4-ad1c-1390bec9507c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:33.152865 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20c8dc-e471-4e32-8a09-c888124fdf8f None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:33.153224 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20c8dc-e471-4e32-8a09-c888124fdf8f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:33.153430 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20c8dc-e471-4e32-8a09-c888124fdf8f None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:33.160039 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 531/1057] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:38:33.161493 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39a614-9222-4686-b304-3b8314488aae None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:33.161784 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39a614-9222-4686-b304-3b8314488aae None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:33.162065 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39a614-9222-4686-b304-3b8314488aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:33.173604 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 527/1058] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:38:33.174146 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455c255-b3a6-4ec4-ad1c-1390bec9507c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:33.179044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-da39a614-9222-4686-b304-3b8314488aae None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:33.180256 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-da39a614-9222-4686-b304-3b8314488aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:33.195868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:33.272849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 532/1059] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:33.274351 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7384e-19ca-4925-955b-10ac29c5a1ea None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:33.274644 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7384e-19ca-4925-955b-10ac29c5a1ea None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:33.274920 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7384e-19ca-4925-955b-10ac29c5a1ea None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:33.276257 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 533/1060] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:33.281845 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b35c72-590a-42d7-bb40-e55c5bae51d6 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:33.282206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b35c72-590a-42d7-bb40-e55c5bae51d6 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:33.282451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b35c72-590a-42d7-bb40-e55c5bae51d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:33.289933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455c255-b3a6-4ec4-ad1c-1390bec9507c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:33.299178 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-99b35c72-590a-42d7-bb40-e55c5bae51d6 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:33.300338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-99b35c72-590a-42d7-bb40-e55c5bae51d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:33.330024 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f0ac1-f3ea-4af0-b025-4e68da3fbd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:33.330819 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f0ac1-f3ea-4af0-b025-4e68da3fbd69 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:33.331108 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f0ac1-f3ea-4af0-b025-4e68da3fbd69 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:33.331387 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f0ac1-f3ea-4af0-b025-4e68da3fbd69 None admin] PATH_INFO: `/v3/projects/6f6264860c8e489399ea46c7fb317ecc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:33.332634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f0ac1-f3ea-4af0-b025-4e68da3fbd69 None admin] RBAC: Authorizing `identity:get_project(project_id=6f6264860c8e489399ea46c7fb317ecc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:33.334077 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f0ac1-f3ea-4af0-b025-4e68da3fbd69 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:33.340761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 528/1061] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:38:33 2022] GET /identity/v3/projects/6f6264860c8e489399ea46c7fb317ecc => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:33.340761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f0ac1-f3ea-4af0-b025-4e68da3fbd69 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:33.370476 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 534/1062] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:33.371337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b35c72-590a-42d7-bb40-e55c5bae51d6 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:33.400268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:33.442623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:33.455485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f0ac1-f3ea-4af0-b025-4e68da3fbd69 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:33.483781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b35c72-590a-42d7-bb40-e55c5bae51d6 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:33.494697 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa506e13-59ec-422d-b246-cfff95f92439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:33.495368 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa506e13-59ec-422d-b246-cfff95f92439 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:33.495655 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa506e13-59ec-422d-b246-cfff95f92439 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:33.497516 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa506e13-59ec-422d-b246-cfff95f92439 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:33.529367 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bc341-3e3b-46ac-bc9f-5f65a4ea4c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:33.530030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bc341-3e3b-46ac-bc9f-5f65a4ea4c1b None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:33.530323 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bc341-3e3b-46ac-bc9f-5f65a4ea4c1b None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:33.530600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bc341-3e3b-46ac-bc9f-5f65a4ea4c1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:33.531424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274bc341-3e3b-46ac-bc9f-5f65a4ea4c1b None admin] RBAC: Adding query filter params (role.id=416a52031d5d49b6a3fa0e9baa814436, scope.project.id=6f6264860c8e489399ea46c7fb317ecc, user.id=4d6782cac8d64a8382baf8a02e1513af) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:33.531740 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274bc341-3e3b-46ac-bc9f-5f65a4ea4c1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:33.533813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274bc341-3e3b-46ac-bc9f-5f65a4ea4c1b None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:33.539269 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 535/1063] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:33 2022] GET /identity/v3/role_assignments?user.id=4d6782cac8d64a8382baf8a02e1513af&scope.project.id=6f6264860c8e489399ea46c7fb317ecc&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:33.540058 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bc341-3e3b-46ac-bc9f-5f65a4ea4c1b None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:33.578216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa506e13-59ec-422d-b246-cfff95f92439 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:33.580323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa506e13-59ec-422d-b246-cfff95f92439 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:33.638583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:33.651546 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bc341-3e3b-46ac-bc9f-5f65a4ea4c1b None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:33.681724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:33.694342 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834604f8-040c-45bb-ae92-e2b8d1b38020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:33.695343 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834604f8-040c-45bb-ae92-e2b8d1b38020 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:33.695624 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834604f8-040c-45bb-ae92-e2b8d1b38020 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:33.695895 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834604f8-040c-45bb-ae92-e2b8d1b38020 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:33.697606 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 529/1064] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:38:33.703052 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa506e13-59ec-422d-b246-cfff95f92439 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:33.708140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834604f8-040c-45bb-ae92-e2b8d1b38020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:33.716513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-834604f8-040c-45bb-ae92-e2b8d1b38020 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:33.716513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:33.716513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:33.716513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:33.716513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:33.716513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:33.716513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:33.716513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:33.716513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:33.716513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:33.716513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:33.716513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:33.716513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:33.716513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:33.716513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:33.716513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:33.717480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:33.717480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:33.717480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:33.717480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:33.717480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:33.717480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:33.717480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:33.717480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:33.717480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:33.717480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:33.717480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:33.717480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:33.717480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:33.717480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:33.717480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:33.717480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:33.718355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:33.718355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:33.718355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:33.718355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:33.718355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:33.718355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:33.718355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:33.718355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:33.718355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:33.718355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:33.718355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:33.718355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:33.718355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 536/1065] 10.222.0.93 () {56 vars in 1120 bytes} [Thu Jun 16 18:38:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:33.724550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834604f8-040c-45bb-ae92-e2b8d1b38020 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:33.815200 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa506e13-59ec-422d-b246-cfff95f92439 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:33.838292 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834604f8-040c-45bb-ae92-e2b8d1b38020 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:33.852758 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb2a31-4ac4-4c8c-95e1-5b566de70861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:33.853581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb2a31-4ac4-4c8c-95e1-5b566de70861 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:33.853872 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb2a31-4ac4-4c8c-95e1-5b566de70861 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:33.854157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb2a31-4ac4-4c8c-95e1-5b566de70861 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:33.867054 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb2a31-4ac4-4c8c-95e1-5b566de70861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:33.868557 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb2a31-4ac4-4c8c-95e1-5b566de70861 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:33.880179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c24f1c-f06c-4719-a270-81a51031cccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:33.880887 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c24f1c-f06c-4719-a270-81a51031cccd None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:33.881173 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c24f1c-f06c-4719-a270-81a51031cccd None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:33.881453 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c24f1c-f06c-4719-a270-81a51031cccd None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:33.882205 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c24f1c-f06c-4719-a270-81a51031cccd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:33.882516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c24f1c-f06c-4719-a270-81a51031cccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:33.883884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c24f1c-f06c-4719-a270-81a51031cccd None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:33.887158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-fdbb2a31-4ac4-4c8c-95e1-5b566de70861 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:33.887158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:33.887158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:33.887158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:33.887158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:33.887158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:33.887158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:33.887158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:33.887158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:33.887158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:33.887158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:33.887158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:33.887158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:33.887158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:33.887158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:33.888066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:33.888066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:33.888066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:33.888066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:33.888066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:33.888066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:33.888066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:33.888066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:33.888066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:33.888066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:33.888066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:33.888066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:33.888066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:33.888066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:33.888066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:33.888066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:33.888066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:33.889005 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:33.889005 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:33.889005 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:33.889005 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:33.897579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 537/1066] 10.222.0.93 () {56 vars in 1115 bytes} [Thu Jun 16 18:38:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:33.897750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 530/1067] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:33.897836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c24f1c-f06c-4719-a270-81a51031cccd None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:33.898214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb2a31-4ac4-4c8c-95e1-5b566de70861 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:33.910274 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:33.942306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:34.005640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb2a31-4ac4-4c8c-95e1-5b566de70861 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:34.007685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c24f1c-f06c-4719-a270-81a51031cccd None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:34.042819 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c350f-7199-4c26-b077-38c4908757b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:34.043070 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75230499-0abc-46f3-b006-c68f2b3c6b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:34.043491 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c350f-7199-4c26-b077-38c4908757b9 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:34.043683 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75230499-0abc-46f3-b006-c68f2b3c6b6f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:34.043782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c350f-7199-4c26-b077-38c4908757b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:34.043972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75230499-0abc-46f3-b006-c68f2b3c6b6f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:34.044079 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c350f-7199-4c26-b077-38c4908757b9 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:34.044252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75230499-0abc-46f3-b006-c68f2b3c6b6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:34.044773 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c350f-7199-4c26-b077-38c4908757b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:34.045080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c350f-7199-4c26-b077-38c4908757b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:34.046445 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c350f-7199-4c26-b077-38c4908757b9 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:34.055824 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75230499-0abc-46f3-b006-c68f2b3c6b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:34.057306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75230499-0abc-46f3-b006-c68f2b3c6b6f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:34.059319 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 538/1068] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:34.084950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-75230499-0abc-46f3-b006-c68f2b3c6b6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:34.084950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:34.084950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:34.084950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:34.084950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:34.084950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:34.084950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:34.084950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:34.084950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:34.084950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:34.084950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:34.084950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:34.084950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:34.084950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:34.084950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:34.085938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:34.085938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:34.085938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:34.085938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:34.085938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:34.085938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:34.085938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:34.085938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:34.085938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:34.085938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:34.085938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:34.085938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:34.085938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:34.085938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:34.085938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:34.085938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:34.085938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:34.086829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:34.086829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:34.086829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:34.086829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:34.088879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 531/1069] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:34.092170 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c350f-7199-4c26-b077-38c4908757b9 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:34.168325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:34.203457 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c350f-7199-4c26-b077-38c4908757b9 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:34.240154 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb22eee-7397-4ee4-895b-cfc78908a16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:34.240866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb22eee-7397-4ee4-895b-cfc78908a16f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:34.241156 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb22eee-7397-4ee4-895b-cfc78908a16f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:34.241441 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb22eee-7397-4ee4-895b-cfc78908a16f None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:34.242176 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb22eee-7397-4ee4-895b-cfc78908a16f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:34.242488 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb22eee-7397-4ee4-895b-cfc78908a16f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:34.243882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb22eee-7397-4ee4-895b-cfc78908a16f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:34.261710 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 539/1070] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:34.268083 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75230499-0abc-46f3-b006-c68f2b3c6b6f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:34.368601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:34.377152 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75230499-0abc-46f3-b006-c68f2b3c6b6f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:34.411254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541664e-0fc0-441d-8cad-e4c8adfa29e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:34.412043 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541664e-0fc0-441d-8cad-e4c8adfa29e6 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:34.412327 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541664e-0fc0-441d-8cad-e4c8adfa29e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:34.412633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541664e-0fc0-441d-8cad-e4c8adfa29e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:34.419459 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541664e-0fc0-441d-8cad-e4c8adfa29e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:34.420940 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541664e-0fc0-441d-8cad-e4c8adfa29e6 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:34.434933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-6541664e-0fc0-441d-8cad-e4c8adfa29e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:38:34.434933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:34.434933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:34.434933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:34.434933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:34.434933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:34.434933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:34.434933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:34.434933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:34.434933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:34.434933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:34.434933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:34.434933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:38:34.434933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:38:34.434933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:38:34.434933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:38:34.435889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:34.435889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:34.435889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:38:34.435889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:34.435889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:38:34.435889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:34.435889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:34.435889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:34.435889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:34.435889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:34.435889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:34.435889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:34.435889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:34.435889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:34.435889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:34.435889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:34.435889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:34.435889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:34.437061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:34.437061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:34.437061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:38:34.437061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:38:34.437061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:38:34.437061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:38:34.437061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:38:34.437061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:38:34.437061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:38:34.437061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:34.437061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 532/1071] 10.222.0.93 () {56 vars in 1093 bytes} [Thu Jun 16 18:38:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:34.441808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb22eee-7397-4ee4-895b-cfc78908a16f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:34.539516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb22eee-7397-4ee4-895b-cfc78908a16f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:34.566720 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:34.572474 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528549c6-e8d0-45d7-981a-f38de33e0ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:34.573149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528549c6-e8d0-45d7-981a-f38de33e0ed6 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:34.576829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528549c6-e8d0-45d7-981a-f38de33e0ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:34.576829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528549c6-e8d0-45d7-981a-f38de33e0ed6 None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:34.576829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528549c6-e8d0-45d7-981a-f38de33e0ed6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:34.576829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528549c6-e8d0-45d7-981a-f38de33e0ed6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:34.576829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528549c6-e8d0-45d7-981a-f38de33e0ed6 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:34.593482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 540/1072] 10.222.0.93 () {56 vars in 1133 bytes} [Thu Jun 16 18:38:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:34.600054 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541664e-0fc0-441d-8cad-e4c8adfa29e6 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:34.699724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541664e-0fc0-441d-8cad-e4c8adfa29e6 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:34.733034 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e2c27-ed98-4276-8980-9d06f6a95097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:34.733824 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e2c27-ed98-4276-8980-9d06f6a95097 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:34.734107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e2c27-ed98-4276-8980-9d06f6a95097 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:34.734384 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e2c27-ed98-4276-8980-9d06f6a95097 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:34.744337 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e2c27-ed98-4276-8980-9d06f6a95097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:34.745808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e2c27-ed98-4276-8980-9d06f6a95097 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:34.763332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-2f7e2c27-ed98-4276-8980-9d06f6a95097 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:34.763332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:34.763332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:34.763332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:34.763332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:34.763332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:34.763332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:34.763332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:34.763332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:34.763332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:34.763332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:34.763332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:34.763332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:34.763332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:34.763332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:34.764465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:34.764465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:34.764465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:34.764465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:34.764465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:34.764465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:34.764465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:34.764465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:34.764465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:34.764465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:34.764465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:34.764465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:34.764465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:34.764465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:34.764465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:34.764465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:34.764465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:34.765534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:34.765534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:34.765534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:34.765534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:34.765534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 533/1073] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:34.771130 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528549c6-e8d0-45d7-981a-f38de33e0ed6 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:34.865964 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528549c6-e8d0-45d7-981a-f38de33e0ed6 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:34.900781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73799f-6915-45f5-a9f6-6c80110bb40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:34.901442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73799f-6915-45f5-a9f6-6c80110bb40b None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:34.901724 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73799f-6915-45f5-a9f6-6c80110bb40b None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:34.901996 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73799f-6915-45f5-a9f6-6c80110bb40b None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:34.902711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73799f-6915-45f5-a9f6-6c80110bb40b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:34.903014 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73799f-6915-45f5-a9f6-6c80110bb40b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:34.904380 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73799f-6915-45f5-a9f6-6c80110bb40b None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:34.915814 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 541/1074] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:34.921416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e2c27-ed98-4276-8980-9d06f6a95097 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:34.925204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:35.024454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e2c27-ed98-4276-8980-9d06f6a95097 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:35.058096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc473d-bdad-4841-869d-747e4ea2a64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:35.058893 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc473d-bdad-4841-869d-747e4ea2a64c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:35.059180 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc473d-bdad-4841-869d-747e4ea2a64c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:35.059460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc473d-bdad-4841-869d-747e4ea2a64c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:35.066763 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc473d-bdad-4841-869d-747e4ea2a64c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:35.068202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc473d-bdad-4841-869d-747e4ea2a64c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:35.081889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-44fc473d-bdad-4841-869d-747e4ea2a64c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:35.081889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:35.081889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:35.081889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:35.081889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:35.081889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:35.081889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:35.081889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:35.081889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:35.081889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:35.081889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:35.081889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:35.081889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:38:35.081889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:38:35.081889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:38:35.082791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:38:35.082791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:35.082791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:35.082791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:35.082791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:35.082791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:35.082791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:35.082791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:35.082791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:35.082791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:35.082791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:35.082791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:35.082791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:35.082791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:35.082791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:35.082791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:35.082791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:35.084337 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:38:35.084337 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:38:35.084337 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:38:35.084337 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:38:35.084337 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:38:35.084337 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:38:35.084337 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:35.084337 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:35.084337 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 534/1075] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:35.088854 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73799f-6915-45f5-a9f6-6c80110bb40b None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:35.137346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:35.186625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73799f-6915-45f5-a9f6-6c80110bb40b None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:35.221480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6e2e1-db0e-40f2-b779-c1c8a1f88ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:35.222157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6e2e1-db0e-40f2-b779-c1c8a1f88ada None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:35.222446 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6e2e1-db0e-40f2-b779-c1c8a1f88ada None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:35.222726 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6e2e1-db0e-40f2-b779-c1c8a1f88ada None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:35.223522 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6e2e1-db0e-40f2-b779-c1c8a1f88ada None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:35.223836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6e2e1-db0e-40f2-b779-c1c8a1f88ada None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:35.225583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6e2e1-db0e-40f2-b779-c1c8a1f88ada None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:35.238573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 542/1076] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:38:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:35.244463 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc473d-bdad-4841-869d-747e4ea2a64c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:35.308185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:35.345525 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc473d-bdad-4841-869d-747e4ea2a64c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:35.379289 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6325be8-13ea-45c6-a79e-9418c5da965b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:35.380183 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6325be8-13ea-45c6-a79e-9418c5da965b None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:35.380493 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6325be8-13ea-45c6-a79e-9418c5da965b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:35.380772 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6325be8-13ea-45c6-a79e-9418c5da965b None admin] PATH_INFO: `/v3/projects/d6d43f779d67418baf199556b8e497c7/users/3503ec98bea14693a17a84e686586bad/roles/4b8942e18cb04e18bc69029f7203d9c0` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:35.382967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6325be8-13ea-45c6-a79e-9418c5da965b None admin] RBAC: Authorizing `identity:create_grant(project_id=d6d43f779d67418baf199556b8e497c7, user_id=3503ec98bea14693a17a84e686586bad, role_id=4b8942e18cb04e18bc69029f7203d9c0)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:35.384401 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6325be8-13ea-45c6-a79e-9418c5da965b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:35.454040 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 535/1077] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:38:35 2022] PUT /identity/v3/projects/d6d43f779d67418baf199556b8e497c7/users/3503ec98bea14693a17a84e686586bad/roles/4b8942e18cb04e18bc69029f7203d9c0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:38:35.672703 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17901c3a-57ce-4076-98f9-d36fd76da38d None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:35.673208 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17901c3a-57ce-4076-98f9-d36fd76da38d None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:35.673208 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17901c3a-57ce-4076-98f9-d36fd76da38d None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:35.674575 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 543/1078] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:35.680482 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37795b8b-70ad-406d-9b40-9d3e79d89908 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:35.680776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37795b8b-70ad-406d-9b40-9d3e79d89908 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:35.681056 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37795b8b-70ad-406d-9b40-9d3e79d89908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:35.698013 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-37795b8b-70ad-406d-9b40-9d3e79d89908 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:35.699179 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-37795b8b-70ad-406d-9b40-9d3e79d89908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:35.764096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 536/1079] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:35.787052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17901c3a-57ce-4076-98f9-d36fd76da38d None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:35.889835 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17901c3a-57ce-4076-98f9-d36fd76da38d None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:35.899635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:35.923887 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c71c7d-99c8-4ff4-ab1e-c26d65297328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:35.924651 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c71c7d-99c8-4ff4-ab1e-c26d65297328 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:35.924939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c71c7d-99c8-4ff4-ab1e-c26d65297328 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:35.925216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c71c7d-99c8-4ff4-ab1e-c26d65297328 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:35.935187 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c71c7d-99c8-4ff4-ab1e-c26d65297328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:35.943216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-c5c71c7d-99c8-4ff4-ab1e-c26d65297328 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:35.943216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:35.943216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:35.943216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:35.943216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:35.943216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:35.943216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:35.943216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:35.943216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:35.943216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:35.943216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:35.943216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:35.943216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:35.943216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:35.943216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:35.943216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:35.944277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:35.944277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:35.944277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:35.944277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:35.944277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:35.944277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:35.944277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:35.944277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:35.944277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:35.944277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:35.944277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:35.944277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:35.944277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:35.944277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:35.944277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:35.944277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:35.945179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:35.945179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:35.945179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:35.945179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:35.945179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:35.945179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:35.945179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:35.945179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:35.945179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:35.945179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:35.945179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:35.945179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:35.945179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 544/1080] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:38:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:35.950819 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37795b8b-70ad-406d-9b40-9d3e79d89908 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:36.006355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:36.051352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37795b8b-70ad-406d-9b40-9d3e79d89908 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:36.085431 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320c402-a30c-4f66-841b-dcd1605fd5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:36.086101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320c402-a30c-4f66-841b-dcd1605fd5b8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:36.086390 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320c402-a30c-4f66-841b-dcd1605fd5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:36.086670 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320c402-a30c-4f66-841b-dcd1605fd5b8 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:36.087424 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320c402-a30c-4f66-841b-dcd1605fd5b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:36.087734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320c402-a30c-4f66-841b-dcd1605fd5b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:36.089138 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320c402-a30c-4f66-841b-dcd1605fd5b8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:36.097752 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 537/1081] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:38:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:36.103762 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c71c7d-99c8-4ff4-ab1e-c26d65297328 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:36.202317 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c71c7d-99c8-4ff4-ab1e-c26d65297328 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:36.236320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f8bce-8b70-44cc-a947-d14de61583d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:36.237271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f8bce-8b70-44cc-a947-d14de61583d0 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:36.237560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f8bce-8b70-44cc-a947-d14de61583d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:36.237839 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f8bce-8b70-44cc-a947-d14de61583d0 None admin] PATH_INFO: `/v3/users/4d6782cac8d64a8382baf8a02e1513af` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:36.239028 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f8bce-8b70-44cc-a947-d14de61583d0 None admin] RBAC: Authorizing `identity:get_user(user_id=4d6782cac8d64a8382baf8a02e1513af)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:36.240496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f8bce-8b70-44cc-a947-d14de61583d0 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:36.242141 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 545/1082] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:36 2022] GET /identity/v3/users/4d6782cac8d64a8382baf8a02e1513af => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:36.247939 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320c402-a30c-4f66-841b-dcd1605fd5b8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:36.352518 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320c402-a30c-4f66-841b-dcd1605fd5b8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:36.368658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:36.386406 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b2c97-618a-4446-9f6b-1f0505dc2341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:36.391547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b2c97-618a-4446-9f6b-1f0505dc2341 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:36.391547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b2c97-618a-4446-9f6b-1f0505dc2341 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:36.391547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b2c97-618a-4446-9f6b-1f0505dc2341 None admin] PATH_INFO: `/v3/projects/6f6264860c8e489399ea46c7fb317ecc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:36.391547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b2c97-618a-4446-9f6b-1f0505dc2341 None admin] RBAC: Authorizing `identity:get_project(project_id=6f6264860c8e489399ea46c7fb317ecc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:36.391547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b2c97-618a-4446-9f6b-1f0505dc2341 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:36.392162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 538/1083] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:38:36 2022] GET /identity/v3/projects/6f6264860c8e489399ea46c7fb317ecc => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:36.398726 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f8bce-8b70-44cc-a947-d14de61583d0 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:36.432370 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:36.496930 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f8bce-8b70-44cc-a947-d14de61583d0 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:36.531346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df1136-6cd4-4521-a707-e854b3e42758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:36.532273 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df1136-6cd4-4521-a707-e854b3e42758 None admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:36.532588 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df1136-6cd4-4521-a707-e854b3e42758 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:36.532871 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df1136-6cd4-4521-a707-e854b3e42758 None admin] PATH_INFO: `/v3/projects/6f6264860c8e489399ea46c7fb317ecc/users/4d6782cac8d64a8382baf8a02e1513af/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:36.534949 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df1136-6cd4-4521-a707-e854b3e42758 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f6264860c8e489399ea46c7fb317ecc, user_id=4d6782cac8d64a8382baf8a02e1513af, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:36.536412 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df1136-6cd4-4521-a707-e854b3e42758 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:36.599922 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 546/1084] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:38:36 2022] PUT /identity/v3/projects/6f6264860c8e489399ea46c7fb317ecc/users/4d6782cac8d64a8382baf8a02e1513af/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:38:37.559767 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b15a7-ce47-4416-a965-e7003d363173 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:37.560292 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b15a7-ce47-4416-a965-e7003d363173 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:37.560292 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b15a7-ce47-4416-a965-e7003d363173 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:37.561710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 539/1085] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:37.566996 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ca335-9e74-424a-b4e9-54ee0622fc4e None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:37.567417 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ca335-9e74-424a-b4e9-54ee0622fc4e None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:37.567760 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ca335-9e74-424a-b4e9-54ee0622fc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:37.584669 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-336ca335-9e74-424a-b4e9-54ee0622fc4e None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:37.585845 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-336ca335-9e74-424a-b4e9-54ee0622fc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:37.650941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 547/1086] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:37.674977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b15a7-ce47-4416-a965-e7003d363173 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:37.775379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b15a7-ce47-4416-a965-e7003d363173 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:37.808925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cec2c-8694-4441-872f-029beaea0e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:37.809728 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cec2c-8694-4441-872f-029beaea0e5e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:37.810064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cec2c-8694-4441-872f-029beaea0e5e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:37.810290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cec2c-8694-4441-872f-029beaea0e5e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:37.820674 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cec2c-8694-4441-872f-029beaea0e5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:37.828703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-fd0cec2c-8694-4441-872f-029beaea0e5e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:37.828703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:37.828703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:37.828703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:37.828703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:37.828703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:37.828703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:37.828703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:37.828703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:37.828703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:37.828703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:37.828703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:37.828703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:37.828703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:37.828703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:37.828703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:37.829911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:37.829911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:37.829911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:37.829911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:37.829911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:37.829911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:37.829911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:37.829911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:37.829911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:37.829911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:37.829911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:37.829911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:37.829911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:37.829911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:37.829911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:37.829911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:37.830841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:37.830841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:37.830841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:37.830841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:37.830841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:37.830841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:37.830841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:37.830841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:37.830841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:37.830841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:37.830841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:37.830841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:37.830841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 540/1087] 10.222.0.93 () {56 vars in 1120 bytes} [Thu Jun 16 18:38:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:37.835740 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ca335-9e74-424a-b4e9-54ee0622fc4e None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:37.863042 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:37.934080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ca335-9e74-424a-b4e9-54ee0622fc4e None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:37.966372 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ccf7d-d578-45de-8c22-eb4ee79a7d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:37.967042 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ccf7d-d578-45de-8c22-eb4ee79a7d21 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:37.967384 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ccf7d-d578-45de-8c22-eb4ee79a7d21 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:37.967668 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ccf7d-d578-45de-8c22-eb4ee79a7d21 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:37.968411 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ccf7d-d578-45de-8c22-eb4ee79a7d21 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:37.968748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ccf7d-d578-45de-8c22-eb4ee79a7d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:37.970119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ccf7d-d578-45de-8c22-eb4ee79a7d21 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:37.978656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 548/1088] 10.222.0.93 () {56 vars in 1115 bytes} [Thu Jun 16 18:38:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:37.984189 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cec2c-8694-4441-872f-029beaea0e5e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:38.028424 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:38.082776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cec2c-8694-4441-872f-029beaea0e5e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:38.115704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d394d9d-9c90-475a-9644-6e215584f46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:38.116517 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d394d9d-9c90-475a-9644-6e215584f46d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:38.116804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d394d9d-9c90-475a-9644-6e215584f46d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:38.117080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d394d9d-9c90-475a-9644-6e215584f46d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:38.126738 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d394d9d-9c90-475a-9644-6e215584f46d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:38.128348 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d394d9d-9c90-475a-9644-6e215584f46d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:38.146272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-1d394d9d-9c90-475a-9644-6e215584f46d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:38.146272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:38.146272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:38.146272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:38.146272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:38.146272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:38.146272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:38.146272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:38.146272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:38.146272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:38.146272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:38.146272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:38.146272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:38.146272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:38.146272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:38.147394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:38.147394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:38.147394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:38.147394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:38.147394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:38.147394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:38.147394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:38.147394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:38.147394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:38.147394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:38.147394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:38.147394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:38.147394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:38.147394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:38.147394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:38.147394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:38.147394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:38.153230 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:38.153230 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:38.153230 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:38.153230 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:38.153230 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 541/1089] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:38.153604 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ccf7d-d578-45de-8c22-eb4ee79a7d21 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:38.239173 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:38.253559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ccf7d-d578-45de-8c22-eb4ee79a7d21 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:38.287931 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa1471-27e8-4b67-98ad-e905a848e748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:38.288632 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa1471-27e8-4b67-98ad-e905a848e748 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:38.288916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa1471-27e8-4b67-98ad-e905a848e748 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:38.289191 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa1471-27e8-4b67-98ad-e905a848e748 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:38.289908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa1471-27e8-4b67-98ad-e905a848e748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:38.290213 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa1471-27e8-4b67-98ad-e905a848e748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:38.291572 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa1471-27e8-4b67-98ad-e905a848e748 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:38.303088 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 549/1090] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:38.308642 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d394d9d-9c90-475a-9644-6e215584f46d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:38.400263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:38.406124 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d394d9d-9c90-475a-9644-6e215584f46d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:38.439804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3fd34-b392-495c-be4e-d502ad73dcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:38.440621 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3fd34-b392-495c-be4e-d502ad73dcd0 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:38.440903 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3fd34-b392-495c-be4e-d502ad73dcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:38.441175 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3fd34-b392-495c-be4e-d502ad73dcd0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:38.449926 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3fd34-b392-495c-be4e-d502ad73dcd0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:38.451345 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3fd34-b392-495c-be4e-d502ad73dcd0 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:38.465335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-aef3fd34-b392-495c-be4e-d502ad73dcd0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:38:38.465335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:38.465335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:38.465335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:38.465335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:38.465335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:38.465335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:38.465335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:38.465335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:38.465335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:38.465335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:38.465335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:38.465335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:38:38.465335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:38:38.465335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:38:38.465335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:38:38.466310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:38.466310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:38.466310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:38:38.466310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:38.466310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:38:38.466310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:38.466310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:38.466310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:38.466310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:38.466310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:38.466310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:38.466310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:38.466310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:38.466310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:38.466310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:38.466310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:38.466310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:38.466310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:38.467366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:38.467366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:38.467366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:38:38.467366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:38:38.467366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:38:38.467366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:38:38.467366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:38:38.467366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:38:38.467366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:38:38.467366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:38.467366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 542/1091] 10.222.0.93 () {56 vars in 1093 bytes} [Thu Jun 16 18:38:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:38.472315 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa1471-27e8-4b67-98ad-e905a848e748 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:38.581050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa1471-27e8-4b67-98ad-e905a848e748 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:38.615666 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c8a8d-0e46-4129-9b70-fbe5a516a1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:38.616340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c8a8d-0e46-4129-9b70-fbe5a516a1cf None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:38.616652 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c8a8d-0e46-4129-9b70-fbe5a516a1cf None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:38.616927 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c8a8d-0e46-4129-9b70-fbe5a516a1cf None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:38.617749 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c8a8d-0e46-4129-9b70-fbe5a516a1cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:38.618057 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c8a8d-0e46-4129-9b70-fbe5a516a1cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:38.619482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c8a8d-0e46-4129-9b70-fbe5a516a1cf None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:38.639302 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 550/1092] 10.222.0.93 () {56 vars in 1133 bytes} [Thu Jun 16 18:38:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:38.646154 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3fd34-b392-495c-be4e-d502ad73dcd0 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:38.696413 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb4a47-bca0-48d5-a00b-5d7b41b71e7c None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:38.696653 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb4a47-bca0-48d5-a00b-5d7b41b71e7c None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:38.696939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb4a47-bca0-48d5-a00b-5d7b41b71e7c None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:38.698319 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 551/1093] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:38:38.703186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e869d-12fd-49e6-9112-9fcd77a5a7c0 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:38.703480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e869d-12fd-49e6-9112-9fcd77a5a7c0 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:38.703761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e869d-12fd-49e6-9112-9fcd77a5a7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:38.715146 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:38.720858 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-319e869d-12fd-49e6-9112-9fcd77a5a7c0 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:38.722033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-319e869d-12fd-49e6-9112-9fcd77a5a7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:38.745480 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3fd34-b392-495c-be4e-d502ad73dcd0 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:38.779777 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd08fc5-7432-45bc-8aaf-7ac3ed34ce76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:38.780634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd08fc5-7432-45bc-8aaf-7ac3ed34ce76 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:38.780924 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd08fc5-7432-45bc-8aaf-7ac3ed34ce76 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:38.781200 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd08fc5-7432-45bc-8aaf-7ac3ed34ce76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:38.788164 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 552/1094] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:38.806085 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:38.811837 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e869d-12fd-49e6-9112-9fcd77a5a7c0 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:38.860780 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd08fc5-7432-45bc-8aaf-7ac3ed34ce76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:38.862240 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd08fc5-7432-45bc-8aaf-7ac3ed34ce76 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:38.909966 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e869d-12fd-49e6-9112-9fcd77a5a7c0 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:38.944314 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df970fb4-6377-492a-873d-43049b6a4bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:38.945142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df970fb4-6377-492a-873d-43049b6a4bc3 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:38.945436 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df970fb4-6377-492a-873d-43049b6a4bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:38.945716 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df970fb4-6377-492a-873d-43049b6a4bc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:38.948361 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:38.956529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df970fb4-6377-492a-873d-43049b6a4bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:38.964264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-df970fb4-6377-492a-873d-43049b6a4bc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:38.964264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:38.964264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:38.964264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:38.964264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:38.964264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:38.964264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:38.964264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:38.964264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:38.964264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:38.964264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:38.964264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:38.964264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:38.964264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:38.964264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:38.964264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:38.965320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:38.965320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:38.965320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:38.965320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:38.965320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:38.965320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:38.965320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:38.965320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:38.965320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:38.965320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:38.965320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:38.965320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:38.965320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:38.965320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:38.965320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:38.965320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:38.966179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:38.966179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:38.966179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:38.966179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:38.966179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:38.966179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:38.966179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:38.966179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:38.966179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:38.966179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:38.966179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:38.966179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:38:38.966179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 553/1095] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:38:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:38.971615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df970fb4-6377-492a-873d-43049b6a4bc3 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:38.971767 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 543/1096] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:38:38.977471 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd08fc5-7432-45bc-8aaf-7ac3ed34ce76 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:39.032417 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:39.072514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df970fb4-6377-492a-873d-43049b6a4bc3 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:39.075003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd08fc5-7432-45bc-8aaf-7ac3ed34ce76 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:39.105209 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76fd8b-708d-44db-b9f1-fbe77a78a1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:39.105875 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76fd8b-708d-44db-b9f1-fbe77a78a1b6 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:39.106164 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76fd8b-708d-44db-b9f1-fbe77a78a1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:39.106448 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76fd8b-708d-44db-b9f1-fbe77a78a1b6 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:39.107194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76fd8b-708d-44db-b9f1-fbe77a78a1b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:39.107506 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76fd8b-708d-44db-b9f1-fbe77a78a1b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:39.108033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6f36d-47b3-4b3b-826b-4bb734ed466f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:39.108841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6f36d-47b3-4b3b-826b-4bb734ed466f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:39.108951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76fd8b-708d-44db-b9f1-fbe77a78a1b6 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:39.109122 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6f36d-47b3-4b3b-826b-4bb734ed466f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:39.109392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6f36d-47b3-4b3b-826b-4bb734ed466f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:39.117483 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 554/1097] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:38:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:39.119934 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6f36d-47b3-4b3b-826b-4bb734ed466f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:39.121386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6f36d-47b3-4b3b-826b-4bb734ed466f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:39.123304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76fd8b-708d-44db-b9f1-fbe77a78a1b6 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:39.139257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-cdc6f36d-47b3-4b3b-826b-4bb734ed466f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:39.139257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:39.139257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:39.139257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:39.139257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:39.139257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:39.139257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:39.139257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:39.139257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:39.139257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:39.139257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:39.139257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:39.139257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:39.139257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:39.139257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:39.140341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:39.140341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:39.140341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:39.140341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:39.140341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:39.140341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:39.140341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:39.140341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:39.140341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:39.140341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:39.140341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:39.140341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:39.140341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:39.140341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:39.140341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:39.140341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:39.140341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:39.141789 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:39.141789 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:39.141789 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:39.141789 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:39.141789 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 544/1098] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:39.145967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6f36d-47b3-4b3b-826b-4bb734ed466f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:39.186663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:39.227597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76fd8b-708d-44db-b9f1-fbe77a78a1b6 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:39.244239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6f36d-47b3-4b3b-826b-4bb734ed466f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:39.256264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:39.262256 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518bcb3-16a6-467e-b284-61f5b2051279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:39.266315 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518bcb3-16a6-467e-b284-61f5b2051279 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:39.266315 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518bcb3-16a6-467e-b284-61f5b2051279 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:39.266315 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518bcb3-16a6-467e-b284-61f5b2051279 None admin] PATH_INFO: `/v3/users/4d6782cac8d64a8382baf8a02e1513af` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:39.266315 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518bcb3-16a6-467e-b284-61f5b2051279 None admin] RBAC: Authorizing `identity:get_user(user_id=4d6782cac8d64a8382baf8a02e1513af)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:39.266628 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518bcb3-16a6-467e-b284-61f5b2051279 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:39.268361 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 555/1099] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:39 2022] GET /identity/v3/users/4d6782cac8d64a8382baf8a02e1513af => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:39.274046 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518bcb3-16a6-467e-b284-61f5b2051279 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:39.283937 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d740b29-11b0-4b3e-ab37-eeacaa3a6b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:39.284642 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d740b29-11b0-4b3e-ab37-eeacaa3a6b57 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:39.284936 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d740b29-11b0-4b3e-ab37-eeacaa3a6b57 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:39.285219 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d740b29-11b0-4b3e-ab37-eeacaa3a6b57 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:39.286520 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d740b29-11b0-4b3e-ab37-eeacaa3a6b57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:39.287336 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d740b29-11b0-4b3e-ab37-eeacaa3a6b57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:39.289017 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d740b29-11b0-4b3e-ab37-eeacaa3a6b57 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:39.300158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 545/1100] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:39.306202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d740b29-11b0-4b3e-ab37-eeacaa3a6b57 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:39.373720 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518bcb3-16a6-467e-b284-61f5b2051279 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:39.398825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:39.405329 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d740b29-11b0-4b3e-ab37-eeacaa3a6b57 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:39.407628 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec2a86-6363-433d-952a-8c7ed1fe3777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:39.409337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec2a86-6363-433d-952a-8c7ed1fe3777 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:39.409337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec2a86-6363-433d-952a-8c7ed1fe3777 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:39.409337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec2a86-6363-433d-952a-8c7ed1fe3777 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:39.439449 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17aced-a8d9-49a0-baa3-e7be330c140f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:39.440237 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17aced-a8d9-49a0-baa3-e7be330c140f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:39.440547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17aced-a8d9-49a0-baa3-e7be330c140f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:39.440821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17aced-a8d9-49a0-baa3-e7be330c140f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:39.447348 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17aced-a8d9-49a0-baa3-e7be330c140f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:39.448811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17aced-a8d9-49a0-baa3-e7be330c140f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:39.462536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-ff17aced-a8d9-49a0-baa3-e7be330c140f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:39.462536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:39.462536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:39.462536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:39.462536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:39.462536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:39.462536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:39.462536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:39.462536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:39.462536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:39.462536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:39.462536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:39.462536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:38:39.462536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:38:39.462536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:38:39.463598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:38:39.463598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:39.463598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:39.463598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:39.463598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:39.463598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:39.463598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:39.463598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:39.463598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:39.463598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:39.463598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:39.463598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:39.463598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:39.463598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:39.463598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:39.463598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:39.463598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:39.469574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:38:39.469574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:38:39.469574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:38:39.469574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:38:39.469574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:38:39.469574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:38:39.469574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:39.469574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:39.469574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 546/1101] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:39.469574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17aced-a8d9-49a0-baa3-e7be330c140f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:39.478623 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec2a86-6363-433d-952a-8c7ed1fe3777 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:39.480038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec2a86-6363-433d-952a-8c7ed1fe3777 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:39.497639 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:39.567182 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17aced-a8d9-49a0-baa3-e7be330c140f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:39.577467 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 556/1102] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 18:38:39.583750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec2a86-6363-433d-952a-8c7ed1fe3777 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:39.606397 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418206f-198d-4794-a5c8-04a19d70658e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:39.607067 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418206f-198d-4794-a5c8-04a19d70658e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:39.607356 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418206f-198d-4794-a5c8-04a19d70658e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:39.607659 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418206f-198d-4794-a5c8-04a19d70658e None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:39.608464 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418206f-198d-4794-a5c8-04a19d70658e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:39.608787 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418206f-198d-4794-a5c8-04a19d70658e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:39.609530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:39.610227 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418206f-198d-4794-a5c8-04a19d70658e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:39.621493 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 547/1103] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:38:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:39.627527 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418206f-198d-4794-a5c8-04a19d70658e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:39.680620 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec2a86-6363-433d-952a-8c7ed1fe3777 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:39.713593 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38197c88-7cd9-4779-a7be-baaa061e4d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:39.713849 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:39.714468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38197c88-7cd9-4779-a7be-baaa061e4d3f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:39.714752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38197c88-7cd9-4779-a7be-baaa061e4d3f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:39.715027 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38197c88-7cd9-4779-a7be-baaa061e4d3f None admin] PATH_INFO: `/v3/projects/6f6264860c8e489399ea46c7fb317ecc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:39.716209 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38197c88-7cd9-4779-a7be-baaa061e4d3f None admin] RBAC: Authorizing `identity:get_project(project_id=6f6264860c8e489399ea46c7fb317ecc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:39.717685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38197c88-7cd9-4779-a7be-baaa061e4d3f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:39.719382 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 557/1104] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:38:39 2022] GET /identity/v3/projects/6f6264860c8e489399ea46c7fb317ecc => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:39.725820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38197c88-7cd9-4779-a7be-baaa061e4d3f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:39.726251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418206f-198d-4794-a5c8-04a19d70658e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:39.758543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99383578-a0fa-41c6-b2b6-847a4e8a1e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:39.759195 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383578-a0fa-41c6-b2b6-847a4e8a1e91 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:39.759476 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383578-a0fa-41c6-b2b6-847a4e8a1e91 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:39.759749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383578-a0fa-41c6-b2b6-847a4e8a1e91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:39.760710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99383578-a0fa-41c6-b2b6-847a4e8a1e91 None admin] RBAC: Adding query filter params (role.id=4b8942e18cb04e18bc69029f7203d9c0, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=3503ec98bea14693a17a84e686586bad) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:39.761020 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99383578-a0fa-41c6-b2b6-847a4e8a1e91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:39.762437 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99383578-a0fa-41c6-b2b6-847a4e8a1e91 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:39.768383 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 548/1105] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:39 2022] GET /identity/v3/role_assignments?user.id=3503ec98bea14693a17a84e686586bad&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=4b8942e18cb04e18bc69029f7203d9c0 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:39.821538 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:39.828346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38197c88-7cd9-4779-a7be-baaa061e4d3f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:39.866582 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a94e4-f2b7-47d3-85ea-18059e83912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:39.867262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a94e4-f2b7-47d3-85ea-18059e83912a None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:39.867550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a94e4-f2b7-47d3-85ea-18059e83912a None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:39.867832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a94e4-f2b7-47d3-85ea-18059e83912a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:39.868709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a94e4-f2b7-47d3-85ea-18059e83912a None admin] RBAC: Adding query filter params (role.id=416a52031d5d49b6a3fa0e9baa814436, scope.project.id=6f6264860c8e489399ea46c7fb317ecc, user.id=4d6782cac8d64a8382baf8a02e1513af) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:39.869027 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a94e4-f2b7-47d3-85ea-18059e83912a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:39.870491 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a94e4-f2b7-47d3-85ea-18059e83912a None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:39.877036 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 558/1106] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:39 2022] GET /identity/v3/role_assignments?user.id=4d6782cac8d64a8382baf8a02e1513af&scope.project.id=6f6264860c8e489399ea46c7fb317ecc&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:42.064342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff08268-3503-4f4b-b060-31b5828e2a2a None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:42.064915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff08268-3503-4f4b-b060-31b5828e2a2a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:42.064915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff08268-3503-4f4b-b060-31b5828e2a2a None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:42.066298 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 549/1107] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:42.071666 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bc0c1-abb3-46e2-b831-9716b396b291 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:42.072645 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bc0c1-abb3-46e2-b831-9716b396b291 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:42.072645 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bc0c1-abb3-46e2-b831-9716b396b291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:42.089656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-f83bc0c1-abb3-46e2-b831-9716b396b291 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:42.090849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f83bc0c1-abb3-46e2-b831-9716b396b291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:42.155352 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 559/1108] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:42.180534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff08268-3503-4f4b-b060-31b5828e2a2a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:42.280366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff08268-3503-4f4b-b060-31b5828e2a2a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:42.312824 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816d332-e860-48e4-9536-adf4eb9156c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:42.313623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816d332-e860-48e4-9536-adf4eb9156c1 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:42.313903 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816d332-e860-48e4-9536-adf4eb9156c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:42.314182 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816d332-e860-48e4-9536-adf4eb9156c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:42.315418 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816d332-e860-48e4-9536-adf4eb9156c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:42.316824 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816d332-e860-48e4-9536-adf4eb9156c1 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:42.318980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 550/1109] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:42.324826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bc0c1-abb3-46e2-b831-9716b396b291 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:42.450377 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:42.461542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bc0c1-abb3-46e2-b831-9716b396b291 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:42.495797 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce19f3-c9a4-4fba-8550-a7e1928cfdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:42.496495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce19f3-c9a4-4fba-8550-a7e1928cfdf8 None admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:42.496784 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce19f3-c9a4-4fba-8550-a7e1928cfdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:42.497061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce19f3-c9a4-4fba-8550-a7e1928cfdf8 None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:42.497780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce19f3-c9a4-4fba-8550-a7e1928cfdf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:42.499211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce19f3-c9a4-4fba-8550-a7e1928cfdf8 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:42.658916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 560/1110] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Jun 16 18:38:42 2022] POST /identity/v3/users => generated 286 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:44.827122 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8f681-cd1a-485c-a110-7cb39c7f5843 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:44.827690 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8f681-cd1a-485c-a110-7cb39c7f5843 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:44.827690 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8f681-cd1a-485c-a110-7cb39c7f5843 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:44.829084 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 551/1111] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:44.834295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940159fc-e161-41a3-ba63-c0fbcf3d23da None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:44.834712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940159fc-e161-41a3-ba63-c0fbcf3d23da None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:44.834868 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940159fc-e161-41a3-ba63-c0fbcf3d23da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:44.852201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-940159fc-e161-41a3-ba63-c0fbcf3d23da None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:44.853414 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-940159fc-e161-41a3-ba63-c0fbcf3d23da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:44.918220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 561/1112] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:44.940964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8f681-cd1a-485c-a110-7cb39c7f5843 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:44.962822 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:45.039944 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8f681-cd1a-485c-a110-7cb39c7f5843 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:45.071173 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a0283-8c7b-40dc-a251-8011fab02c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:45.072025 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a0283-8c7b-40dc-a251-8011fab02c40 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:45.072316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a0283-8c7b-40dc-a251-8011fab02c40 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:45.072625 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a0283-8c7b-40dc-a251-8011fab02c40 None admin] PATH_INFO: `/v3/roles/cfd7c6febb2246d4a48765a0aa8563bf` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:45.074111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a0283-8c7b-40dc-a251-8011fab02c40 None admin] RBAC: Authorizing `identity:get_role(role_id=cfd7c6febb2246d4a48765a0aa8563bf)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:45.075480 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a0283-8c7b-40dc-a251-8011fab02c40 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:45.076890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 552/1113] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:44 2022] GET /identity/v3/roles/cfd7c6febb2246d4a48765a0aa8563bf => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:45.082717 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940159fc-e161-41a3-ba63-c0fbcf3d23da None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:45.154672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:45.178593 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940159fc-e161-41a3-ba63-c0fbcf3d23da None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:45.211502 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18218c39-fc3a-4781-aad2-7ca99928415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:45.212409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18218c39-fc3a-4781-aad2-7ca99928415f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:45.212789 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18218c39-fc3a-4781-aad2-7ca99928415f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:45.213062 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18218c39-fc3a-4781-aad2-7ca99928415f None admin] PATH_INFO: `/v3/users/b41ce0e6be1142bea288bf30df71060c` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:45.225901 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18218c39-fc3a-4781-aad2-7ca99928415f None admin] RBAC: Authorizing `identity:get_user(user_id=b41ce0e6be1142bea288bf30df71060c)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:45.227359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18218c39-fc3a-4781-aad2-7ca99928415f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:45.229016 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 562/1114] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:45 2022] GET /identity/v3/users/b41ce0e6be1142bea288bf30df71060c => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:45.234882 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a0283-8c7b-40dc-a251-8011fab02c40 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:45.321118 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:45.332467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a0283-8c7b-40dc-a251-8011fab02c40 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:45.365442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab7ad-0748-4677-b780-87a20d07fd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:45.366032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab7ad-0748-4677-b780-87a20d07fd6b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:45.366318 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab7ad-0748-4677-b780-87a20d07fd6b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:45.366596 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab7ad-0748-4677-b780-87a20d07fd6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:45.433140 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ab7ad-0748-4677-b780-87a20d07fd6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:45.434572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ab7ad-0748-4677-b780-87a20d07fd6b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:45.517515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:45.529464 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 553/1115] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:38:45.535522 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18218c39-fc3a-4781-aad2-7ca99928415f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:45.637430 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18218c39-fc3a-4781-aad2-7ca99928415f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:45.665366 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:45.670226 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d79ce5-e8fc-4ad3-b3aa-b35fee75b463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:45.671089 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d79ce5-e8fc-4ad3-b3aa-b35fee75b463 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:45.671374 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d79ce5-e8fc-4ad3-b3aa-b35fee75b463 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:45.671652 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d79ce5-e8fc-4ad3-b3aa-b35fee75b463 None admin] PATH_INFO: `/v3/projects/6f6264860c8e489399ea46c7fb317ecc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:45.672854 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d79ce5-e8fc-4ad3-b3aa-b35fee75b463 None admin] RBAC: Authorizing `identity:get_project(project_id=6f6264860c8e489399ea46c7fb317ecc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:45.674298 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d79ce5-e8fc-4ad3-b3aa-b35fee75b463 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:45.675993 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 563/1116] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:38:45 2022] GET /identity/v3/projects/6f6264860c8e489399ea46c7fb317ecc => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:45.682884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab7ad-0748-4677-b780-87a20d07fd6b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:45.779417 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab7ad-0748-4677-b780-87a20d07fd6b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:45.812124 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0287c2-4962-4bf9-9590-f6b749cc47ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:45.812805 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0287c2-4962-4bf9-9590-f6b749cc47ba None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:45.813083 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0287c2-4962-4bf9-9590-f6b749cc47ba None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:45.813363 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0287c2-4962-4bf9-9590-f6b749cc47ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:45.814196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0287c2-4962-4bf9-9590-f6b749cc47ba None admin] RBAC: Adding query filter params (role.id=cfd7c6febb2246d4a48765a0aa8563bf, scope.project.id=6f6264860c8e489399ea46c7fb317ecc, user.id=b41ce0e6be1142bea288bf30df71060c) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:45.814510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0287c2-4962-4bf9-9590-f6b749cc47ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:45.815943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0287c2-4962-4bf9-9590-f6b749cc47ba None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:45.821912 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 554/1117] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:45 2022] GET /identity/v3/role_assignments?user.id=b41ce0e6be1142bea288bf30df71060c&scope.project.id=6f6264860c8e489399ea46c7fb317ecc&role.id=cfd7c6febb2246d4a48765a0aa8563bf => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:47.885893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a39042-7f49-4356-8530-dc50bd11416a None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:47.886459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a39042-7f49-4356-8530-dc50bd11416a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:47.886459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a39042-7f49-4356-8530-dc50bd11416a None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:47.887815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 564/1118] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:47.892923 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ce6ca-66d2-47f6-9518-c79626a30c0c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:47.893352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ce6ca-66d2-47f6-9518-c79626a30c0c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:47.893493 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ce6ca-66d2-47f6-9518-c79626a30c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:47.909815 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-cb6ce6ca-66d2-47f6-9518-c79626a30c0c None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:47.910995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cb6ce6ca-66d2-47f6-9518-c79626a30c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:47.956545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:47.975068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 555/1119] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:47.999647 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a39042-7f49-4356-8530-dc50bd11416a None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:48.097041 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a39042-7f49-4356-8530-dc50bd11416a None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:48.129225 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbee96-8b56-4f5c-b473-25408f57d0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:48.130065 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbee96-8b56-4f5c-b473-25408f57d0fe None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:48.130341 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbee96-8b56-4f5c-b473-25408f57d0fe None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:48.130610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbee96-8b56-4f5c-b473-25408f57d0fe None admin] PATH_INFO: `/v3/roles/cfd7c6febb2246d4a48765a0aa8563bf` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:48.132054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbee96-8b56-4f5c-b473-25408f57d0fe None admin] RBAC: Authorizing `identity:get_role(role_id=cfd7c6febb2246d4a48765a0aa8563bf)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:48.133456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbee96-8b56-4f5c-b473-25408f57d0fe None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:48.134815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 565/1120] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:47 2022] GET /identity/v3/roles/cfd7c6febb2246d4a48765a0aa8563bf => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:48.140830 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ce6ca-66d2-47f6-9518-c79626a30c0c None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:48.236584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ce6ca-66d2-47f6-9518-c79626a30c0c None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:48.269320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3a8d-b41c-45e6-b803-5884434a3194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:48.270191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3a8d-b41c-45e6-b803-5884434a3194 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:48.270472 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3a8d-b41c-45e6-b803-5884434a3194 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:48.270744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc3a8d-b41c-45e6-b803-5884434a3194 None admin] PATH_INFO: `/v3/users/b41ce0e6be1142bea288bf30df71060c` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:48.271931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc3a8d-b41c-45e6-b803-5884434a3194 None admin] RBAC: Authorizing `identity:get_user(user_id=b41ce0e6be1142bea288bf30df71060c)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:48.273389 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc3a8d-b41c-45e6-b803-5884434a3194 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:48.275565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 556/1121] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:48 2022] GET /identity/v3/users/b41ce0e6be1142bea288bf30df71060c => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:48.281299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbee96-8b56-4f5c-b473-25408f57d0fe None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:48.344576 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:48.376665 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbee96-8b56-4f5c-b473-25408f57d0fe None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:48.408203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6116378-49d3-4a18-b44a-5636eb1a7718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:48.409032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6116378-49d3-4a18-b44a-5636eb1a7718 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:48.409321 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6116378-49d3-4a18-b44a-5636eb1a7718 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:48.409603 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6116378-49d3-4a18-b44a-5636eb1a7718 None admin] PATH_INFO: `/v3/projects/6f6264860c8e489399ea46c7fb317ecc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:48.410785 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6116378-49d3-4a18-b44a-5636eb1a7718 None admin] RBAC: Authorizing `identity:get_project(project_id=6f6264860c8e489399ea46c7fb317ecc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:48.412231 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6116378-49d3-4a18-b44a-5636eb1a7718 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:48.413972 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 566/1122] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:38:48 2022] GET /identity/v3/projects/6f6264860c8e489399ea46c7fb317ecc => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:48.420417 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3a8d-b41c-45e6-b803-5884434a3194 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:48.468347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:48.516881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc3a8d-b41c-45e6-b803-5884434a3194 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:48.549584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1809d1-d73e-473a-a20a-97b1283a3d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:48.550459 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1809d1-d73e-473a-a20a-97b1283a3d4b None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:48.550737 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1809d1-d73e-473a-a20a-97b1283a3d4b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:48.551008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1809d1-d73e-473a-a20a-97b1283a3d4b None admin] PATH_INFO: `/v3/projects/6f6264860c8e489399ea46c7fb317ecc/users/b41ce0e6be1142bea288bf30df71060c/roles/cfd7c6febb2246d4a48765a0aa8563bf` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:48.553155 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1809d1-d73e-473a-a20a-97b1283a3d4b None admin] RBAC: Authorizing `identity:create_grant(project_id=6f6264860c8e489399ea46c7fb317ecc, user_id=b41ce0e6be1142bea288bf30df71060c, role_id=cfd7c6febb2246d4a48765a0aa8563bf)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:48.556417 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1809d1-d73e-473a-a20a-97b1283a3d4b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:48.632169 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 557/1123] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:38:48 2022] PUT /identity/v3/projects/6f6264860c8e489399ea46c7fb317ecc/users/b41ce0e6be1142bea288bf30df71060c/roles/cfd7c6febb2246d4a48765a0aa8563bf => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:38:50.733172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cc129-49a8-45b0-b73a-a2c9a9fdfbfd None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:50.733710 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cc129-49a8-45b0-b73a-a2c9a9fdfbfd None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:50.733710 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cc129-49a8-45b0-b73a-a2c9a9fdfbfd None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:50.735029 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 567/1124] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:50.741005 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fc463-a854-4881-8b8a-8485c02675f3 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:50.741513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fc463-a854-4881-8b8a-8485c02675f3 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:50.741622 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fc463-a854-4881-8b8a-8485c02675f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:50.758639 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-763fc463-a854-4881-8b8a-8485c02675f3 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:50.760336 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-763fc463-a854-4881-8b8a-8485c02675f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:50.825724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 558/1125] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:50.849160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cc129-49a8-45b0-b73a-a2c9a9fdfbfd None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:50.948317 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cc129-49a8-45b0-b73a-a2c9a9fdfbfd None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:50.980172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cead36-e2fd-4f56-ab35-e1b1a5a041fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:50.981049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cead36-e2fd-4f56-ab35-e1b1a5a041fd None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:50.981339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cead36-e2fd-4f56-ab35-e1b1a5a041fd None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:50.981618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cead36-e2fd-4f56-ab35-e1b1a5a041fd None admin] PATH_INFO: `/v3/roles/cfd7c6febb2246d4a48765a0aa8563bf` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:50.983400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cead36-e2fd-4f56-ab35-e1b1a5a041fd None admin] RBAC: Authorizing `identity:get_role(role_id=cfd7c6febb2246d4a48765a0aa8563bf)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:50.984747 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cead36-e2fd-4f56-ab35-e1b1a5a041fd None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:50.986121 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 568/1126] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:50 2022] GET /identity/v3/roles/cfd7c6febb2246d4a48765a0aa8563bf => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:50.991893 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fc463-a854-4881-8b8a-8485c02675f3 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:51.032528 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:51.087547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fc463-a854-4881-8b8a-8485c02675f3 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:51.120221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199aa916-0744-441f-9e41-de71c3262789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:51.121103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aa916-0744-441f-9e41-de71c3262789 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:51.121380 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aa916-0744-441f-9e41-de71c3262789 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:51.121653 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aa916-0744-441f-9e41-de71c3262789 None admin] PATH_INFO: `/v3/users/b41ce0e6be1142bea288bf30df71060c` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:51.122820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199aa916-0744-441f-9e41-de71c3262789 None admin] RBAC: Authorizing `identity:get_user(user_id=b41ce0e6be1142bea288bf30df71060c)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:51.124233 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199aa916-0744-441f-9e41-de71c3262789 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:51.125863 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 559/1127] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:50 2022] GET /identity/v3/users/b41ce0e6be1142bea288bf30df71060c => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:51.131523 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cead36-e2fd-4f56-ab35-e1b1a5a041fd None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:51.135684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:51.225913 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cead36-e2fd-4f56-ab35-e1b1a5a041fd None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:51.258881 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b2d39-d848-4c54-91db-01d522393470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:51.259527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b2d39-d848-4c54-91db-01d522393470 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:51.259815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b2d39-d848-4c54-91db-01d522393470 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:51.260125 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b2d39-d848-4c54-91db-01d522393470 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:51.324930 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b2d39-d848-4c54-91db-01d522393470 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:51.326378 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b2d39-d848-4c54-91db-01d522393470 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:51.328933 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:51.419697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 569/1128] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:38:51.425783 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199aa916-0744-441f-9e41-de71c3262789 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:51.520797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199aa916-0744-441f-9e41-de71c3262789 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:51.529998 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:51.553950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6610054-4061-479c-ae93-ea189c77244f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:51.554796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6610054-4061-479c-ae93-ea189c77244f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:51.555078 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6610054-4061-479c-ae93-ea189c77244f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:51.555349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6610054-4061-479c-ae93-ea189c77244f None admin] PATH_INFO: `/v3/projects/6f6264860c8e489399ea46c7fb317ecc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:51.556545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6610054-4061-479c-ae93-ea189c77244f None admin] RBAC: Authorizing `identity:get_project(project_id=6f6264860c8e489399ea46c7fb317ecc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:51.557999 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6610054-4061-479c-ae93-ea189c77244f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:51.560553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 560/1129] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:38:51 2022] GET /identity/v3/projects/6f6264860c8e489399ea46c7fb317ecc => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:51.565697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b2d39-d848-4c54-91db-01d522393470 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:51.660570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b2d39-d848-4c54-91db-01d522393470 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:51.662780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:51.693492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ac962-7153-43ba-b402-6c2a6610ab87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:51.694136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ac962-7153-43ba-b402-6c2a6610ab87 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:51.694423 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ac962-7153-43ba-b402-6c2a6610ab87 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:51.694704 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ac962-7153-43ba-b402-6c2a6610ab87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:51.695530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ac962-7153-43ba-b402-6c2a6610ab87 None admin] RBAC: Adding query filter params (role.id=cfd7c6febb2246d4a48765a0aa8563bf, scope.project.id=6f6264860c8e489399ea46c7fb317ecc, user.id=b41ce0e6be1142bea288bf30df71060c) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:51.695861 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ac962-7153-43ba-b402-6c2a6610ab87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:51.697799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ac962-7153-43ba-b402-6c2a6610ab87 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:51.703862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 570/1130] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:51 2022] GET /identity/v3/role_assignments?user.id=b41ce0e6be1142bea288bf30df71060c&scope.project.id=6f6264860c8e489399ea46c7fb317ecc&role.id=cfd7c6febb2246d4a48765a0aa8563bf => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:53.990020 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e0b25-d63c-4d19-9305-d8517d4a0022 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:53.990562 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e0b25-d63c-4d19-9305-d8517d4a0022 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:53.990562 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e0b25-d63c-4d19-9305-d8517d4a0022 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:53.991927 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 561/1131] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:53.997585 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ba412-d1c3-435b-9292-4a0f20e55788 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:53.997995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ba412-d1c3-435b-9292-4a0f20e55788 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:53.998164 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ba412-d1c3-435b-9292-4a0f20e55788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:54.014435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-739ba412-d1c3-435b-9292-4a0f20e55788 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:54.015616 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-739ba412-d1c3-435b-9292-4a0f20e55788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:54.081024 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 571/1132] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:54.104677 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e0b25-d63c-4d19-9305-d8517d4a0022 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:54.201630 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e0b25-d63c-4d19-9305-d8517d4a0022 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:54.233669 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59d2ef-5a88-44a0-9c7d-8a835d83c62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:54.234698 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59d2ef-5a88-44a0-9c7d-8a835d83c62f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:54.234981 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59d2ef-5a88-44a0-9c7d-8a835d83c62f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:54.235253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59d2ef-5a88-44a0-9c7d-8a835d83c62f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:54.236406 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59d2ef-5a88-44a0-9c7d-8a835d83c62f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:54.237849 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59d2ef-5a88-44a0-9c7d-8a835d83c62f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:54.239433 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 562/1133] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:54.245161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ba412-d1c3-435b-9292-4a0f20e55788 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:54.336670 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:54.341045 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ba412-d1c3-435b-9292-4a0f20e55788 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:54.374741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52e7b2-1825-415e-acc3-c01cfc52ec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:54.375405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52e7b2-1825-415e-acc3-c01cfc52ec1e None admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:54.375693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52e7b2-1825-415e-acc3-c01cfc52ec1e None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:54.375973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52e7b2-1825-415e-acc3-c01cfc52ec1e None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:54.376707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52e7b2-1825-415e-acc3-c01cfc52ec1e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:54.378143 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52e7b2-1825-415e-acc3-c01cfc52ec1e None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:54.501624 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 572/1134] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Jun 16 18:38:54 2022] POST /identity/v3/projects => generated 311 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:56.647180 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827d41b-93b4-4c16-814e-7fef64ff7d69 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:56.647694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827d41b-93b4-4c16-814e-7fef64ff7d69 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:56.647694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827d41b-93b4-4c16-814e-7fef64ff7d69 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:56.649044 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 563/1135] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:56.654266 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6d935-8206-458e-8235-7f53d2cf425f None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:56.654652 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6d935-8206-458e-8235-7f53d2cf425f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:56.654833 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6d935-8206-458e-8235-7f53d2cf425f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:56.671679 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-64b6d935-8206-458e-8235-7f53d2cf425f None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:56.672878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-64b6d935-8206-458e-8235-7f53d2cf425f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:56.735790 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 573/1136] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:56.760628 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827d41b-93b4-4c16-814e-7fef64ff7d69 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:56.806259 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:56.857858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827d41b-93b4-4c16-814e-7fef64ff7d69 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:56.892457 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1e134-5cb1-44bd-b435-3e0d1d75a4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:56.893254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1e134-5cb1-44bd-b435-3e0d1d75a4cc None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:56.893547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1e134-5cb1-44bd-b435-3e0d1d75a4cc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:56.893827 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1e134-5cb1-44bd-b435-3e0d1d75a4cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:56.895008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1e134-5cb1-44bd-b435-3e0d1d75a4cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:56.896465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1e134-5cb1-44bd-b435-3e0d1d75a4cc None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:56.898125 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 564/1137] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:56.904204 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6d935-8206-458e-8235-7f53d2cf425f None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:56.980218 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:56.998987 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6d935-8206-458e-8235-7f53d2cf425f None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:57.032082 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097b530-cff7-4d1c-bd57-f857dc3e0186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:57.032775 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097b530-cff7-4d1c-bd57-f857dc3e0186 None admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:57.033064 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097b530-cff7-4d1c-bd57-f857dc3e0186 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:57.033343 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097b530-cff7-4d1c-bd57-f857dc3e0186 None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:57.034108 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097b530-cff7-4d1c-bd57-f857dc3e0186 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:57.035546 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097b530-cff7-4d1c-bd57-f857dc3e0186 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:57.139014 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 574/1138] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Jun 16 18:38:56 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:38:59.296956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb54ec4-235e-4fea-9e7d-132409f6d861 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:59.297420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb54ec4-235e-4fea-9e7d-132409f6d861 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:59.297537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb54ec4-235e-4fea-9e7d-132409f6d861 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:59.298876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 565/1139] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:59.303958 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de783189-01f9-4558-928a-83ebeeb66ca5 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:59.304347 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de783189-01f9-4558-928a-83ebeeb66ca5 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:59.304532 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de783189-01f9-4558-928a-83ebeeb66ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:59.320756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-de783189-01f9-4558-928a-83ebeeb66ca5 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:59.321918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-de783189-01f9-4558-928a-83ebeeb66ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:59.384988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 575/1140] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:59.415949 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb54ec4-235e-4fea-9e7d-132409f6d861 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:59.515195 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb54ec4-235e-4fea-9e7d-132409f6d861 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:59.527712 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:59.548325 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d778824-366b-4863-9232-a63a7f346761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:59.549138 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d778824-366b-4863-9232-a63a7f346761 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:59.549425 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d778824-366b-4863-9232-a63a7f346761 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:59.549703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d778824-366b-4863-9232-a63a7f346761 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:59.559414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d778824-366b-4863-9232-a63a7f346761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:59.567033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-7d778824-366b-4863-9232-a63a7f346761 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:59.567033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:59.567033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:59.567033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:59.567033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:59.567033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:59.567033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:59.567033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:59.567033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:59.567033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:59.567033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:59.567033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:59.567033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:59.567033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:59.567033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:59.567033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:59.567962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:59.567962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:59.567962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:59.567962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:59.567962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:59.567962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:59.567962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:59.567962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:59.567962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:59.567962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:59.567962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:59.567962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:59.567962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:59.567962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:59.567962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:59.567962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:59.568889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:59.568889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:59.568889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:59.568889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:59.568889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:59.568889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:59.568889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:59.568889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:59.568889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:59.568889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:59.568889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:59.568889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:38:59.568889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 566/1141] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:38:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:59.574161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de783189-01f9-4558-928a-83ebeeb66ca5 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:59.636842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:59.670499 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de783189-01f9-4558-928a-83ebeeb66ca5 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:59.711132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f62aa6-d129-433f-8609-ce5a2a12f92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:59.711810 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f62aa6-d129-433f-8609-ce5a2a12f92e None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:59.712098 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f62aa6-d129-433f-8609-ce5a2a12f92e None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:59.712377 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f62aa6-d129-433f-8609-ce5a2a12f92e None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:59.713169 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f62aa6-d129-433f-8609-ce5a2a12f92e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:59.713485 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f62aa6-d129-433f-8609-ce5a2a12f92e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:59.714860 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f62aa6-d129-433f-8609-ce5a2a12f92e None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:59.723615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 576/1142] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:38:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:59.729558 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d778824-366b-4863-9232-a63a7f346761 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:59.829719 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d778824-366b-4863-9232-a63a7f346761 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:59.861556 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03063556-0ba2-4e9d-839c-c8935113018f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:59.862669 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03063556-0ba2-4e9d-839c-c8935113018f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:59.862952 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03063556-0ba2-4e9d-839c-c8935113018f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:59.863230 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03063556-0ba2-4e9d-839c-c8935113018f None admin] PATH_INFO: `/v3/users/695fe70140ca43c49219495afa976881` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:59.876597 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03063556-0ba2-4e9d-839c-c8935113018f None admin] RBAC: Authorizing `identity:get_user(user_id=695fe70140ca43c49219495afa976881)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:59.878027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03063556-0ba2-4e9d-839c-c8935113018f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:59.879667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 567/1143] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:59 2022] GET /identity/v3/users/695fe70140ca43c49219495afa976881 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:59.885475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f62aa6-d129-433f-8609-ce5a2a12f92e None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:59.981015 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f62aa6-d129-433f-8609-ce5a2a12f92e None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:00.006386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:00.015223 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa980e76-2ad2-4966-b88f-e77722e31c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:00.025622 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa980e76-2ad2-4966-b88f-e77722e31c21 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:00.025908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa980e76-2ad2-4966-b88f-e77722e31c21 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:00.026180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa980e76-2ad2-4966-b88f-e77722e31c21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:00.101861 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa980e76-2ad2-4966-b88f-e77722e31c21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:00.103221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa980e76-2ad2-4966-b88f-e77722e31c21 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:00.201999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 577/1144] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:39:00.207944 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03063556-0ba2-4e9d-839c-c8935113018f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:00.237111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:00.304244 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03063556-0ba2-4e9d-839c-c8935113018f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:00.337141 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c20671-22b2-4cda-965d-eaba3e85b468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:00.337997 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c20671-22b2-4cda-965d-eaba3e85b468 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:00.338287 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c20671-22b2-4cda-965d-eaba3e85b468 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:00.338569 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c20671-22b2-4cda-965d-eaba3e85b468 None admin] PATH_INFO: `/v3/projects/ba310c7d00cb40a39d6331dff16af246` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:00.339742 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c20671-22b2-4cda-965d-eaba3e85b468 None admin] RBAC: Authorizing `identity:get_project(project_id=ba310c7d00cb40a39d6331dff16af246)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:00.341207 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c20671-22b2-4cda-965d-eaba3e85b468 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:00.342928 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 568/1145] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:39:00 2022] GET /identity/v3/projects/ba310c7d00cb40a39d6331dff16af246 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:00.349129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa980e76-2ad2-4966-b88f-e77722e31c21 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:00.376855 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:00.446703 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa980e76-2ad2-4966-b88f-e77722e31c21 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:00.478164 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601f3a3-6bc2-4335-b98e-3ef7a230c2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:00.478813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601f3a3-6bc2-4335-b98e-3ef7a230c2b6 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:00.479095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601f3a3-6bc2-4335-b98e-3ef7a230c2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:00.479374 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601f3a3-6bc2-4335-b98e-3ef7a230c2b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:00.480189 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601f3a3-6bc2-4335-b98e-3ef7a230c2b6 None admin] RBAC: Adding query filter params (role.id=416a52031d5d49b6a3fa0e9baa814436, scope.project.id=ba310c7d00cb40a39d6331dff16af246, user.id=695fe70140ca43c49219495afa976881) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:39:00.480527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601f3a3-6bc2-4335-b98e-3ef7a230c2b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:00.481947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601f3a3-6bc2-4335-b98e-3ef7a230c2b6 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:00.487896 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 578/1146] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:39:00 2022] GET /identity/v3/role_assignments?user.id=695fe70140ca43c49219495afa976881&scope.project.id=ba310c7d00cb40a39d6331dff16af246&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:02.549802 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56520e46-5bc7-43a3-9d62-cafabd8f0f5d None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:02.550307 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56520e46-5bc7-43a3-9d62-cafabd8f0f5d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:02.550307 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56520e46-5bc7-43a3-9d62-cafabd8f0f5d None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:02.551609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 569/1147] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:39:02.556867 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f86901-e88d-4b88-bc74-e297b479b286 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:02.557318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f86901-e88d-4b88-bc74-e297b479b286 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:02.557434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f86901-e88d-4b88-bc74-e297b479b286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:02.573713 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-e2f86901-e88d-4b88-bc74-e297b479b286 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:39:02.574887 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-e2f86901-e88d-4b88-bc74-e297b479b286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:39:02.638421 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 579/1148] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:39:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:39:02.661307 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56520e46-5bc7-43a3-9d62-cafabd8f0f5d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:02.753015 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:02.757270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56520e46-5bc7-43a3-9d62-cafabd8f0f5d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:02.789562 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7d936-993a-4bde-8097-ab50c103b2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:02.790334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7d936-993a-4bde-8097-ab50c103b2b0 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:02.790612 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7d936-993a-4bde-8097-ab50c103b2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:02.790879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7d936-993a-4bde-8097-ab50c103b2b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:02.800733 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7d936-993a-4bde-8097-ab50c103b2b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:39:02.808157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-a2a7d936-993a-4bde-8097-ab50c103b2b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:39:02.808157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:39:02.808157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:39:02.808157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:39:02.808157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:39:02.808157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:39:02.808157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:39:02.808157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:39:02.808157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:39:02.808157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:39:02.808157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:39:02.808157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:39:02.808157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:39:02.808157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:39:02.808157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:39:02.808157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:39:02.809255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:39:02.809255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:39:02.809255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:39:02.809255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:39:02.809255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:39:02.809255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:39:02.809255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:39:02.809255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:39:02.809255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:39:02.809255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:39:02.809255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:39:02.809255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:39:02.809255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:39:02.809255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:39:02.809255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:39:02.809255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:39:02.810139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:39:02.810139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:39:02.810139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:39:02.810139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:39:02.810139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:39:02.810139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:39:02.810139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:39:02.810139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:39:02.810139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:39:02.810139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:39:02.810139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:39:02.810139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:39:02.810139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 570/1149] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:39:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:39:02.816019 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f86901-e88d-4b88-bc74-e297b479b286 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:02.843577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:02.915436 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f86901-e88d-4b88-bc74-e297b479b286 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:02.947796 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b80e5a-bfd8-422e-bfc9-548e105d57e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:02.948481 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b80e5a-bfd8-422e-bfc9-548e105d57e3 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:02.948774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b80e5a-bfd8-422e-bfc9-548e105d57e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:02.949056 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b80e5a-bfd8-422e-bfc9-548e105d57e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:02.949799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b80e5a-bfd8-422e-bfc9-548e105d57e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:39:02.950107 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b80e5a-bfd8-422e-bfc9-548e105d57e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:02.951476 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b80e5a-bfd8-422e-bfc9-548e105d57e3 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:02.959814 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 580/1150] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:39:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:02.965546 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7d936-993a-4bde-8097-ab50c103b2b0 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:03.060516 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7d936-993a-4bde-8097-ab50c103b2b0 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:03.092847 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028367b7-624b-4c18-81d7-48f477489ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:03.093705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028367b7-624b-4c18-81d7-48f477489ab0 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:03.093986 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028367b7-624b-4c18-81d7-48f477489ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:03.094260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028367b7-624b-4c18-81d7-48f477489ab0 None admin] PATH_INFO: `/v3/users/695fe70140ca43c49219495afa976881` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:03.095433 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028367b7-624b-4c18-81d7-48f477489ab0 None admin] RBAC: Authorizing `identity:get_user(user_id=695fe70140ca43c49219495afa976881)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:03.096899 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028367b7-624b-4c18-81d7-48f477489ab0 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:03.098499 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 571/1151] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:39:02 2022] GET /identity/v3/users/695fe70140ca43c49219495afa976881 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:03.103948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b80e5a-bfd8-422e-bfc9-548e105d57e3 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:03.188139 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:03.203024 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b80e5a-bfd8-422e-bfc9-548e105d57e3 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:03.235087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87e2bf-1739-4414-8dcf-a852633f1e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:03.235927 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87e2bf-1739-4414-8dcf-a852633f1e07 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:03.236211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87e2bf-1739-4414-8dcf-a852633f1e07 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:03.236509 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87e2bf-1739-4414-8dcf-a852633f1e07 None admin] PATH_INFO: `/v3/projects/ba310c7d00cb40a39d6331dff16af246` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:03.237679 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87e2bf-1739-4414-8dcf-a852633f1e07 None admin] RBAC: Authorizing `identity:get_project(project_id=ba310c7d00cb40a39d6331dff16af246)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:03.239366 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87e2bf-1739-4414-8dcf-a852633f1e07 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:03.241083 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 581/1152] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:39:03 2022] GET /identity/v3/projects/ba310c7d00cb40a39d6331dff16af246 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:03.247043 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028367b7-624b-4c18-81d7-48f477489ab0 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:03.274874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:03.344651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028367b7-624b-4c18-81d7-48f477489ab0 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:03.377570 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26f2f5-decf-4994-aa79-34ead942c3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:03.378449 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26f2f5-decf-4994-aa79-34ead942c3e9 None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:03.378736 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26f2f5-decf-4994-aa79-34ead942c3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:03.379014 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26f2f5-decf-4994-aa79-34ead942c3e9 None admin] PATH_INFO: `/v3/projects/ba310c7d00cb40a39d6331dff16af246/users/695fe70140ca43c49219495afa976881/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:03.381001 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26f2f5-decf-4994-aa79-34ead942c3e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba310c7d00cb40a39d6331dff16af246, user_id=695fe70140ca43c49219495afa976881, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:03.382439 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26f2f5-decf-4994-aa79-34ead942c3e9 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:03.486491 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 572/1153] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:39:03 2022] PUT /identity/v3/projects/ba310c7d00cb40a39d6331dff16af246/users/695fe70140ca43c49219495afa976881/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:39:05.572965 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71215320-4ec2-405e-bc9a-43e23aeeeba8 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:05.573473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71215320-4ec2-405e-bc9a-43e23aeeeba8 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:05.573473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71215320-4ec2-405e-bc9a-43e23aeeeba8 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:05.574825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 582/1154] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:39:05.580051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a61e1-d86a-4843-a8f2-ab7f204f7927 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:05.580426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a61e1-d86a-4843-a8f2-ab7f204f7927 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:05.580635 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a61e1-d86a-4843-a8f2-ab7f204f7927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:05.596831 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5b0a61e1-d86a-4843-a8f2-ab7f204f7927 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:39:05.597992 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5b0a61e1-d86a-4843-a8f2-ab7f204f7927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:39:05.662246 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 573/1155] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:39:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:39:05.685874 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71215320-4ec2-405e-bc9a-43e23aeeeba8 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:05.784597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71215320-4ec2-405e-bc9a-43e23aeeeba8 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:05.816896 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40345b-63a2-49ca-a027-f7a88b332157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:05.817678 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40345b-63a2-49ca-a027-f7a88b332157 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:05.817965 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40345b-63a2-49ca-a027-f7a88b332157 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:05.818244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40345b-63a2-49ca-a027-f7a88b332157 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:05.828073 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40345b-63a2-49ca-a027-f7a88b332157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:39:05.835661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-ee40345b-63a2-49ca-a027-f7a88b332157 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:39:05.835661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:39:05.835661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:39:05.835661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:39:05.835661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:39:05.835661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:39:05.835661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:39:05.835661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:39:05.835661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:39:05.835661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:39:05.835661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:39:05.835661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:39:05.835661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:39:05.835661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:39:05.835661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:39:05.835661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:39:05.836756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:39:05.836756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:39:05.836756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:39:05.836756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:39:05.836756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:39:05.836756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:39:05.836756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:39:05.836756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:39:05.836756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:39:05.836756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:39:05.836756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:39:05.836756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:39:05.836756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:39:05.836756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:39:05.836756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:39:05.836756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:39:05.837815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:39:05.837815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:39:05.837815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:39:05.837815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:39:05.837815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:39:05.837815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:39:05.837815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:39:05.837815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:39:05.837815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:39:05.837815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:39:05.837815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:39:05.837815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:39:05.837815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 583/1156] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:39:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:39:05.842997 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a61e1-d86a-4843-a8f2-ab7f204f7927 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:05.860822 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:05.943216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a61e1-d86a-4843-a8f2-ab7f204f7927 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:05.975717 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186b356-e813-4977-830d-b3e8c6554523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:05.976372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186b356-e813-4977-830d-b3e8c6554523 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:05.976677 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186b356-e813-4977-830d-b3e8c6554523 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:05.976951 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186b356-e813-4977-830d-b3e8c6554523 None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:05.977689 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186b356-e813-4977-830d-b3e8c6554523 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:39:05.977995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186b356-e813-4977-830d-b3e8c6554523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:05.979349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186b356-e813-4977-830d-b3e8c6554523 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:05.987730 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 574/1157] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:39:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:05.993942 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40345b-63a2-49ca-a027-f7a88b332157 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:06.008856 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:06.089940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40345b-63a2-49ca-a027-f7a88b332157 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:06.123318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7848431-8996-4c1d-9f0d-ac5607c09ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:06.124176 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7848431-8996-4c1d-9f0d-ac5607c09ee4 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:06.124485 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7848431-8996-4c1d-9f0d-ac5607c09ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:06.124794 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7848431-8996-4c1d-9f0d-ac5607c09ee4 None admin] PATH_INFO: `/v3/users/695fe70140ca43c49219495afa976881` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:06.125975 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7848431-8996-4c1d-9f0d-ac5607c09ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=695fe70140ca43c49219495afa976881)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:06.127412 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7848431-8996-4c1d-9f0d-ac5607c09ee4 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:06.129054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 584/1158] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:39:05 2022] GET /identity/v3/users/695fe70140ca43c49219495afa976881 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:06.134965 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186b356-e813-4977-830d-b3e8c6554523 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:06.217191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:06.239316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186b356-e813-4977-830d-b3e8c6554523 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:06.272380 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421f329-e74c-4551-929f-0580d7920ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:06.273058 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421f329-e74c-4551-929f-0580d7920ada None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:06.273341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421f329-e74c-4551-929f-0580d7920ada None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:06.273616 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421f329-e74c-4551-929f-0580d7920ada None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:06.338458 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421f329-e74c-4551-929f-0580d7920ada None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:06.339894 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421f329-e74c-4551-929f-0580d7920ada None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:06.414434 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:06.435849 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 575/1159] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:39:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:39:06.442381 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7848431-8996-4c1d-9f0d-ac5607c09ee4 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:06.519686 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:06.538246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7848431-8996-4c1d-9f0d-ac5607c09ee4 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:06.571212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb607e8-8ddc-4ecc-89fd-f20c6238fb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:06.572061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb607e8-8ddc-4ecc-89fd-f20c6238fb9c None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:06.572343 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb607e8-8ddc-4ecc-89fd-f20c6238fb9c None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:06.572645 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb607e8-8ddc-4ecc-89fd-f20c6238fb9c None admin] PATH_INFO: `/v3/projects/ba310c7d00cb40a39d6331dff16af246` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:06.573803 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb607e8-8ddc-4ecc-89fd-f20c6238fb9c None admin] RBAC: Authorizing `identity:get_project(project_id=ba310c7d00cb40a39d6331dff16af246)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:06.575235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb607e8-8ddc-4ecc-89fd-f20c6238fb9c None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:06.576949 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 585/1160] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:39:06 2022] GET /identity/v3/projects/ba310c7d00cb40a39d6331dff16af246 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:06.583069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421f329-e74c-4551-929f-0580d7920ada None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:06.680513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421f329-e74c-4551-929f-0580d7920ada None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:06.713422 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5556c9-d126-4c4c-8c73-cec07175350b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:06.714081 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5556c9-d126-4c4c-8c73-cec07175350b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:06.714371 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5556c9-d126-4c4c-8c73-cec07175350b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:06.714651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5556c9-d126-4c4c-8c73-cec07175350b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:06.715519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5556c9-d126-4c4c-8c73-cec07175350b None admin] RBAC: Adding query filter params (role.id=416a52031d5d49b6a3fa0e9baa814436, scope.project.id=ba310c7d00cb40a39d6331dff16af246, user.id=695fe70140ca43c49219495afa976881) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:39:06.715837 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5556c9-d126-4c4c-8c73-cec07175350b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:06.717401 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5556c9-d126-4c4c-8c73-cec07175350b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:06.723709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 576/1161] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:39:06 2022] GET /identity/v3/role_assignments?user.id=695fe70140ca43c49219495afa976881&scope.project.id=ba310c7d00cb40a39d6331dff16af246&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:08.860154 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fced55-257f-4e20-988d-5c199f28958e None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:08.860884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fced55-257f-4e20-988d-5c199f28958e None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:08.861012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fced55-257f-4e20-988d-5c199f28958e None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:08.862343 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 586/1162] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:39:08.868570 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1fea5-b266-4f09-9a19-81adea3c065f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:08.869113 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1fea5-b266-4f09-9a19-81adea3c065f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:08.869113 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1fea5-b266-4f09-9a19-81adea3c065f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:08.886576 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-e5c1fea5-b266-4f09-9a19-81adea3c065f None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:39:08.887767 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e5c1fea5-b266-4f09-9a19-81adea3c065f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:39:08.921750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:08.951841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 577/1163] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:39:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:39:08.975087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fced55-257f-4e20-988d-5c199f28958e None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:09.074634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fced55-257f-4e20-988d-5c199f28958e None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:09.106708 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80738f2-1837-4e0b-ae42-e950e2b3fe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:09.107346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80738f2-1837-4e0b-ae42-e950e2b3fe23 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:09.107627 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80738f2-1837-4e0b-ae42-e950e2b3fe23 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:09.107902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80738f2-1837-4e0b-ae42-e950e2b3fe23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:09.124643 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:09.171765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80738f2-1837-4e0b-ae42-e950e2b3fe23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:09.173747 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80738f2-1837-4e0b-ae42-e950e2b3fe23 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:09.266562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 587/1164] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:39:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:39:09.272396 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1fea5-b266-4f09-9a19-81adea3c065f None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:09.368087 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1fea5-b266-4f09-9a19-81adea3c065f None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:09.401436 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5a1c2-fef9-45d5-b235-d380aa99ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:09.402164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5a1c2-fef9-45d5-b235-d380aa99ef93 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:09.402454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5a1c2-fef9-45d5-b235-d380aa99ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:09.402733 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5a1c2-fef9-45d5-b235-d380aa99ef93 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:09.409289 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5a1c2-fef9-45d5-b235-d380aa99ef93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:09.410731 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5a1c2-fef9-45d5-b235-d380aa99ef93 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:09.425051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-63b5a1c2-fef9-45d5-b235-d380aa99ef93 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 18:39:09.425051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:39:09.425051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 16 18:39:09.425051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 16 18:39:09.425051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:39:09.425051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:39:09.425051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:39:09.425051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:39:09.425051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 16 18:39:09.425051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:39:09.425051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:39:09.425051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:39:09.425051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:39:09.425051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:39:09.425051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:39:09.425051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:39:09.425051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:39:09.426317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:39:09.426317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:39:09.426317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:39:09.426317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:39:09.426317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:39:09.426317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:39:09.426317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:39:09.426317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:39:09.426317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:39:09.426317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:39:09.426317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:39:09.426317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:39:09.426317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:39:09.426317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:39:09.426317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:39:09.426317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:39:09.427581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:39:09.427581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:39:09.427581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:39:09.427581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:39:09.427581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:39:09.427581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:39:09.427581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:39:09.427581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:39:09.427581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:39:09.427581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:39:09.427581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 16 18:39:09.427581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:39:09.427581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 18:39:09.427581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:39:09.427581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 578/1165] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Jun 16 18:39:09 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:39:09.432125 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80738f2-1837-4e0b-ae42-e950e2b3fe23 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:09.479387 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:09.529614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80738f2-1837-4e0b-ae42-e950e2b3fe23 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:09.561872 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00d11b-3741-409d-ba36-f66e8d17e520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:09.562520 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00d11b-3741-409d-ba36-f66e8d17e520 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:09.562850 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00d11b-3741-409d-ba36-f66e8d17e520 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:09.563082 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00d11b-3741-409d-ba36-f66e8d17e520 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:09.563829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00d11b-3741-409d-ba36-f66e8d17e520 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:39:09.564202 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00d11b-3741-409d-ba36-f66e8d17e520 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:09.565529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00d11b-3741-409d-ba36-f66e8d17e520 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:09.572481 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 588/1166] 10.222.0.93 () {56 vars in 1115 bytes} [Thu Jun 16 18:39:09 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:11.649820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ebe53-f977-40cd-8c01-ba470e13da30 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:11.650322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ebe53-f977-40cd-8c01-ba470e13da30 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:11.650322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ebe53-f977-40cd-8c01-ba470e13da30 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:11.651678 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 579/1167] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:39:11.656761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256cd16-651b-4ca2-974c-25cc2de7cfb0 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:11.657147 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256cd16-651b-4ca2-974c-25cc2de7cfb0 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:11.657330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256cd16-651b-4ca2-974c-25cc2de7cfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:11.674152 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-5256cd16-651b-4ca2-974c-25cc2de7cfb0 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:39:11.675324 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5256cd16-651b-4ca2-974c-25cc2de7cfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:39:11.739687 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 589/1168] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:39:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:39:11.762538 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ebe53-f977-40cd-8c01-ba470e13da30 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:11.794233 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:11.862654 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ebe53-f977-40cd-8c01-ba470e13da30 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:11.894557 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991d417-d29c-4450-a9fb-abfee390cf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:11.895212 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991d417-d29c-4450-a9fb-abfee390cf6d None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:11.895499 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991d417-d29c-4450-a9fb-abfee390cf6d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:11.895781 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991d417-d29c-4450-a9fb-abfee390cf6d None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:11.896721 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991d417-d29c-4450-a9fb-abfee390cf6d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:11.898088 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991d417-d29c-4450-a9fb-abfee390cf6d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:11.996156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 580/1169] 10.222.0.93 () {60 vars in 1138 bytes} [Thu Jun 16 18:39:11 2022] POST /identity/v3/domains => generated 267 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:39:14.127604 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717c30d-8e3c-4f5f-a96a-a7a67dc93d4e None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:14.128163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717c30d-8e3c-4f5f-a96a-a7a67dc93d4e None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:14.128163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717c30d-8e3c-4f5f-a96a-a7a67dc93d4e None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:14.129545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 590/1170] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:39:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:39:14.134794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e101d-7137-4920-91e4-a133393ab32c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:14.135179 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e101d-7137-4920-91e4-a133393ab32c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:14.135358 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e101d-7137-4920-91e4-a133393ab32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:14.152367 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-853e101d-7137-4920-91e4-a133393ab32c None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:39:14.153575 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-853e101d-7137-4920-91e4-a133393ab32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:39:14.216616 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 581/1171] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:39:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:39:14.239933 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717c30d-8e3c-4f5f-a96a-a7a67dc93d4e None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:14.284711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:14.342721 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717c30d-8e3c-4f5f-a96a-a7a67dc93d4e None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:14.375114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821754a8-912c-4a4a-9a29-5952556b6eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:14.375969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821754a8-912c-4a4a-9a29-5952556b6eb6 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:14.376253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821754a8-912c-4a4a-9a29-5952556b6eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:14.376583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821754a8-912c-4a4a-9a29-5952556b6eb6 None admin] PATH_INFO: `/v3/domains/91bdf311c8864e6f9c37bb1125df1e53` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:14.387166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821754a8-912c-4a4a-9a29-5952556b6eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=91bdf311c8864e6f9c37bb1125df1e53)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:14.388577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821754a8-912c-4a4a-9a29-5952556b6eb6 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:14.390207 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 591/1172] 10.222.0.93 () {56 vars in 1183 bytes} [Thu Jun 16 18:39:14 2022] GET /identity/v3/domains/91bdf311c8864e6f9c37bb1125df1e53 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:14.396765 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e101d-7137-4920-91e4-a133393ab32c None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:14.419607 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:14.493483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e101d-7137-4920-91e4-a133393ab32c None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:14.526857 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76109530-aeff-4a0e-b723-a17ec96b6223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:14.527513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76109530-aeff-4a0e-b723-a17ec96b6223 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:14.527797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76109530-aeff-4a0e-b723-a17ec96b6223 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:14.528075 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76109530-aeff-4a0e-b723-a17ec96b6223 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:14.528823 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76109530-aeff-4a0e-b723-a17ec96b6223 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:14.530250 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76109530-aeff-4a0e-b723-a17ec96b6223 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:14.614180 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 582/1173] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Jun 16 18:39:14 2022] POST /identity/v3/projects => generated 361 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:39:16.811702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142453cc-ff5c-482f-ab3b-952fc7c17141 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:16.812277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142453cc-ff5c-482f-ab3b-952fc7c17141 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:16.812277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142453cc-ff5c-482f-ab3b-952fc7c17141 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:16.813659 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 592/1174] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:39:16.819599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e206363-edc3-4edb-a59f-cec5fbbfb711 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:16.820216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e206363-edc3-4edb-a59f-cec5fbbfb711 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:16.820216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e206363-edc3-4edb-a59f-cec5fbbfb711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:16.837098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6e206363-edc3-4edb-a59f-cec5fbbfb711 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:39:16.838285 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6e206363-edc3-4edb-a59f-cec5fbbfb711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:39:16.904912 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 583/1175] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:39:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:39:16.930219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142453cc-ff5c-482f-ab3b-952fc7c17141 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:17.028336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142453cc-ff5c-482f-ab3b-952fc7c17141 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:17.029867 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:17.061843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36952971-d8c5-4073-a63e-828ceba24605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:17.062645 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36952971-d8c5-4073-a63e-828ceba24605 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:17.062933 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36952971-d8c5-4073-a63e-828ceba24605 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:17.063213 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36952971-d8c5-4073-a63e-828ceba24605 None admin] PATH_INFO: `/v3/domains/91bdf311c8864e6f9c37bb1125df1e53` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:17.064390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36952971-d8c5-4073-a63e-828ceba24605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=91bdf311c8864e6f9c37bb1125df1e53)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:17.065878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36952971-d8c5-4073-a63e-828ceba24605 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:17.067491 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 593/1176] 10.222.0.93 () {56 vars in 1183 bytes} [Thu Jun 16 18:39:16 2022] GET /identity/v3/domains/91bdf311c8864e6f9c37bb1125df1e53 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:17.073489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e206363-edc3-4edb-a59f-cec5fbbfb711 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:17.076604 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:17.169283 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e206363-edc3-4edb-a59f-cec5fbbfb711 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:17.202014 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb6980-fe94-4a2e-80c9-7ca21b6019f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:17.202682 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb6980-fe94-4a2e-80c9-7ca21b6019f0 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:17.202968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb6980-fe94-4a2e-80c9-7ca21b6019f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:17.203245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb6980-fe94-4a2e-80c9-7ca21b6019f0 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:17.203955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb6980-fe94-4a2e-80c9-7ca21b6019f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:17.205415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb6980-fe94-4a2e-80c9-7ca21b6019f0 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:17.310873 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 584/1177] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Jun 16 18:39:17 2022] POST /identity/v3/users => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:39:19.457717 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d402a57-bdca-40e1-8ec8-4cbd702d841f None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:19.458263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d402a57-bdca-40e1-8ec8-4cbd702d841f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:19.458263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d402a57-bdca-40e1-8ec8-4cbd702d841f None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:19.459643 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 594/1178] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:39:19.464719 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad9962-604a-4095-9a04-0471deb2ecbe None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:19.465232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad9962-604a-4095-9a04-0471deb2ecbe None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:19.465323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad9962-604a-4095-9a04-0471deb2ecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:19.481865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-71ad9962-604a-4095-9a04-0471deb2ecbe None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:39:19.483042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-71ad9962-604a-4095-9a04-0471deb2ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:39:19.537584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:19.548212 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 585/1179] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:39:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:39:19.571266 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d402a57-bdca-40e1-8ec8-4cbd702d841f None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:19.675116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d402a57-bdca-40e1-8ec8-4cbd702d841f None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:19.709186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634f916-c054-4794-9ee9-6135737cfe5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:19.709971 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634f916-c054-4794-9ee9-6135737cfe5a None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:19.710254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634f916-c054-4794-9ee9-6135737cfe5a None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:19.710527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634f916-c054-4794-9ee9-6135737cfe5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:19.720211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634f916-c054-4794-9ee9-6135737cfe5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:39:19.728235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-c634f916-c054-4794-9ee9-6135737cfe5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:39:19.728235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:39:19.728235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:39:19.728235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:39:19.728235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:39:19.728235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:39:19.728235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:39:19.728235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:39:19.728235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:39:19.728235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:39:19.728235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:39:19.728235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:39:19.728235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:39:19.728235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:39:19.728235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:39:19.728235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:39:19.729400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:39:19.729400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:39:19.729400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:39:19.729400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:39:19.729400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:39:19.729400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:39:19.729400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:39:19.729400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:39:19.729400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:39:19.729400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:39:19.729400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:39:19.729400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:39:19.729400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:39:19.729400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:39:19.729400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:39:19.729400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:39:19.730562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:39:19.730562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:39:19.730562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:39:19.730562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:39:19.730562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:39:19.730562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:39:19.730562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:39:19.730562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:39:19.730562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:39:19.730562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:39:19.730562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:39:19.730562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:39:19.730562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 595/1180] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:39:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:39:19.735519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad9962-604a-4095-9a04-0471deb2ecbe None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:19.829306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad9962-604a-4095-9a04-0471deb2ecbe None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:19.862051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4920b3e-d24e-4d44-ac4b-9274fedd70aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:19.862726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4920b3e-d24e-4d44-ac4b-9274fedd70aa None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:19.863011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4920b3e-d24e-4d44-ac4b-9274fedd70aa None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:19.863289 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4920b3e-d24e-4d44-ac4b-9274fedd70aa None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:19.864030 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4920b3e-d24e-4d44-ac4b-9274fedd70aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:39:19.864337 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4920b3e-d24e-4d44-ac4b-9274fedd70aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:19.865731 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4920b3e-d24e-4d44-ac4b-9274fedd70aa None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:19.873760 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 586/1181] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:39:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:19.879588 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634f916-c054-4794-9ee9-6135737cfe5a None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:19.909290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:19.976348 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634f916-c054-4794-9ee9-6135737cfe5a None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:20.008865 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4a90a-ae2b-4623-bfd8-f429c37127c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:20.009727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4a90a-ae2b-4623-bfd8-f429c37127c2 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:20.010014 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4a90a-ae2b-4623-bfd8-f429c37127c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:20.010291 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4a90a-ae2b-4623-bfd8-f429c37127c2 None admin] PATH_INFO: `/v3/users/6809e740c9e74caf9f90e7fbf0d8bf3d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:20.023475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4a90a-ae2b-4623-bfd8-f429c37127c2 None admin] RBAC: Authorizing `identity:get_user(user_id=6809e740c9e74caf9f90e7fbf0d8bf3d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:20.024964 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4a90a-ae2b-4623-bfd8-f429c37127c2 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:20.026672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 596/1182] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:39:19 2022] GET /identity/v3/users/6809e740c9e74caf9f90e7fbf0d8bf3d => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:20.038306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4920b3e-d24e-4d44-ac4b-9274fedd70aa None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:20.094426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:20.139455 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4920b3e-d24e-4d44-ac4b-9274fedd70aa None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:20.171521 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3b1e8-6033-48bf-962f-ff54747c15bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:20.172172 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3b1e8-6033-48bf-962f-ff54747c15bb None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:20.172485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3b1e8-6033-48bf-962f-ff54747c15bb None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:20.172772 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3b1e8-6033-48bf-962f-ff54747c15bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:20.237080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3b1e8-6033-48bf-962f-ff54747c15bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:20.238542 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3b1e8-6033-48bf-962f-ff54747c15bb None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:20.289776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:20.335999 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 587/1183] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:39:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:39:20.341998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4a90a-ae2b-4623-bfd8-f429c37127c2 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:20.448954 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:20.460642 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4a90a-ae2b-4623-bfd8-f429c37127c2 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:20.493896 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98167112-e913-4a14-915e-0dbbbed2e33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:20.494744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98167112-e913-4a14-915e-0dbbbed2e33a None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:20.495019 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98167112-e913-4a14-915e-0dbbbed2e33a None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:20.495289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98167112-e913-4a14-915e-0dbbbed2e33a None admin] PATH_INFO: `/v3/projects/a08fd6768e514972b567b9de4c4abaf3` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:20.496460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98167112-e913-4a14-915e-0dbbbed2e33a None admin] RBAC: Authorizing `identity:get_project(project_id=a08fd6768e514972b567b9de4c4abaf3)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:20.497937 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98167112-e913-4a14-915e-0dbbbed2e33a None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:20.499634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 597/1184] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:39:20 2022] GET /identity/v3/projects/a08fd6768e514972b567b9de4c4abaf3 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:20.506414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3b1e8-6033-48bf-962f-ff54747c15bb None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:20.600363 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3b1e8-6033-48bf-962f-ff54747c15bb None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:20.633385 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb979fd-72e7-414e-81d4-69d81d0cc802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:20.634034 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb979fd-72e7-414e-81d4-69d81d0cc802 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:20.634316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb979fd-72e7-414e-81d4-69d81d0cc802 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:20.634592 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb979fd-72e7-414e-81d4-69d81d0cc802 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:20.635416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb979fd-72e7-414e-81d4-69d81d0cc802 None admin] RBAC: Adding query filter params (role.id=416a52031d5d49b6a3fa0e9baa814436, scope.project.id=a08fd6768e514972b567b9de4c4abaf3, user.id=6809e740c9e74caf9f90e7fbf0d8bf3d) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:39:20.635731 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb979fd-72e7-414e-81d4-69d81d0cc802 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:20.637174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb979fd-72e7-414e-81d4-69d81d0cc802 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:20.642460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 588/1185] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:39:20 2022] GET /identity/v3/role_assignments?user.id=6809e740c9e74caf9f90e7fbf0d8bf3d&scope.project.id=a08fd6768e514972b567b9de4c4abaf3&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:22.726414 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c930b-9890-4487-81c0-56ae9be14b27 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:22.726941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c930b-9890-4487-81c0-56ae9be14b27 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:22.726941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c930b-9890-4487-81c0-56ae9be14b27 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:22.728253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 598/1186] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:39:22.733402 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d75a3d-695f-4342-82fa-29b13140d8b8 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:22.733795 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d75a3d-695f-4342-82fa-29b13140d8b8 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:22.733964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d75a3d-695f-4342-82fa-29b13140d8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:22.750728 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-03d75a3d-695f-4342-82fa-29b13140d8b8 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:39:22.751891 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-03d75a3d-695f-4342-82fa-29b13140d8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:39:22.762180 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:22.818007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 589/1187] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:39:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:39:22.840256 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c930b-9890-4487-81c0-56ae9be14b27 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:22.936918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c930b-9890-4487-81c0-56ae9be14b27 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:22.969695 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6faca3-b572-488b-b543-b3a9ff751cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:22.970483 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6faca3-b572-488b-b543-b3a9ff751cff None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:22.970771 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6faca3-b572-488b-b543-b3a9ff751cff None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:22.971050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6faca3-b572-488b-b543-b3a9ff751cff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:22.981534 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6faca3-b572-488b-b543-b3a9ff751cff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:39:22.989140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-9e6faca3-b572-488b-b543-b3a9ff751cff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:39:22.989140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:39:22.989140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:39:22.989140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:39:22.989140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:39:22.989140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:39:22.989140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:39:22.989140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:39:22.989140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:39:22.989140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:39:22.989140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:39:22.989140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:39:22.989140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:39:22.989140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:39:22.989140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:39:22.989140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:39:22.990244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:39:22.990244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:39:22.990244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:39:22.990244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:39:22.990244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:39:22.990244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:39:22.990244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:39:22.990244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:39:22.990244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:39:22.990244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:39:22.990244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:39:22.990244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:39:22.990244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:39:22.990244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:39:22.990244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:39:22.990244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:39:22.991304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:39:22.991304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:39:22.991304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:39:22.991304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:39:22.991304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:39:22.991304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:39:22.991304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:39:22.991304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:39:22.991304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:39:22.991304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:39:22.991304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:39:22.991304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:39:22.991304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 599/1188] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:39:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:39:22.996670 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d75a3d-695f-4342-82fa-29b13140d8b8 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:23.091743 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d75a3d-695f-4342-82fa-29b13140d8b8 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:23.123798 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ede1d-da06-4d65-b341-6ff935c367fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:23.124475 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ede1d-da06-4d65-b341-6ff935c367fc None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:23.124765 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ede1d-da06-4d65-b341-6ff935c367fc None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:23.125044 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ede1d-da06-4d65-b341-6ff935c367fc None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:23.125784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ede1d-da06-4d65-b341-6ff935c367fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:39:23.126091 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ede1d-da06-4d65-b341-6ff935c367fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:23.127453 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ede1d-da06-4d65-b341-6ff935c367fc None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:23.135780 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 590/1189] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:39:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:23.141472 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6faca3-b572-488b-b543-b3a9ff751cff None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:23.160102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:23.237231 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6faca3-b572-488b-b543-b3a9ff751cff None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:23.271123 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df33b19-0404-49e9-a0e1-2ab9fab165f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:23.271993 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df33b19-0404-49e9-a0e1-2ab9fab165f9 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:23.272277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df33b19-0404-49e9-a0e1-2ab9fab165f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:23.272585 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df33b19-0404-49e9-a0e1-2ab9fab165f9 None admin] PATH_INFO: `/v3/users/6809e740c9e74caf9f90e7fbf0d8bf3d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:23.273765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df33b19-0404-49e9-a0e1-2ab9fab165f9 None admin] RBAC: Authorizing `identity:get_user(user_id=6809e740c9e74caf9f90e7fbf0d8bf3d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:23.275207 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df33b19-0404-49e9-a0e1-2ab9fab165f9 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:23.276878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 600/1190] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:39:23 2022] GET /identity/v3/users/6809e740c9e74caf9f90e7fbf0d8bf3d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:23.282504 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ede1d-da06-4d65-b341-6ff935c367fc None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:23.293589 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:23.377911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ede1d-da06-4d65-b341-6ff935c367fc None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:23.410639 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077195d-4ca4-40bd-92f0-6947b9db3bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:23.411486 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077195d-4ca4-40bd-92f0-6947b9db3bcb None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:23.411768 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077195d-4ca4-40bd-92f0-6947b9db3bcb None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:23.412042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077195d-4ca4-40bd-92f0-6947b9db3bcb None admin] PATH_INFO: `/v3/projects/a08fd6768e514972b567b9de4c4abaf3` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:23.413234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077195d-4ca4-40bd-92f0-6947b9db3bcb None admin] RBAC: Authorizing `identity:get_project(project_id=a08fd6768e514972b567b9de4c4abaf3)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:23.414657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077195d-4ca4-40bd-92f0-6947b9db3bcb None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:23.416344 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 591/1191] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:39:23 2022] GET /identity/v3/projects/a08fd6768e514972b567b9de4c4abaf3 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:23.422384 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df33b19-0404-49e9-a0e1-2ab9fab165f9 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:23.504974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:23.519974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df33b19-0404-49e9-a0e1-2ab9fab165f9 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:23.553019 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eadc76-af2b-4cc4-8a03-d87341d40e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:23.553903 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eadc76-af2b-4cc4-8a03-d87341d40e17 None admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:23.554192 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eadc76-af2b-4cc4-8a03-d87341d40e17 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:23.554474 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eadc76-af2b-4cc4-8a03-d87341d40e17 None admin] PATH_INFO: `/v3/projects/a08fd6768e514972b567b9de4c4abaf3/users/6809e740c9e74caf9f90e7fbf0d8bf3d/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:23.556430 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eadc76-af2b-4cc4-8a03-d87341d40e17 None admin] RBAC: Authorizing `identity:create_grant(project_id=a08fd6768e514972b567b9de4c4abaf3, user_id=6809e740c9e74caf9f90e7fbf0d8bf3d, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:23.557892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eadc76-af2b-4cc4-8a03-d87341d40e17 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:23.666414 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 601/1192] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:39:23 2022] PUT /identity/v3/projects/a08fd6768e514972b567b9de4c4abaf3/users/6809e740c9e74caf9f90e7fbf0d8bf3d/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:39:25.763074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cde45-2905-457e-945c-eab40dca0c49 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:25.763617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cde45-2905-457e-945c-eab40dca0c49 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:25.763617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cde45-2905-457e-945c-eab40dca0c49 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:25.765048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 592/1193] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:39:25.770502 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc835e3d-a568-4b5d-be78-e6f3a938b06c None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:25.770916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc835e3d-a568-4b5d-be78-e6f3a938b06c None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:25.771071 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc835e3d-a568-4b5d-be78-e6f3a938b06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:25.788041 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-fc835e3d-a568-4b5d-be78-e6f3a938b06c None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:39:25.789410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-fc835e3d-a568-4b5d-be78-e6f3a938b06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:39:25.852481 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 602/1194] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:39:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:39:25.875619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cde45-2905-457e-945c-eab40dca0c49 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:25.951716 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:25.973972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cde45-2905-457e-945c-eab40dca0c49 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:26.006845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05719a-3406-49df-b590-0a3e5756b4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:26.007625 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05719a-3406-49df-b590-0a3e5756b4e5 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:26.007910 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05719a-3406-49df-b590-0a3e5756b4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:26.008187 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05719a-3406-49df-b590-0a3e5756b4e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:26.018032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05719a-3406-49df-b590-0a3e5756b4e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:39:26.025577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-8a05719a-3406-49df-b590-0a3e5756b4e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:39:26.025577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:39:26.025577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:39:26.025577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:39:26.025577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:39:26.025577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:39:26.025577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:39:26.025577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:39:26.025577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:39:26.025577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:39:26.025577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:39:26.025577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:39:26.025577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:39:26.025577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:39:26.025577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:39:26.025577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:39:26.026651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:39:26.026651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:39:26.026651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:39:26.026651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:39:26.026651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:39:26.026651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:39:26.026651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:39:26.026651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:39:26.026651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:39:26.026651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:39:26.026651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:39:26.026651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:39:26.026651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:39:26.026651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:39:26.026651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:39:26.026651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:39:26.027514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:39:26.027514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:39:26.027514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:39:26.027514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:39:26.027514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:39:26.027514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:39:26.027514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:39:26.027514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:39:26.027514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:39:26.027514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:39:26.027514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:39:26.027514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:39:26.027514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 593/1195] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:39:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:39:26.032684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc835e3d-a568-4b5d-be78-e6f3a938b06c None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:26.104124 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:26.128661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc835e3d-a568-4b5d-be78-e6f3a938b06c None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:26.160813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e494544-655e-45d3-8ca0-9f9c2c789fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:26.161962 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e494544-655e-45d3-8ca0-9f9c2c789fc6 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:26.162247 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e494544-655e-45d3-8ca0-9f9c2c789fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:26.162527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e494544-655e-45d3-8ca0-9f9c2c789fc6 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:26.163269 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e494544-655e-45d3-8ca0-9f9c2c789fc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:39:26.163579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e494544-655e-45d3-8ca0-9f9c2c789fc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:26.164997 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e494544-655e-45d3-8ca0-9f9c2c789fc6 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:26.173402 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 603/1196] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:39:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:26.179157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05719a-3406-49df-b590-0a3e5756b4e5 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:26.275499 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05719a-3406-49df-b590-0a3e5756b4e5 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:26.308493 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd258e-df23-4e1e-9249-7872e3e25869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:26.309356 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd258e-df23-4e1e-9249-7872e3e25869 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:26.309670 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd258e-df23-4e1e-9249-7872e3e25869 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:26.309945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd258e-df23-4e1e-9249-7872e3e25869 None admin] PATH_INFO: `/v3/users/6809e740c9e74caf9f90e7fbf0d8bf3d` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:26.311132 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd258e-df23-4e1e-9249-7872e3e25869 None admin] RBAC: Authorizing `identity:get_user(user_id=6809e740c9e74caf9f90e7fbf0d8bf3d)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:26.312594 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd258e-df23-4e1e-9249-7872e3e25869 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:26.314214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 594/1197] 10.222.0.93 () {56 vars in 1177 bytes} [Thu Jun 16 18:39:26 2022] GET /identity/v3/users/6809e740c9e74caf9f90e7fbf0d8bf3d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:26.319995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e494544-655e-45d3-8ca0-9f9c2c789fc6 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:26.415553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e494544-655e-45d3-8ca0-9f9c2c789fc6 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:26.448762 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfff11-d918-4f5c-8b43-8cfd72f49e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:26.449431 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfff11-d918-4f5c-8b43-8cfd72f49e59 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:26.449714 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfff11-d918-4f5c-8b43-8cfd72f49e59 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:26.449985 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfff11-d918-4f5c-8b43-8cfd72f49e59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:26.453431 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:26.515471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfff11-d918-4f5c-8b43-8cfd72f49e59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:26.516954 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfff11-d918-4f5c-8b43-8cfd72f49e59 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:26.615111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 604/1198] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:39:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:39:26.621235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd258e-df23-4e1e-9249-7872e3e25869 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:26.624961 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:26.716908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd258e-df23-4e1e-9249-7872e3e25869 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:26.749190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9af2d3-9e02-405d-9494-64a038d8ba7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:26.750039 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9af2d3-9e02-405d-9494-64a038d8ba7f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:26.750321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9af2d3-9e02-405d-9494-64a038d8ba7f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:26.750609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9af2d3-9e02-405d-9494-64a038d8ba7f None admin] PATH_INFO: `/v3/projects/a08fd6768e514972b567b9de4c4abaf3` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:26.751763 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9af2d3-9e02-405d-9494-64a038d8ba7f None admin] RBAC: Authorizing `identity:get_project(project_id=a08fd6768e514972b567b9de4c4abaf3)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:26.753217 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9af2d3-9e02-405d-9494-64a038d8ba7f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:26.755011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 595/1199] 10.222.0.93 () {56 vars in 1186 bytes} [Thu Jun 16 18:39:26 2022] GET /identity/v3/projects/a08fd6768e514972b567b9de4c4abaf3 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:26.761086 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfff11-d918-4f5c-8b43-8cfd72f49e59 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:26.798202 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:26.862508 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfff11-d918-4f5c-8b43-8cfd72f49e59 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:26.894914 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc324218-9c32-458e-ae9b-48e41b06a829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:26.895549 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324218-9c32-458e-ae9b-48e41b06a829 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:26.896327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324218-9c32-458e-ae9b-48e41b06a829 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:26.896628 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324218-9c32-458e-ae9b-48e41b06a829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:26.897613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc324218-9c32-458e-ae9b-48e41b06a829 None admin] RBAC: Adding query filter params (role.id=416a52031d5d49b6a3fa0e9baa814436, scope.project.id=a08fd6768e514972b567b9de4c4abaf3, user.id=6809e740c9e74caf9f90e7fbf0d8bf3d) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:39:26.897928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc324218-9c32-458e-ae9b-48e41b06a829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:26.899347 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc324218-9c32-458e-ae9b-48e41b06a829 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:26.904989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 605/1200] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:39:26 2022] GET /identity/v3/role_assignments?user.id=6809e740c9e74caf9f90e7fbf0d8bf3d&scope.project.id=a08fd6768e514972b567b9de4c4abaf3&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:36.744973 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=64 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:36.902399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=50 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:46.171196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c5259-0a93-412f-b9fc-2e8433a55580 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:46.171826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c5259-0a93-412f-b9fc-2e8433a55580 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:46.171826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c5259-0a93-412f-b9fc-2e8433a55580 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:46.173220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 596/1201] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:40:46.178170 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e92158-fe84-48d2-a659-1e1b33b4dceb None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:46.178597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e92158-fe84-48d2-a659-1e1b33b4dceb None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:46.178725 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e92158-fe84-48d2-a659-1e1b33b4dceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:46.196528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-05e92158-fe84-48d2-a659-1e1b33b4dceb None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:40:46.197757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-05e92158-fe84-48d2-a659-1e1b33b4dceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:40:46.263080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 606/1202] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:40:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:40:46.289066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c5259-0a93-412f-b9fc-2e8433a55580 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:46.391931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c5259-0a93-412f-b9fc-2e8433a55580 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:46.425085 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063682b-d068-4a4f-ab09-3cc4a3e77f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:46.425807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063682b-d068-4a4f-ab09-3cc4a3e77f21 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:46.426085 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063682b-d068-4a4f-ab09-3cc4a3e77f21 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:46.426357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063682b-d068-4a4f-ab09-3cc4a3e77f21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:46.437668 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063682b-d068-4a4f-ab09-3cc4a3e77f21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:46.439117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063682b-d068-4a4f-ab09-3cc4a3e77f21 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:46.456074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-c063682b-d068-4a4f-ab09-3cc4a3e77f21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:46.456074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:46.456074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:46.456074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:46.456074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:46.456074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:46.456074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:46.456074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:46.456074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:46.456074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:46.456074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:46.456074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:46.456074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:46.456074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:46.456074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:46.457408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:46.457408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:46.457408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:46.457408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:46.457408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:46.457408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:46.457408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:46.457408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:46.457408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:46.457408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:46.457408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:46.457408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:46.457408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:46.457408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:46.457408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:46.457408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:46.457408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:46.458627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:46.458627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:46.458627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:46.458627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:40:46.458627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 597/1203] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:46.464279 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e92158-fe84-48d2-a659-1e1b33b4dceb None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:46.566285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e92158-fe84-48d2-a659-1e1b33b4dceb None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:46.594072 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:46.599774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627eb4cb-89f3-42db-af5d-00162e86c7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:46.600458 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627eb4cb-89f3-42db-af5d-00162e86c7cf None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:46.600767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627eb4cb-89f3-42db-af5d-00162e86c7cf None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:46.601045 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627eb4cb-89f3-42db-af5d-00162e86c7cf None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:46.601847 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627eb4cb-89f3-42db-af5d-00162e86c7cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:46.602157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627eb4cb-89f3-42db-af5d-00162e86c7cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:46.603545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627eb4cb-89f3-42db-af5d-00162e86c7cf None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:46.615093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 607/1204] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:46.621124 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063682b-d068-4a4f-ab09-3cc4a3e77f21 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:46.673185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:46.718363 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063682b-d068-4a4f-ab09-3cc4a3e77f21 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:46.750807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564b9b5-fea4-4082-b330-0a14fb89b31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:46.758161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564b9b5-fea4-4082-b330-0a14fb89b31f None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:46.758161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564b9b5-fea4-4082-b330-0a14fb89b31f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:46.758161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564b9b5-fea4-4082-b330-0a14fb89b31f None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:46.758161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564b9b5-fea4-4082-b330-0a14fb89b31f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:46.758161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564b9b5-fea4-4082-b330-0a14fb89b31f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:46.914762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 598/1205] 10.222.0.93 () {60 vars in 1132 bytes} [Thu Jun 16 18:40:46 2022] POST /identity/v3/users => generated 251 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:40:49.103269 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3413f-4e35-4112-a2f1-f700b990f003 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:49.104482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3413f-4e35-4112-a2f1-f700b990f003 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:49.104482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3413f-4e35-4112-a2f1-f700b990f003 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:49.105985 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 608/1206] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:40:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:40:49.113655 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60858f86-6815-4872-a9b5-bf73a5762854 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:49.122676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60858f86-6815-4872-a9b5-bf73a5762854 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:49.122676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60858f86-6815-4872-a9b5-bf73a5762854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:49.134306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-60858f86-6815-4872-a9b5-bf73a5762854 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:40:49.135522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-60858f86-6815-4872-a9b5-bf73a5762854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:40:49.202003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 599/1207] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:40:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:40:49.225261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3413f-4e35-4112-a2f1-f700b990f003 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:49.326773 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3413f-4e35-4112-a2f1-f700b990f003 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:49.359394 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da719e3-b99b-46fe-aff5-91965dabf84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:49.360126 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da719e3-b99b-46fe-aff5-91965dabf84a None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:49.360407 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da719e3-b99b-46fe-aff5-91965dabf84a None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:49.360709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da719e3-b99b-46fe-aff5-91965dabf84a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:49.370971 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da719e3-b99b-46fe-aff5-91965dabf84a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:40:49.379032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-6da719e3-b99b-46fe-aff5-91965dabf84a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:40:49.379032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:49.379032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:49.379032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:49.379032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:49.379032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:49.379032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:49.379032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:49.379032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:49.379032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:49.379032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:49.379032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:49.379032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:40:49.379032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:40:49.379032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:40:49.379032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:40:49.380185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:40:49.380185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:40:49.380185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:40:49.380185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:40:49.380185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:49.380185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:49.380185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:49.380185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:49.380185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:49.380185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:49.380185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:49.380185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:49.380185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:49.380185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:49.380185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:49.380185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:49.381278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:49.381278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:49.381278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:49.381278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:49.381278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:40:49.381278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:40:49.381278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:40:49.381278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:40:49.381278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:40:49.381278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:40:49.381278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:40:49.381278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:40:49.381278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 609/1208] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:40:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:49.386333 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60858f86-6815-4872-a9b5-bf73a5762854 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:49.425043 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:49.488020 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60858f86-6815-4872-a9b5-bf73a5762854 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:49.521058 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcd1f2-66bd-45fb-9b07-f1fc12b47b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:49.521737 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcd1f2-66bd-45fb-9b07-f1fc12b47b8c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:49.522023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcd1f2-66bd-45fb-9b07-f1fc12b47b8c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:49.522301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcd1f2-66bd-45fb-9b07-f1fc12b47b8c None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:49.523057 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcd1f2-66bd-45fb-9b07-f1fc12b47b8c None admin] RBAC: Adding query filter params (name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:49.523369 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcd1f2-66bd-45fb-9b07-f1fc12b47b8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:49.524778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcd1f2-66bd-45fb-9b07-f1fc12b47b8c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:49.533937 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 600/1209] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:40:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:49.539685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da719e3-b99b-46fe-aff5-91965dabf84a None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:49.588942 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:49.636541 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da719e3-b99b-46fe-aff5-91965dabf84a None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:49.669011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336bc42-0e0f-4c2f-928c-26c97d7967bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:49.669803 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336bc42-0e0f-4c2f-928c-26c97d7967bf None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:49.670087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336bc42-0e0f-4c2f-928c-26c97d7967bf None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:49.670361 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336bc42-0e0f-4c2f-928c-26c97d7967bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:49.680683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336bc42-0e0f-4c2f-928c-26c97d7967bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:49.682201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336bc42-0e0f-4c2f-928c-26c97d7967bf None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:49.698655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-9336bc42-0e0f-4c2f-928c-26c97d7967bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:49.698655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:49.698655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:49.698655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:49.698655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:49.698655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:49.698655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:49.698655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:49.698655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:49.698655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:49.698655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:49.698655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:49.698655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:49.698655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:49.698655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:49.701986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:49.701986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:49.701986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:49.701986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:49.701986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:49.701986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:49.701986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:49.701986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:49.701986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:49.701986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:49.701986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:49.701986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:49.701986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:49.701986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:49.701986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:49.701986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:49.701986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:49.703138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:49.703138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:49.703138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:49.703138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:40:49.703138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 610/1210] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:49.705881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcd1f2-66bd-45fb-9b07-f1fc12b47b8c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:49.804592 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:49.807569 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcd1f2-66bd-45fb-9b07-f1fc12b47b8c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:49.840115 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b51c0a-bf31-4ceb-b5a1-92a1df89a53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:49.840828 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b51c0a-bf31-4ceb-b5a1-92a1df89a53e None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:49.841142 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b51c0a-bf31-4ceb-b5a1-92a1df89a53e None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:49.841420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b51c0a-bf31-4ceb-b5a1-92a1df89a53e None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:49.842140 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b51c0a-bf31-4ceb-b5a1-92a1df89a53e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:49.842449 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b51c0a-bf31-4ceb-b5a1-92a1df89a53e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:49.843870 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b51c0a-bf31-4ceb-b5a1-92a1df89a53e None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:49.855353 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 601/1211] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:49.861300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336bc42-0e0f-4c2f-928c-26c97d7967bf None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:49.957833 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336bc42-0e0f-4c2f-928c-26c97d7967bf None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:49.959252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:49.991175 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8f4cf-6f0f-4a5c-bb80-9002f523b3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:49.991964 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8f4cf-6f0f-4a5c-bb80-9002f523b3f9 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:49.992242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8f4cf-6f0f-4a5c-bb80-9002f523b3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:49.992542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8f4cf-6f0f-4a5c-bb80-9002f523b3f9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:49.999194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8f4cf-6f0f-4a5c-bb80-9002f523b3f9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:50.000648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8f4cf-6f0f-4a5c-bb80-9002f523b3f9 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:50.015399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-48e8f4cf-6f0f-4a5c-bb80-9002f523b3f9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:40:50.015399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:50.015399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:50.015399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:50.015399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:50.015399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:50.015399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:50.015399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:50.015399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:50.015399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:50.015399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:50.015399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:50.015399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:40:50.015399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:40:50.015399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:40:50.015399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:40:50.016566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:50.016566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:50.016566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:40:50.016566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:40:50.016566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:40:50.016566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:40:50.016566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:50.016566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:50.016566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:50.016566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:50.016566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:50.016566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:50.016566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:50.016566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:50.016566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:50.016566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:50.016566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:50.016566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:50.017772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:50.017772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:50.017772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:40:50.017772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:40:50.017772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:40:50.017772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:40:50.017772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:40:50.017772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:40:50.017772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:40:50.017772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:40:50.017772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 611/1212] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:50.022599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b51c0a-bf31-4ceb-b5a1-92a1df89a53e None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:50.118304 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b51c0a-bf31-4ceb-b5a1-92a1df89a53e None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:50.151878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3369d59-078f-4f99-a2cf-bca29ef7d490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:50.152567 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3369d59-078f-4f99-a2cf-bca29ef7d490 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:50.152855 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3369d59-078f-4f99-a2cf-bca29ef7d490 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:50.153131 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3369d59-078f-4f99-a2cf-bca29ef7d490 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:50.153958 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3369d59-078f-4f99-a2cf-bca29ef7d490 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:50.154269 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3369d59-078f-4f99-a2cf-bca29ef7d490 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:50.155684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3369d59-078f-4f99-a2cf-bca29ef7d490 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:50.172768 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 602/1213] 10.222.0.93 () {56 vars in 1143 bytes} [Thu Jun 16 18:40:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:50.178596 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8f4cf-6f0f-4a5c-bb80-9002f523b3f9 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:50.276455 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8f4cf-6f0f-4a5c-bb80-9002f523b3f9 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:50.310479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8ac08-867e-4a42-9bd4-69a786d98528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:50.311133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8ac08-867e-4a42-9bd4-69a786d98528 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:50.311419 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8ac08-867e-4a42-9bd4-69a786d98528 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:50.311693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8ac08-867e-4a42-9bd4-69a786d98528 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:50.340511 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:50.376771 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8ac08-867e-4a42-9bd4-69a786d98528 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:50.378291 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8ac08-867e-4a42-9bd4-69a786d98528 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:50.472330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 612/1214] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:40:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:40:50.478126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3369d59-078f-4f99-a2cf-bca29ef7d490 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:50.497605 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:50.575820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3369d59-078f-4f99-a2cf-bca29ef7d490 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:50.608988 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2b4a5-9b2e-49b6-9ab7-0f86e30ac03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:50.609774 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2b4a5-9b2e-49b6-9ab7-0f86e30ac03c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:50.610060 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2b4a5-9b2e-49b6-9ab7-0f86e30ac03c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:50.610339 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2b4a5-9b2e-49b6-9ab7-0f86e30ac03c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:50.622216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2b4a5-9b2e-49b6-9ab7-0f86e30ac03c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:50.623654 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2b4a5-9b2e-49b6-9ab7-0f86e30ac03c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:50.641571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-1bb2b4a5-9b2e-49b6-9ab7-0f86e30ac03c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:50.641571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:50.641571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:50.641571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:50.641571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:50.641571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:50.641571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:50.641571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:50.641571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:50.641571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:50.641571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:50.641571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:50.641571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:50.641571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:50.641571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:50.642667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:50.642667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:50.642667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:50.642667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:50.642667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:50.642667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:50.642667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:50.642667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:50.642667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:50.642667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:50.642667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:50.642667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:50.642667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:50.642667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:50.642667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:50.642667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:50.642667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:50.643986 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:50.643986 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:50.643986 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:50.643986 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:40:50.643986 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 603/1215] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:50.648627 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8ac08-867e-4a42-9bd4-69a786d98528 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:50.708854 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:50.748019 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8ac08-867e-4a42-9bd4-69a786d98528 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:50.781534 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d141259-a10c-42e0-bdee-56bf84553df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:50.782196 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d141259-a10c-42e0-bdee-56bf84553df2 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:50.782479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d141259-a10c-42e0-bdee-56bf84553df2 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:50.782755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d141259-a10c-42e0-bdee-56bf84553df2 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:50.783472 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d141259-a10c-42e0-bdee-56bf84553df2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:50.783778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d141259-a10c-42e0-bdee-56bf84553df2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:50.785178 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d141259-a10c-42e0-bdee-56bf84553df2 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:50.797472 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 613/1216] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:50.803118 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2b4a5-9b2e-49b6-9ab7-0f86e30ac03c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:50.871765 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:50.901512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2b4a5-9b2e-49b6-9ab7-0f86e30ac03c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:50.934199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebdb43-f11b-487f-8a95-4a97daeaf223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:50.935013 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebdb43-f11b-487f-8a95-4a97daeaf223 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:50.935299 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebdb43-f11b-487f-8a95-4a97daeaf223 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:50.935575 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebdb43-f11b-487f-8a95-4a97daeaf223 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:50.942112 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebdb43-f11b-487f-8a95-4a97daeaf223 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:50.943550 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebdb43-f11b-487f-8a95-4a97daeaf223 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:50.957881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-d0ebdb43-f11b-487f-8a95-4a97daeaf223 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:40:50.957881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:50.957881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:50.957881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:50.957881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:50.957881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:50.957881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:50.957881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:50.957881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:50.957881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:50.957881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:50.957881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:50.957881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:40:50.957881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:40:50.957881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:40:50.959335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:40:50.959335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:50.959335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:50.959335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:50.959335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:50.959335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:50.959335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:50.959335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:50.959335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:50.959335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:50.959335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:50.959335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:50.959335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:50.959335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:50.959335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:50.959335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:50.959335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:50.960403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:40:50.960403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:40:50.960403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:40:50.960403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:40:50.960403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:40:50.960403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:40:50.960403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:40:50.960403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:40:50.960403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 604/1217] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:40:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:50.965447 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d141259-a10c-42e0-bdee-56bf84553df2 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:51.062934 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d141259-a10c-42e0-bdee-56bf84553df2 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:51.085194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:51.096912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda14d3-6c11-4f57-8a08-5f08ead3ef41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:51.097577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda14d3-6c11-4f57-8a08-5f08ead3ef41 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:51.097862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda14d3-6c11-4f57-8a08-5f08ead3ef41 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:51.098136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda14d3-6c11-4f57-8a08-5f08ead3ef41 None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:51.098919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda14d3-6c11-4f57-8a08-5f08ead3ef41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:51.099230 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda14d3-6c11-4f57-8a08-5f08ead3ef41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:51.100710 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda14d3-6c11-4f57-8a08-5f08ead3ef41 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:51.112712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 614/1218] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:40:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:51.118742 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebdb43-f11b-487f-8a95-4a97daeaf223 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:51.216703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebdb43-f11b-487f-8a95-4a97daeaf223 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:51.244976 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:51.250598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143aab9-a44c-4432-97fc-19fb9c4303f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:51.251517 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143aab9-a44c-4432-97fc-19fb9c4303f4 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:51.251803 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143aab9-a44c-4432-97fc-19fb9c4303f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:51.252083 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143aab9-a44c-4432-97fc-19fb9c4303f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:51.252953 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143aab9-a44c-4432-97fc-19fb9c4303f4 None admin] RBAC: Adding query filter params (role.id=06f67743387f476cade2623aa7e5c5d2, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=3abe1d47a1164776bf3a82fe4b129d9d) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:51.253270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143aab9-a44c-4432-97fc-19fb9c4303f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:51.254704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143aab9-a44c-4432-97fc-19fb9c4303f4 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:51.260257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 605/1219] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:40:51 2022] GET /identity/v3/role_assignments?user.id=3abe1d47a1164776bf3a82fe4b129d9d&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=06f67743387f476cade2623aa7e5c5d2 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:53.340231 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2362ba3-ce78-4d5c-b79c-f88a5885574f None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:53.340870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2362ba3-ce78-4d5c-b79c-f88a5885574f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:53.340870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2362ba3-ce78-4d5c-b79c-f88a5885574f None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:53.342166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 615/1220] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:40:53.347219 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e82a1b-5b96-4e0b-930c-1e987f97cc41 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:53.347625 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e82a1b-5b96-4e0b-930c-1e987f97cc41 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:53.349930 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e82a1b-5b96-4e0b-930c-1e987f97cc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:53.364682 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-e0e82a1b-5b96-4e0b-930c-1e987f97cc41 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:40:53.365853 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e0e82a1b-5b96-4e0b-930c-1e987f97cc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:40:53.430048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 606/1221] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:40:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:40:53.453232 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2362ba3-ce78-4d5c-b79c-f88a5885574f None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:53.604134 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2362ba3-ce78-4d5c-b79c-f88a5885574f None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:53.637589 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e42fa-4086-4182-989d-6c008bd60fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:53.638466 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e42fa-4086-4182-989d-6c008bd60fbb None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:53.638758 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e42fa-4086-4182-989d-6c008bd60fbb None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:53.639039 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e42fa-4086-4182-989d-6c008bd60fbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:53.649844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e42fa-4086-4182-989d-6c008bd60fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:40:53.657614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-dd0e42fa-4086-4182-989d-6c008bd60fbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:40:53.657614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:53.657614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:53.657614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:53.657614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:53.657614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:53.657614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:53.657614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:53.657614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:53.657614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:53.657614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:53.657614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:53.657614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:40:53.657614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:40:53.657614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:40:53.657614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:40:53.658755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:40:53.658755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:40:53.658755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:40:53.658755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:40:53.658755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:53.658755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:53.658755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:53.658755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:53.658755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:53.658755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:53.658755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:53.658755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:53.658755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:53.658755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:53.658755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:53.658755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:53.659656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:53.659656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:53.659656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:53.659656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:53.659656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:40:53.659656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:40:53.659656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:40:53.659656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:40:53.659656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:40:53.659656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:40:53.659656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:40:53.659656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:40:53.659656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 616/1222] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:40:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:53.665009 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e82a1b-5b96-4e0b-930c-1e987f97cc41 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:53.760235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e82a1b-5b96-4e0b-930c-1e987f97cc41 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:53.782118 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:53.792740 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae96ec2-46c0-4601-8f55-0e221ff11faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:53.793401 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae96ec2-46c0-4601-8f55-0e221ff11faf None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:53.793682 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae96ec2-46c0-4601-8f55-0e221ff11faf None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:53.793955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae96ec2-46c0-4601-8f55-0e221ff11faf None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:53.794691 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae96ec2-46c0-4601-8f55-0e221ff11faf None admin] RBAC: Adding query filter params (name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:53.794996 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae96ec2-46c0-4601-8f55-0e221ff11faf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:53.796348 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae96ec2-46c0-4601-8f55-0e221ff11faf None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:53.804007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 607/1223] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:40:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:40:53.810349 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e42fa-4086-4182-989d-6c008bd60fbb None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:53.856705 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:53.912173 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e42fa-4086-4182-989d-6c008bd60fbb None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:53.945056 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe7041-d6bd-4756-a2a8-e9acd3e3b73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:53.945846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe7041-d6bd-4756-a2a8-e9acd3e3b73f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:53.946127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe7041-d6bd-4756-a2a8-e9acd3e3b73f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:53.946398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe7041-d6bd-4756-a2a8-e9acd3e3b73f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:53.956776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe7041-d6bd-4756-a2a8-e9acd3e3b73f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:53.960318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe7041-d6bd-4756-a2a8-e9acd3e3b73f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:53.975061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-b5fe7041-d6bd-4756-a2a8-e9acd3e3b73f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:53.975061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:53.975061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:53.975061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:53.975061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:53.975061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:53.975061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:53.975061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:53.975061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:53.975061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:53.975061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:53.975061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:53.975061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:53.975061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:53.975061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:53.976128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:53.976128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:53.976128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:53.976128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:53.976128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:53.976128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:53.976128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:53.976128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:53.976128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:53.976128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:53.976128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:53.976128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:53.976128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:53.976128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:53.976128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:53.976128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:53.976128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:53.977278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:53.977278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:53.977278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:53.977278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:40:53.977278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 617/1224] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:40:53.984232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae96ec2-46c0-4601-8f55-0e221ff11faf None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:54.081538 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae96ec2-46c0-4601-8f55-0e221ff11faf None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:54.114861 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2adc22-f712-424d-ad5c-8c5d0615eb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:54.115456 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2adc22-f712-424d-ad5c-8c5d0615eb0c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:54.115743 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2adc22-f712-424d-ad5c-8c5d0615eb0c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:54.116022 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2adc22-f712-424d-ad5c-8c5d0615eb0c None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:54.116771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2adc22-f712-424d-ad5c-8c5d0615eb0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:54.117082 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2adc22-f712-424d-ad5c-8c5d0615eb0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:54.118466 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2adc22-f712-424d-ad5c-8c5d0615eb0c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:54.130269 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 608/1225] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:54.136133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe7041-d6bd-4756-a2a8-e9acd3e3b73f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:54.227265 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:54.234198 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe7041-d6bd-4756-a2a8-e9acd3e3b73f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:54.266223 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26d6e8-126e-4c53-b8f8-f93412280ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:54.267028 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26d6e8-126e-4c53-b8f8-f93412280ad9 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:54.267310 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26d6e8-126e-4c53-b8f8-f93412280ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:54.267609 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26d6e8-126e-4c53-b8f8-f93412280ad9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:54.295500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26d6e8-126e-4c53-b8f8-f93412280ad9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:54.295500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26d6e8-126e-4c53-b8f8-f93412280ad9 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:54.295500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-cd26d6e8-126e-4c53-b8f8-f93412280ad9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:40:54.295500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:54.295500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:54.295500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:54.295500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:54.295500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:54.295500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:54.295500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:54.295500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:54.295500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:54.296362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:54.296362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:54.296362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:40:54.296362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:40:54.296362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:40:54.296362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:40:54.296362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:54.296362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:54.296362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:40:54.296362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:40:54.296362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:40:54.296362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:40:54.296362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:54.296362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:54.296362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:54.296362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:54.296362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:54.296362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:54.297517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:54.297517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:54.297517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:54.297517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:54.297517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:54.297517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:54.297517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:54.297517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:54.297517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:40:54.297517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:40:54.297517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:40:54.297517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:40:54.297517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:40:54.297517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:40:54.297517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:40:54.297517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:40:54.297517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 618/1226] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:54.298735 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2adc22-f712-424d-ad5c-8c5d0615eb0c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:54.345396 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:54.397183 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2adc22-f712-424d-ad5c-8c5d0615eb0c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:54.430373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d2202-9e42-449e-93c3-f683b80192c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:54.431046 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d2202-9e42-449e-93c3-f683b80192c8 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:54.431337 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d2202-9e42-449e-93c3-f683b80192c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:54.431617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d2202-9e42-449e-93c3-f683b80192c8 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:54.432463 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d2202-9e42-449e-93c3-f683b80192c8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:54.432792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d2202-9e42-449e-93c3-f683b80192c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:54.436867 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d2202-9e42-449e-93c3-f683b80192c8 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:54.451135 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 609/1227] 10.222.0.93 () {56 vars in 1143 bytes} [Thu Jun 16 18:40:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:54.456782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26d6e8-126e-4c53-b8f8-f93412280ad9 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:54.554086 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26d6e8-126e-4c53-b8f8-f93412280ad9 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:54.587823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0908ad-94ff-46ba-9ed4-152642ec8fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:54.588649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0908ad-94ff-46ba-9ed4-152642ec8fd3 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:54.597225 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0908ad-94ff-46ba-9ed4-152642ec8fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:54.597225 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0908ad-94ff-46ba-9ed4-152642ec8fd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:54.599216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0908ad-94ff-46ba-9ed4-152642ec8fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:54.600693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0908ad-94ff-46ba-9ed4-152642ec8fd3 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:54.619995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-6d0908ad-94ff-46ba-9ed4-152642ec8fd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:54.619995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:54.619995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:54.619995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:54.619995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:54.619995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:54.619995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:54.619995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:54.619995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:54.619995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:54.619995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:54.619995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:54.619995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:54.619995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:54.619995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:54.621155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:54.621155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:54.621155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:54.621155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:54.621155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:54.621155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:54.621155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:54.621155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:54.621155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:54.621155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:54.621155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:54.621155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:54.621155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:54.621155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:54.621155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:54.621155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:54.621155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:54.622714 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:54.622714 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:54.622714 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:54.622714 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:40:54.622714 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 619/1228] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:54.629445 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d2202-9e42-449e-93c3-f683b80192c8 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:54.727954 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d2202-9e42-449e-93c3-f683b80192c8 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:54.730896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:54.767947 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6379143-5e6c-4266-9762-b60802747894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:54.768644 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6379143-5e6c-4266-9762-b60802747894 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:54.768928 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6379143-5e6c-4266-9762-b60802747894 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:54.769203 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6379143-5e6c-4266-9762-b60802747894 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:54.770669 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6379143-5e6c-4266-9762-b60802747894 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:54.770993 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6379143-5e6c-4266-9762-b60802747894 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:54.772526 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6379143-5e6c-4266-9762-b60802747894 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:54.784777 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 610/1229] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:54.792875 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0908ad-94ff-46ba-9ed4-152642ec8fd3 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:54.802524 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:54.895855 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0908ad-94ff-46ba-9ed4-152642ec8fd3 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:54.929909 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07981859-40a4-4351-a592-320229da0970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:54.930702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07981859-40a4-4351-a592-320229da0970 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:54.930987 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07981859-40a4-4351-a592-320229da0970 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:54.931284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07981859-40a4-4351-a592-320229da0970 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:54.937774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07981859-40a4-4351-a592-320229da0970 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:54.939233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07981859-40a4-4351-a592-320229da0970 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:54.953424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-07981859-40a4-4351-a592-320229da0970 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:40:54.953424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:54.953424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:54.953424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:54.953424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:54.953424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:54.953424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:54.953424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:54.953424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:54.953424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:54.953424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:54.953424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:54.953424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:40:54.953424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:40:54.953424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:40:54.957911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:40:54.957911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:54.957911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:54.957911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:54.957911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:54.957911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:54.957911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:54.957911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:54.957911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:54.957911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:54.957911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:54.957911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:54.957911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:54.957911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:54.957911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:54.957911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:54.957911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:54.959038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:40:54.959038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:40:54.959038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:40:54.959038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:40:54.959038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:40:54.959038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:40:54.959038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:40:54.959038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:40:54.959038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 620/1230] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:40:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:54.961313 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6379143-5e6c-4266-9762-b60802747894 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:55.074855 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6379143-5e6c-4266-9762-b60802747894 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:55.112379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f6539-7346-4d2e-8dcd-c9da0f126ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:55.113070 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f6539-7346-4d2e-8dcd-c9da0f126ac2 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:55.113358 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f6539-7346-4d2e-8dcd-c9da0f126ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:55.113639 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f6539-7346-4d2e-8dcd-c9da0f126ac2 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:55.114428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f6539-7346-4d2e-8dcd-c9da0f126ac2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:55.114745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f6539-7346-4d2e-8dcd-c9da0f126ac2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:55.119111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f6539-7346-4d2e-8dcd-c9da0f126ac2 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:55.132505 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 611/1231] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:40:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:55.139340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07981859-40a4-4351-a592-320229da0970 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:55.211092 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:55.249119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07981859-40a4-4351-a592-320229da0970 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:55.285534 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ba238-2635-434e-930a-8cf551055c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:55.286475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ba238-2635-434e-930a-8cf551055c58 None admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:55.286803 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ba238-2635-434e-930a-8cf551055c58 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:55.287114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ba238-2635-434e-930a-8cf551055c58 None admin] PATH_INFO: `/v3/projects/d6d43f779d67418baf199556b8e497c7/users/3abe1d47a1164776bf3a82fe4b129d9d/roles/06f67743387f476cade2623aa7e5c5d2` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:55.301426 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ba238-2635-434e-930a-8cf551055c58 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6d43f779d67418baf199556b8e497c7, user_id=3abe1d47a1164776bf3a82fe4b129d9d, role_id=06f67743387f476cade2623aa7e5c5d2)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:55.302866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ba238-2635-434e-930a-8cf551055c58 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:55.396635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 621/1232] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:40:55 2022] PUT /identity/v3/projects/d6d43f779d67418baf199556b8e497c7/users/3abe1d47a1164776bf3a82fe4b129d9d/roles/06f67743387f476cade2623aa7e5c5d2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:40:57.518810 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04b7ba-fc0d-49de-bb83-36d24f879f4c None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:57.519530 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04b7ba-fc0d-49de-bb83-36d24f879f4c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:57.519530 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04b7ba-fc0d-49de-bb83-36d24f879f4c None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:57.520953 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 612/1233] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:40:57.526157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc028932-fc42-4493-9206-023244993a70 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:57.526593 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc028932-fc42-4493-9206-023244993a70 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:57.526721 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc028932-fc42-4493-9206-023244993a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:57.544974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-dc028932-fc42-4493-9206-023244993a70 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:40:57.546143 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-dc028932-fc42-4493-9206-023244993a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:40:57.612483 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 622/1234] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:40:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:40:57.636410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04b7ba-fc0d-49de-bb83-36d24f879f4c None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:57.661713 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:57.735794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04b7ba-fc0d-49de-bb83-36d24f879f4c None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:57.770677 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf854a4-4dd7-4b5e-822d-3df7075262f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:57.771410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf854a4-4dd7-4b5e-822d-3df7075262f9 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:57.771696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf854a4-4dd7-4b5e-822d-3df7075262f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:57.771972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf854a4-4dd7-4b5e-822d-3df7075262f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:57.781908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf854a4-4dd7-4b5e-822d-3df7075262f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:40:57.789534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-9bf854a4-4dd7-4b5e-822d-3df7075262f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:40:57.789534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:57.789534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:57.789534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:57.789534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:57.789534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:57.789534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:57.789534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:57.789534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:57.789534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:57.789534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:57.789534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:57.789534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:40:57.789534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:40:57.789534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:40:57.789534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:40:57.790519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:40:57.790519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:40:57.790519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:40:57.790519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:40:57.790519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:57.790519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:57.790519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:57.790519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:57.790519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:57.790519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:57.790519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:57.790519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:57.790519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:57.790519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:57.790519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:57.790519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:57.791429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:57.791429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:57.791429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:57.791429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:57.791429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:40:57.791429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:40:57.791429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:40:57.791429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:40:57.791429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:40:57.791429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:40:57.791429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:40:57.791429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:40:57.791429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 613/1235] 10.222.0.93 () {56 vars in 1102 bytes} [Thu Jun 16 18:40:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:57.797013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc028932-fc42-4493-9206-023244993a70 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:57.843842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:57.895581 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc028932-fc42-4493-9206-023244993a70 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:57.929855 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d87e2-bafd-4947-bca6-4b47dd9f0f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:57.930523 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d87e2-bafd-4947-bca6-4b47dd9f0f9c None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:57.930807 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d87e2-bafd-4947-bca6-4b47dd9f0f9c None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:57.931102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d87e2-bafd-4947-bca6-4b47dd9f0f9c None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:57.932421 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d87e2-bafd-4947-bca6-4b47dd9f0f9c None admin] RBAC: Adding query filter params (name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:57.932758 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d87e2-bafd-4947-bca6-4b47dd9f0f9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:57.934128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d87e2-bafd-4947-bca6-4b47dd9f0f9c None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:57.941896 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 623/1236] 10.222.0.93 () {56 vars in 1103 bytes} [Thu Jun 16 18:40:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:57.948148 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf854a4-4dd7-4b5e-822d-3df7075262f9 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:58.030701 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:58.046636 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf854a4-4dd7-4b5e-822d-3df7075262f9 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:58.078487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f9158-fded-4c2d-8921-8c391a957f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:58.079269 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f9158-fded-4c2d-8921-8c391a957f29 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:58.079555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f9158-fded-4c2d-8921-8c391a957f29 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:58.079833 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f9158-fded-4c2d-8921-8c391a957f29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:58.089919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f9158-fded-4c2d-8921-8c391a957f29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:58.091366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f9158-fded-4c2d-8921-8c391a957f29 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:58.108420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-018f9158-fded-4c2d-8921-8c391a957f29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:58.108420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:58.108420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:58.108420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:58.108420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:58.108420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:58.108420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:58.108420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:58.108420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:58.108420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:58.108420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:58.108420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:58.108420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:58.108420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:58.108420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:58.109581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:58.109581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:58.109581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:58.109581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:58.109581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:58.109581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:58.109581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:58.109581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:58.109581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:58.109581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:58.109581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:58.109581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:58.109581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:58.109581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:58.109581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:58.109581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:58.109581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:58.110704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:58.110704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:58.110704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:58.110704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:40:58.110704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 614/1237] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:58.115902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d87e2-bafd-4947-bca6-4b47dd9f0f9c None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:58.213095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d87e2-bafd-4947-bca6-4b47dd9f0f9c None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:58.221665 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:58.246020 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf7af0-4db1-4f2f-92d0-e24db736ed58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:58.246686 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf7af0-4db1-4f2f-92d0-e24db736ed58 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:58.246970 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf7af0-4db1-4f2f-92d0-e24db736ed58 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:58.247246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf7af0-4db1-4f2f-92d0-e24db736ed58 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:58.247971 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf7af0-4db1-4f2f-92d0-e24db736ed58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:58.248277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf7af0-4db1-4f2f-92d0-e24db736ed58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:58.249681 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf7af0-4db1-4f2f-92d0-e24db736ed58 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:58.261658 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 624/1238] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:58.268623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f9158-fded-4c2d-8921-8c391a957f29 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:58.368709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f9158-fded-4c2d-8921-8c391a957f29 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:58.402401 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfe22f-7bd5-479c-96b8-d7719c70d25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:58.403263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfe22f-7bd5-479c-96b8-d7719c70d25b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:58.403544 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfe22f-7bd5-479c-96b8-d7719c70d25b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:58.403819 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfe22f-7bd5-479c-96b8-d7719c70d25b None admin] PATH_INFO: `/v3/users/placement` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:58.406441 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:58.411333 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfe22f-7bd5-479c-96b8-d7719c70d25b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:58.412789 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfe22f-7bd5-479c-96b8-d7719c70d25b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:58.427064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-a6bfe22f-7bd5-479c-96b8-d7719c70d25b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:40:58.427064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:58.427064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:58.427064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:58.427064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:58.427064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:58.427064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:58.427064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:58.427064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:58.427064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:58.427064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:58.427064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:58.427064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:40:58.427064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:40:58.427064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:40:58.427064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:40:58.428208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:58.428208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:58.428208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:40:58.428208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:40:58.428208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:40:58.428208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:40:58.428208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:58.428208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:58.428208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:58.428208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:58.428208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:58.428208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:58.428208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:58.428208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:58.428208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:58.428208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:58.428208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:58.428208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:58.429603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:58.429603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:58.429603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:40:58.429603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:40:58.429603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:40:58.429603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:40:58.429603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:40:58.429603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:40:58.429603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:40:58.429603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:40:58.429603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 615/1239] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:58.434288 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf7af0-4db1-4f2f-92d0-e24db736ed58 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:58.532856 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf7af0-4db1-4f2f-92d0-e24db736ed58 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:58.567020 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23882e0a-c2b3-46ee-909f-e5ce5c8b81dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:58.567713 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23882e0a-c2b3-46ee-909f-e5ce5c8b81dd None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:58.567996 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23882e0a-c2b3-46ee-909f-e5ce5c8b81dd None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:58.568270 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23882e0a-c2b3-46ee-909f-e5ce5c8b81dd None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:58.569131 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23882e0a-c2b3-46ee-909f-e5ce5c8b81dd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:58.569445 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23882e0a-c2b3-46ee-909f-e5ce5c8b81dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:58.570870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23882e0a-c2b3-46ee-909f-e5ce5c8b81dd None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:58.587761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 625/1240] 10.222.0.93 () {56 vars in 1143 bytes} [Thu Jun 16 18:40:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:58.593606 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfe22f-7bd5-479c-96b8-d7719c70d25b None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:58.692798 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfe22f-7bd5-479c-96b8-d7719c70d25b None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:58.726530 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d709f1-7e87-41df-a4c9-ad10453d3161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:58.727179 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d709f1-7e87-41df-a4c9-ad10453d3161 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:58.727474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d709f1-7e87-41df-a4c9-ad10453d3161 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:58.727746 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d709f1-7e87-41df-a4c9-ad10453d3161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:58.787944 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:58.794342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d709f1-7e87-41df-a4c9-ad10453d3161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:58.795789 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d709f1-7e87-41df-a4c9-ad10453d3161 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:58.890326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 616/1241] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:40:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:40:58.896096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23882e0a-c2b3-46ee-909f-e5ce5c8b81dd None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:58.923105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:58.992934 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23882e0a-c2b3-46ee-909f-e5ce5c8b81dd None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:59.026444 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bb3ba-2f43-406d-8be9-5c415e0dc698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:59.027240 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bb3ba-2f43-406d-8be9-5c415e0dc698 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:59.027524 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bb3ba-2f43-406d-8be9-5c415e0dc698 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:59.027800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bb3ba-2f43-406d-8be9-5c415e0dc698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:59.037832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bb3ba-2f43-406d-8be9-5c415e0dc698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:59.039269 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bb3ba-2f43-406d-8be9-5c415e0dc698 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:59.056172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-970bb3ba-2f43-406d-8be9-5c415e0dc698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:59.056172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:59.056172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:59.056172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:59.056172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:59.056172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:59.056172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:59.056172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:59.056172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:59.056172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:59.056172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:59.056172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:59.056172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:59.056172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:59.056172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:59.057277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:59.057277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:59.057277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:59.057277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:59.057277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:59.057277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:59.057277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:59.057277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:59.057277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:59.057277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:59.057277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:59.057277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:59.057277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:59.057277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:59.057277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:59.057277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:59.057277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:59.058412 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:59.058412 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:59.058412 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:59.058412 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:40:59.058412 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 626/1242] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:59.063154 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d709f1-7e87-41df-a4c9-ad10453d3161 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:59.154903 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:59.160482 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d709f1-7e87-41df-a4c9-ad10453d3161 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:59.193633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9a390-a7e9-4ca9-8c33-608a6ce37191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:59.194658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9a390-a7e9-4ca9-8c33-608a6ce37191 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:59.194658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9a390-a7e9-4ca9-8c33-608a6ce37191 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:59.194925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9a390-a7e9-4ca9-8c33-608a6ce37191 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:59.195658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9a390-a7e9-4ca9-8c33-608a6ce37191 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:59.195972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9a390-a7e9-4ca9-8c33-608a6ce37191 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:59.197932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9a390-a7e9-4ca9-8c33-608a6ce37191 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:59.208858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 617/1243] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:59.214516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bb3ba-2f43-406d-8be9-5c415e0dc698 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:59.291798 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:59.312531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bb3ba-2f43-406d-8be9-5c415e0dc698 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:59.344853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b094-ff4e-4c66-a1d3-0ac9bfa61e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:59.345639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b094-ff4e-4c66-a1d3-0ac9bfa61e78 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:59.345923 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b094-ff4e-4c66-a1d3-0ac9bfa61e78 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:59.346195 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b094-ff4e-4c66-a1d3-0ac9bfa61e78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:59.352599 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8b094-ff4e-4c66-a1d3-0ac9bfa61e78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:59.354061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8b094-ff4e-4c66-a1d3-0ac9bfa61e78 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:59.367303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-58b8b094-ff4e-4c66-a1d3-0ac9bfa61e78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:40:59.367303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:59.367303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:59.367303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:59.367303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:59.367303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:59.367303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:59.367303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:59.367303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:59.367303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:59.367303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:59.367303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:59.367303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:40:59.367303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:40:59.367303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:40:59.370979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:40:59.370979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:59.370979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:59.370979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:59.370979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:59.370979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:59.370979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:59.370979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:59.370979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:59.370979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:59.370979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:59.370979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:59.370979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:59.370979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:59.370979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:59.370979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:59.370979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:59.372116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:40:59.372116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:40:59.372116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:40:59.372116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:40:59.372116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:40:59.372116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:40:59.372116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:40:59.372116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:40:59.372116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 627/1244] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:40:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:59.374825 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9a390-a7e9-4ca9-8c33-608a6ce37191 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:59.474849 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9a390-a7e9-4ca9-8c33-608a6ce37191 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:59.508125 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6c0e0-e176-4b42-a251-ce529a540224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:59.508886 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6c0e0-e176-4b42-a251-ce529a540224 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:59.509172 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6c0e0-e176-4b42-a251-ce529a540224 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:59.509451 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6c0e0-e176-4b42-a251-ce529a540224 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:59.510830 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6c0e0-e176-4b42-a251-ce529a540224 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:59.511145 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6c0e0-e176-4b42-a251-ce529a540224 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:59.512609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6c0e0-e176-4b42-a251-ce529a540224 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:59.524510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 618/1245] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:40:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:59.530556 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b094-ff4e-4c66-a1d3-0ac9bfa61e78 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:59.637250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b094-ff4e-4c66-a1d3-0ac9bfa61e78 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:59.670890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843afac-8e26-43a5-9ac2-997d212ba900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:59.671537 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843afac-8e26-43a5-9ac2-997d212ba900 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:59.671824 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843afac-8e26-43a5-9ac2-997d212ba900 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:59.672103 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843afac-8e26-43a5-9ac2-997d212ba900 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:59.672956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843afac-8e26-43a5-9ac2-997d212ba900 None admin] RBAC: Adding query filter params (role.id=06f67743387f476cade2623aa7e5c5d2, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=3abe1d47a1164776bf3a82fe4b129d9d) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:59.673270 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843afac-8e26-43a5-9ac2-997d212ba900 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:59.674692 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843afac-8e26-43a5-9ac2-997d212ba900 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:59.680310 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 628/1246] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:40:59 2022] GET /identity/v3/role_assignments?user.id=3abe1d47a1164776bf3a82fe4b129d9d&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=06f67743387f476cade2623aa7e5c5d2 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:01.864233 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abd2b2-d6db-4035-8cdb-3ccb1802ff64 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:01.864841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abd2b2-d6db-4035-8cdb-3ccb1802ff64 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:01.864841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abd2b2-d6db-4035-8cdb-3ccb1802ff64 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:01.866399 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 619/1247] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:41:01.871671 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e9e8b-f952-475a-ba5b-c0eebbb8efb5 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:01.872100 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e9e8b-f952-475a-ba5b-c0eebbb8efb5 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:01.872237 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e9e8b-f952-475a-ba5b-c0eebbb8efb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:01.877548 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:01.889653 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-916e9e8b-f952-475a-ba5b-c0eebbb8efb5 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:41:01.890832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-916e9e8b-f952-475a-ba5b-c0eebbb8efb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:01.958471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 629/1248] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:41:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:41:01.982158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abd2b2-d6db-4035-8cdb-3ccb1802ff64 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:02.000270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:02.081412 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abd2b2-d6db-4035-8cdb-3ccb1802ff64 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:02.115074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd30319-754d-4027-8520-4d0d7ff025f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:02.115800 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd30319-754d-4027-8520-4d0d7ff025f4 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:02.116087 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd30319-754d-4027-8520-4d0d7ff025f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:02.116366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd30319-754d-4027-8520-4d0d7ff025f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:02.127329 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd30319-754d-4027-8520-4d0d7ff025f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:41:02.135543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-3dd30319-754d-4027-8520-4d0d7ff025f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:41:02.135543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:02.135543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:41:02.135543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:41:02.135543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:41:02.135543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:41:02.135543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:41:02.135543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:41:02.135543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:41:02.135543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:41:02.135543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:41:02.135543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:41:02.135543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:41:02.135543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:41:02.135543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:41:02.135543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:41:02.136724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:41:02.136724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:41:02.136724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:41:02.136724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:41:02.136724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:41:02.136724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:41:02.136724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:41:02.136724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:41:02.136724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:41:02.136724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:41:02.136724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:41:02.136724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:41:02.136724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:41:02.136724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:41:02.136724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:41:02.136724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:41:02.137821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:41:02.137821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:41:02.137821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:41:02.137821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:41:02.137821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:41:02.137821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:41:02.137821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:41:02.137821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:41:02.137821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:41:02.137821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:41:02.137821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:41:02.137821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:41:02.137821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 620/1249] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:41:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:41:02.142922 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e9e8b-f952-475a-ba5b-c0eebbb8efb5 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:02.238296 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e9e8b-f952-475a-ba5b-c0eebbb8efb5 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:02.267512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:02.272233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6064fe1-1a85-4f14-a87f-9dcab2f0a788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:02.272937 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6064fe1-1a85-4f14-a87f-9dcab2f0a788 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:02.273219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6064fe1-1a85-4f14-a87f-9dcab2f0a788 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:02.273492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6064fe1-1a85-4f14-a87f-9dcab2f0a788 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:02.274236 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6064fe1-1a85-4f14-a87f-9dcab2f0a788 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:02.274540 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6064fe1-1a85-4f14-a87f-9dcab2f0a788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:02.275921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6064fe1-1a85-4f14-a87f-9dcab2f0a788 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:02.283926 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 630/1250] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:41:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:02.289722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd30319-754d-4027-8520-4d0d7ff025f4 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:02.365280 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:02.388269 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd30319-754d-4027-8520-4d0d7ff025f4 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:02.420409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372304f-df23-4483-83a8-acbc9ce29698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:02.421218 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372304f-df23-4483-83a8-acbc9ce29698 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:02.421503 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372304f-df23-4483-83a8-acbc9ce29698 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:02.421781 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372304f-df23-4483-83a8-acbc9ce29698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:02.432737 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372304f-df23-4483-83a8-acbc9ce29698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:02.434174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372304f-df23-4483-83a8-acbc9ce29698 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:02.451359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-1372304f-df23-4483-83a8-acbc9ce29698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:41:02.451359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:02.451359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:41:02.451359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:41:02.451359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:41:02.451359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:41:02.451359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:41:02.451359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:41:02.451359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:41:02.451359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:41:02.451359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:41:02.451359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:41:02.451359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:41:02.451359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:41:02.451359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:41:02.452415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:41:02.452415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:41:02.452415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:41:02.452415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:41:02.452415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:41:02.452415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:41:02.452415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:41:02.452415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:41:02.452415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:41:02.452415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:41:02.452415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:41:02.452415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:41:02.452415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:41:02.452415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:41:02.452415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:41:02.452415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:41:02.452415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:41:02.453543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:41:02.453543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:41:02.453543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:41:02.453543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:41:02.453543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 621/1251] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:41:02.459798 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6064fe1-1a85-4f14-a87f-9dcab2f0a788 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:02.557313 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6064fe1-1a85-4f14-a87f-9dcab2f0a788 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:02.589192 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa6cc6-0ab7-43a6-b96a-f50cde5db90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:02.589851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa6cc6-0ab7-43a6-b96a-f50cde5db90e None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:02.590141 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa6cc6-0ab7-43a6-b96a-f50cde5db90e None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:02.590421 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa6cc6-0ab7-43a6-b96a-f50cde5db90e None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:02.591138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa6cc6-0ab7-43a6-b96a-f50cde5db90e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:02.591447 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa6cc6-0ab7-43a6-b96a-f50cde5db90e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:02.592857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa6cc6-0ab7-43a6-b96a-f50cde5db90e None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:02.605237 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 631/1252] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:02.610945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372304f-df23-4483-83a8-acbc9ce29698 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:02.710650 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372304f-df23-4483-83a8-acbc9ce29698 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:02.736206 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:02.743724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19065ec4-139d-4c88-8001-faf4e1a0b728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:02.745122 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19065ec4-139d-4c88-8001-faf4e1a0b728 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:02.745410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19065ec4-139d-4c88-8001-faf4e1a0b728 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:02.745689 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19065ec4-139d-4c88-8001-faf4e1a0b728 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:02.753938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19065ec4-139d-4c88-8001-faf4e1a0b728 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:02.755420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19065ec4-139d-4c88-8001-faf4e1a0b728 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:02.769365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-19065ec4-139d-4c88-8001-faf4e1a0b728 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:41:02.769365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:02.769365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:41:02.769365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:41:02.769365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:41:02.769365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:41:02.769365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:41:02.769365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:41:02.769365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:41:02.769365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:41:02.769365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:41:02.769365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:41:02.769365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:41:02.769365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:41:02.769365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:41:02.769365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:41:02.770531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:41:02.770531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:41:02.770531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:41:02.770531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:41:02.770531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:41:02.770531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:41:02.770531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:41:02.770531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:41:02.770531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:41:02.770531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:41:02.770531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:41:02.770531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:41:02.770531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:41:02.770531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:41:02.770531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:41:02.770531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:41:02.770531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:41:02.770531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:41:02.771776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:41:02.771776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:41:02.771776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:41:02.771776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:41:02.771776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:41:02.771776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:41:02.771776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:41:02.771776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:41:02.771776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:41:02.771776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:41:02.771776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 622/1253] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:41:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:41:02.776495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa6cc6-0ab7-43a6-b96a-f50cde5db90e None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:02.830261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:02.872574 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa6cc6-0ab7-43a6-b96a-f50cde5db90e None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:02.904101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfe374-2fe4-4d20-bc54-fc6f58348ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:02.904796 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfe374-2fe4-4d20-bc54-fc6f58348ff3 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:02.905081 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfe374-2fe4-4d20-bc54-fc6f58348ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:02.905489 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfe374-2fe4-4d20-bc54-fc6f58348ff3 None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:02.906487 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfe374-2fe4-4d20-bc54-fc6f58348ff3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:02.906822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfe374-2fe4-4d20-bc54-fc6f58348ff3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:02.908573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfe374-2fe4-4d20-bc54-fc6f58348ff3 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:02.926065 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 632/1254] 10.222.0.93 () {56 vars in 1143 bytes} [Thu Jun 16 18:41:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:02.931834 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19065ec4-139d-4c88-8001-faf4e1a0b728 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:03.030348 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19065ec4-139d-4c88-8001-faf4e1a0b728 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:03.063560 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9151c-c946-47df-81eb-bffb1ef29ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:03.064217 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9151c-c946-47df-81eb-bffb1ef29ea4 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:03.064531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9151c-c946-47df-81eb-bffb1ef29ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:03.064810 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9151c-c946-47df-81eb-bffb1ef29ea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:03.119608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:03.131445 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9151c-c946-47df-81eb-bffb1ef29ea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:03.132944 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9151c-c946-47df-81eb-bffb1ef29ea4 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:03.224252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 623/1255] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:41:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:41:03.230595 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfe374-2fe4-4d20-bc54-fc6f58348ff3 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:03.328716 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfe374-2fe4-4d20-bc54-fc6f58348ff3 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:03.344062 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:03.364402 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c0c7a-1351-4d76-ad8e-352bc177c036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:03.365233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c0c7a-1351-4d76-ad8e-352bc177c036 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:03.365522 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c0c7a-1351-4d76-ad8e-352bc177c036 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:03.365801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c0c7a-1351-4d76-ad8e-352bc177c036 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:03.375525 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c0c7a-1351-4d76-ad8e-352bc177c036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:03.377280 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c0c7a-1351-4d76-ad8e-352bc177c036 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:03.394727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-204c0c7a-1351-4d76-ad8e-352bc177c036 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:41:03.394727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:03.394727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:41:03.394727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:41:03.394727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:41:03.394727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:41:03.394727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:41:03.394727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:41:03.394727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:41:03.394727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:41:03.394727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:41:03.394727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:41:03.394727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:41:03.394727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:41:03.394727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:41:03.399570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:41:03.399570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:41:03.399570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:41:03.399570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:41:03.399570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:41:03.399570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:41:03.399570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:41:03.399570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:41:03.399570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:41:03.399570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:41:03.399570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:41:03.399570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:41:03.399570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:41:03.399570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:41:03.399570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:41:03.399570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:41:03.399570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:41:03.401255 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:41:03.401255 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:41:03.401255 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:41:03.401255 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:41:03.401255 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 633/1256] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:41:03.402131 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9151c-c946-47df-81eb-bffb1ef29ea4 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:03.486426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:03.498338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9151c-c946-47df-81eb-bffb1ef29ea4 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:03.530583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08959910-6484-4823-8e43-980baf1e3c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:03.531238 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08959910-6484-4823-8e43-980baf1e3c35 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:03.531526 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08959910-6484-4823-8e43-980baf1e3c35 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:03.531806 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08959910-6484-4823-8e43-980baf1e3c35 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:03.532552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08959910-6484-4823-8e43-980baf1e3c35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:03.532865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08959910-6484-4823-8e43-980baf1e3c35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:03.534226 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08959910-6484-4823-8e43-980baf1e3c35 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:03.545798 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 624/1257] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:03.551442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c0c7a-1351-4d76-ad8e-352bc177c036 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:03.647912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c0c7a-1351-4d76-ad8e-352bc177c036 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:03.683892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6086c20-31eb-48fa-8ad2-0df3e1dbd52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:03.684939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6086c20-31eb-48fa-8ad2-0df3e1dbd52f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:03.685224 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6086c20-31eb-48fa-8ad2-0df3e1dbd52f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:03.685504 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6086c20-31eb-48fa-8ad2-0df3e1dbd52f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:03.692208 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6086c20-31eb-48fa-8ad2-0df3e1dbd52f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:03.693687 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6086c20-31eb-48fa-8ad2-0df3e1dbd52f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:03.707774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-b6086c20-31eb-48fa-8ad2-0df3e1dbd52f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:41:03.707774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:03.707774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:41:03.707774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:41:03.707774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:41:03.707774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:41:03.707774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:41:03.707774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:41:03.707774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:41:03.707774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:41:03.707774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:41:03.707774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:41:03.707774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:41:03.707774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:41:03.707774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:41:03.708940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:41:03.708940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:41:03.708940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:41:03.708940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:41:03.708940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:41:03.708940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:41:03.708940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:41:03.708940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:41:03.708940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:41:03.708940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:41:03.708940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:41:03.708940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:41:03.708940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:41:03.708940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:41:03.708940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:41:03.708940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:41:03.708940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:41:03.710080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:41:03.710080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:41:03.710080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:41:03.710080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:41:03.710080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:41:03.710080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:41:03.710080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:41:03.710080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:41:03.710080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 634/1258] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:41:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:41:03.719291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08959910-6484-4823-8e43-980baf1e3c35 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:03.814665 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08959910-6484-4823-8e43-980baf1e3c35 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:03.847322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12fca5-230b-4f35-ab3b-95fbc2395178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:03.847973 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12fca5-230b-4f35-ab3b-95fbc2395178 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:03.848257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12fca5-230b-4f35-ab3b-95fbc2395178 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:03.848567 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12fca5-230b-4f35-ab3b-95fbc2395178 None admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:03.849354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12fca5-230b-4f35-ab3b-95fbc2395178 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:03.849665 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12fca5-230b-4f35-ab3b-95fbc2395178 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:03.851089 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12fca5-230b-4f35-ab3b-95fbc2395178 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:03.862768 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 625/1259] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:41:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:03.869476 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6086c20-31eb-48fa-8ad2-0df3e1dbd52f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:03.899437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:03.989143 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6086c20-31eb-48fa-8ad2-0df3e1dbd52f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:04.023755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eeded9-a31a-418e-a72d-39b88f4bb3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:04.024411 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eeded9-a31a-418e-a72d-39b88f4bb3ee None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:04.024731 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eeded9-a31a-418e-a72d-39b88f4bb3ee None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:04.025011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eeded9-a31a-418e-a72d-39b88f4bb3ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:04.025838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eeded9-a31a-418e-a72d-39b88f4bb3ee None admin] RBAC: Adding query filter params (role.id=416a52031d5d49b6a3fa0e9baa814436, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=3abe1d47a1164776bf3a82fe4b129d9d) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:04.026154 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eeded9-a31a-418e-a72d-39b88f4bb3ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:04.027647 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eeded9-a31a-418e-a72d-39b88f4bb3ee None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:04.033134 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 635/1260] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:41:03 2022] GET /identity/v3/role_assignments?user.id=3abe1d47a1164776bf3a82fe4b129d9d&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:06.118154 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2b006-afe1-4dc7-98f9-3b85c587912b None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:06.118721 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2b006-afe1-4dc7-98f9-3b85c587912b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:06.118721 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2b006-afe1-4dc7-98f9-3b85c587912b None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:06.120100 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 626/1261] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:41:06.125182 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d961d-660d-4ae8-b5b4-2ea53b7c1a83 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:06.125556 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d961d-660d-4ae8-b5b4-2ea53b7c1a83 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:06.125753 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d961d-660d-4ae8-b5b4-2ea53b7c1a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:06.142553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-150d961d-660d-4ae8-b5b4-2ea53b7c1a83 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:41:06.143725 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-150d961d-660d-4ae8-b5b4-2ea53b7c1a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:06.208055 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 636/1262] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:41:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:41:06.231179 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2b006-afe1-4dc7-98f9-3b85c587912b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:06.241811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:06.329984 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2b006-afe1-4dc7-98f9-3b85c587912b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:06.364320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a48432-7f69-4966-abee-20ba0637f34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:06.365215 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a48432-7f69-4966-abee-20ba0637f34f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:06.365493 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a48432-7f69-4966-abee-20ba0637f34f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:06.365762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a48432-7f69-4966-abee-20ba0637f34f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:06.376171 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a48432-7f69-4966-abee-20ba0637f34f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:41:06.383577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-75a48432-7f69-4966-abee-20ba0637f34f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:41:06.383577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:06.383577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:41:06.383577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:41:06.383577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:41:06.383577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:41:06.383577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:41:06.383577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:41:06.383577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:41:06.383577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:41:06.383577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:41:06.383577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:41:06.383577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:41:06.383577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:41:06.383577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:41:06.383577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:41:06.385265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:41:06.385265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:41:06.385265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:41:06.385265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:41:06.385265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:41:06.385265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:41:06.385265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:41:06.385265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:41:06.385265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:41:06.385265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:41:06.385265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:41:06.385265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:41:06.385265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:41:06.385265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:41:06.385265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:41:06.385265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:41:06.386245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:41:06.386245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:41:06.386245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:41:06.386245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:41:06.386245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:41:06.386245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:41:06.386245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:41:06.386245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:41:06.386245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:41:06.386245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:41:06.386245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:41:06.386245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:41:06.386245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 627/1263] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:41:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:41:06.391470 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d961d-660d-4ae8-b5b4-2ea53b7c1a83 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:06.409830 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:06.489734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d961d-660d-4ae8-b5b4-2ea53b7c1a83 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:06.523167 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19650661-1df8-4dd6-a77e-75dbc5c316d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:06.523837 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19650661-1df8-4dd6-a77e-75dbc5c316d3 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:06.524126 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19650661-1df8-4dd6-a77e-75dbc5c316d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:06.524402 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19650661-1df8-4dd6-a77e-75dbc5c316d3 None admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:06.525813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19650661-1df8-4dd6-a77e-75dbc5c316d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:06.526121 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19650661-1df8-4dd6-a77e-75dbc5c316d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:06.527494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19650661-1df8-4dd6-a77e-75dbc5c316d3 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:06.535457 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 637/1264] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:41:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:06.541379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a48432-7f69-4966-abee-20ba0637f34f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:06.607339 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:06.639897 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a48432-7f69-4966-abee-20ba0637f34f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:06.672815 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8e85c-f8f8-481f-984d-adfe71c1ec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:06.673601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8e85c-f8f8-481f-984d-adfe71c1ec74 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:06.673881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8e85c-f8f8-481f-984d-adfe71c1ec74 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:06.674190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8e85c-f8f8-481f-984d-adfe71c1ec74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:06.684754 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8e85c-f8f8-481f-984d-adfe71c1ec74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:06.686186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8e85c-f8f8-481f-984d-adfe71c1ec74 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:06.703003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-1ce8e85c-f8f8-481f-984d-adfe71c1ec74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:41:06.703003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:06.703003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:41:06.703003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:41:06.703003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:41:06.703003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:41:06.703003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:41:06.703003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:41:06.703003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:41:06.703003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:41:06.703003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:41:06.703003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:41:06.703003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:41:06.703003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:41:06.703003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:41:06.704069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:41:06.704069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:41:06.704069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:41:06.704069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:41:06.704069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:41:06.704069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:41:06.704069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:41:06.704069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:41:06.704069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:41:06.704069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:41:06.704069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:41:06.704069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:41:06.704069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:41:06.704069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:41:06.704069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:41:06.704069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:41:06.704069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:41:06.705297 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:41:06.705297 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:41:06.705297 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:41:06.705297 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:41:06.705297 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 628/1265] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:41:06.709933 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19650661-1df8-4dd6-a77e-75dbc5c316d3 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:06.791089 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:06.809747 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19650661-1df8-4dd6-a77e-75dbc5c316d3 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:06.846907 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274c352-c64e-465c-af8f-c1cd45af2945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:06.847563 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274c352-c64e-465c-af8f-c1cd45af2945 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:06.847845 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274c352-c64e-465c-af8f-c1cd45af2945 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:06.848118 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274c352-c64e-465c-af8f-c1cd45af2945 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:06.848857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274c352-c64e-465c-af8f-c1cd45af2945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:06.849162 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274c352-c64e-465c-af8f-c1cd45af2945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:06.850536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274c352-c64e-465c-af8f-c1cd45af2945 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:06.861442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 638/1266] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:06.867097 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8e85c-f8f8-481f-984d-adfe71c1ec74 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:06.964157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8e85c-f8f8-481f-984d-adfe71c1ec74 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:06.982771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:06.996530 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0590bc-6ca1-4ef1-9e82-fe1b26b7fd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:06.997310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0590bc-6ca1-4ef1-9e82-fe1b26b7fd1d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:06.997590 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0590bc-6ca1-4ef1-9e82-fe1b26b7fd1d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:06.997862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0590bc-6ca1-4ef1-9e82-fe1b26b7fd1d None admin] PATH_INFO: `/v3/users/placement` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:07.005622 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0590bc-6ca1-4ef1-9e82-fe1b26b7fd1d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:07.007060 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0590bc-6ca1-4ef1-9e82-fe1b26b7fd1d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:07.021865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-ff0590bc-6ca1-4ef1-9e82-fe1b26b7fd1d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:41:07.021865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:07.021865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:41:07.021865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:41:07.021865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:41:07.021865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:41:07.021865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:41:07.021865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:41:07.021865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:41:07.021865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:41:07.021865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:41:07.021865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:41:07.021865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:41:07.021865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:41:07.021865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:41:07.021865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:41:07.027311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:41:07.027311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:41:07.027311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:41:07.027311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:41:07.027311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:41:07.027311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:41:07.027311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:41:07.027311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:41:07.027311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:41:07.027311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:41:07.027311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:41:07.027311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:41:07.027311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:41:07.027311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:41:07.027311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:41:07.027311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:41:07.027311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:41:07.027311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:41:07.028640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:41:07.028640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:41:07.028640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:41:07.028640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:41:07.028640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:41:07.028640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:41:07.028640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:41:07.028640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:41:07.028640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:41:07.028640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:41:07.028640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 629/1267] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:41:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:41:07.029388 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274c352-c64e-465c-af8f-c1cd45af2945 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:07.126711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274c352-c64e-465c-af8f-c1cd45af2945 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:07.159999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2e0c5-cda7-4374-8e86-db9c0d0ab23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:07.160699 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2e0c5-cda7-4374-8e86-db9c0d0ab23f None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:07.160982 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2e0c5-cda7-4374-8e86-db9c0d0ab23f None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:07.161254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2e0c5-cda7-4374-8e86-db9c0d0ab23f None admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:07.162145 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2e0c5-cda7-4374-8e86-db9c0d0ab23f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:07.162453 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2e0c5-cda7-4374-8e86-db9c0d0ab23f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:07.163877 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2e0c5-cda7-4374-8e86-db9c0d0ab23f None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:07.172676 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:07.180526 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 639/1268] 10.222.0.93 () {56 vars in 1143 bytes} [Thu Jun 16 18:41:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:07.186157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0590bc-6ca1-4ef1-9e82-fe1b26b7fd1d None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:07.285710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0590bc-6ca1-4ef1-9e82-fe1b26b7fd1d None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:07.318738 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed333ef9-1f09-42de-8a84-d58af8984606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:07.319536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed333ef9-1f09-42de-8a84-d58af8984606 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:07.319821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed333ef9-1f09-42de-8a84-d58af8984606 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:07.320095 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed333ef9-1f09-42de-8a84-d58af8984606 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:07.331501 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed333ef9-1f09-42de-8a84-d58af8984606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:07.332979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed333ef9-1f09-42de-8a84-d58af8984606 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:07.350255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-ed333ef9-1f09-42de-8a84-d58af8984606 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:41:07.350255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:07.350255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:41:07.350255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:41:07.350255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:41:07.350255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:41:07.350255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:41:07.350255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:41:07.350255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:41:07.350255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:41:07.350255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:41:07.350255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:41:07.350255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:41:07.350255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:41:07.350255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:41:07.351338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:41:07.351338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:41:07.351338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:41:07.351338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:41:07.351338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:41:07.351338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:41:07.351338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:41:07.351338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:41:07.351338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:41:07.351338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:41:07.351338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:41:07.351338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:41:07.351338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:41:07.351338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:41:07.351338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:41:07.351338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:41:07.351338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:41:07.352681 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:41:07.352681 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:41:07.352681 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:41:07.352681 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:41:07.352681 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 630/1269] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:41:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:41:07.357163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2e0c5-cda7-4374-8e86-db9c0d0ab23f None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:07.454084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2e0c5-cda7-4374-8e86-db9c0d0ab23f None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:07.486610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212a055-4a12-4e0d-9e5e-40f3389a011c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:07.487271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212a055-4a12-4e0d-9e5e-40f3389a011c None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:07.487558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212a055-4a12-4e0d-9e5e-40f3389a011c None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:07.487838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212a055-4a12-4e0d-9e5e-40f3389a011c None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:07.488593 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212a055-4a12-4e0d-9e5e-40f3389a011c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:07.488906 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212a055-4a12-4e0d-9e5e-40f3389a011c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:07.490277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212a055-4a12-4e0d-9e5e-40f3389a011c None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:07.502147 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 640/1270] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:07.507826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed333ef9-1f09-42de-8a84-d58af8984606 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:07.538799 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:07.603569 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed333ef9-1f09-42de-8a84-d58af8984606 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:07.637541 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29482fe9-f638-4a06-b743-482bdcff625c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:07.638340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29482fe9-f638-4a06-b743-482bdcff625c None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:07.638624 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29482fe9-f638-4a06-b743-482bdcff625c None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:07.638904 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29482fe9-f638-4a06-b743-482bdcff625c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:07.646404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29482fe9-f638-4a06-b743-482bdcff625c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:07.647841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29482fe9-f638-4a06-b743-482bdcff625c None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:07.663395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-29482fe9-f638-4a06-b743-482bdcff625c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:41:07.663395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:07.663395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:41:07.663395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:41:07.663395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:41:07.663395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:41:07.663395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:41:07.663395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:41:07.663395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:41:07.663395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:41:07.663395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:41:07.663395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:41:07.663395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:41:07.663395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:41:07.663395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:41:07.664481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:41:07.664481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:41:07.664481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:41:07.664481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:41:07.664481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:41:07.664481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:41:07.664481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:41:07.664481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:41:07.664481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:41:07.664481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:41:07.664481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:41:07.664481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:41:07.664481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:41:07.664481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:41:07.664481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:41:07.664481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:41:07.664481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:41:07.666164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:41:07.666164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:41:07.666164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:41:07.666164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:41:07.666164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:41:07.666164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:41:07.666164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:41:07.666164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:41:07.666164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 631/1271] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:41:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:41:07.670947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212a055-4a12-4e0d-9e5e-40f3389a011c None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:07.733277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:07.773250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212a055-4a12-4e0d-9e5e-40f3389a011c None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:07.806127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c709cd-5fd6-4487-a375-0cb31da09fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:07.806726 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c709cd-5fd6-4487-a375-0cb31da09fb0 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:07.807016 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c709cd-5fd6-4487-a375-0cb31da09fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:07.807298 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c709cd-5fd6-4487-a375-0cb31da09fb0 None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:07.808081 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c709cd-5fd6-4487-a375-0cb31da09fb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:07.808395 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c709cd-5fd6-4487-a375-0cb31da09fb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:07.809867 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c709cd-5fd6-4487-a375-0cb31da09fb0 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:07.822111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 641/1272] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:41:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:07.828334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29482fe9-f638-4a06-b743-482bdcff625c None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:07.917962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:07.926476 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29482fe9-f638-4a06-b743-482bdcff625c None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:07.959672 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509e756-0033-4894-9348-55a8605df66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:07.960585 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509e756-0033-4894-9348-55a8605df66b None admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:07.960868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509e756-0033-4894-9348-55a8605df66b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:07.961143 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509e756-0033-4894-9348-55a8605df66b None admin] PATH_INFO: `/v3/projects/d6d43f779d67418baf199556b8e497c7/users/3abe1d47a1164776bf3a82fe4b129d9d/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:07.963630 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509e756-0033-4894-9348-55a8605df66b None admin] RBAC: Authorizing `identity:create_grant(project_id=d6d43f779d67418baf199556b8e497c7, user_id=3abe1d47a1164776bf3a82fe4b129d9d, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:07.965203 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509e756-0033-4894-9348-55a8605df66b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:08.096064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 632/1273] 10.222.0.93 () {58 vars in 1439 bytes} [Thu Jun 16 18:41:07 2022] PUT /identity/v3/projects/d6d43f779d67418baf199556b8e497c7/users/3abe1d47a1164776bf3a82fe4b129d9d/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:41:10.184712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96999f-3bdf-4863-b551-c310a0c51eea None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:10.185386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96999f-3bdf-4863-b551-c310a0c51eea None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:10.185386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96999f-3bdf-4863-b551-c310a0c51eea None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:10.186642 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 642/1274] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:41:10.191707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d7b36-4c9c-467e-8146-8fb560f33d38 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:10.192285 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d7b36-4c9c-467e-8146-8fb560f33d38 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:10.192390 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d7b36-4c9c-467e-8146-8fb560f33d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:10.208854 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b91d7b36-4c9c-467e-8146-8fb560f33d38 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:41:10.210047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b91d7b36-4c9c-467e-8146-8fb560f33d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:10.277277 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 633/1275] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:41:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:41:10.300350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96999f-3bdf-4863-b551-c310a0c51eea None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:10.400509 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96999f-3bdf-4863-b551-c310a0c51eea None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:10.417276 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:10.433958 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dac9ba-3bd4-46ce-83ea-5d4e5f1f4bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:10.434799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dac9ba-3bd4-46ce-83ea-5d4e5f1f4bc1 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:10.435033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dac9ba-3bd4-46ce-83ea-5d4e5f1f4bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:10.435296 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dac9ba-3bd4-46ce-83ea-5d4e5f1f4bc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:10.444938 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dac9ba-3bd4-46ce-83ea-5d4e5f1f4bc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:41:10.452948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-87dac9ba-3bd4-46ce-83ea-5d4e5f1f4bc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:41:10.452948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:10.452948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:41:10.452948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:41:10.452948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:41:10.452948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:41:10.452948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:41:10.452948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:41:10.452948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:41:10.452948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:41:10.452948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:41:10.452948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:41:10.452948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:41:10.452948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:41:10.452948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:41:10.452948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:41:10.454127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:41:10.454127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:41:10.454127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:41:10.454127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:41:10.454127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:41:10.454127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:41:10.454127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:41:10.454127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:41:10.454127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:41:10.454127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:41:10.454127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:41:10.454127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:41:10.454127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:41:10.454127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:41:10.454127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:41:10.454127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:41:10.455260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:41:10.455260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:41:10.455260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:41:10.455260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:41:10.455260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:41:10.455260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:41:10.455260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:41:10.455260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:41:10.455260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:41:10.455260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:41:10.455260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:41:10.455260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:41:10.455260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 643/1276] 10.222.0.93 () {56 vars in 1096 bytes} [Thu Jun 16 18:41:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:41:10.460741 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d7b36-4c9c-467e-8146-8fb560f33d38 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:10.539293 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:10.556799 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d7b36-4c9c-467e-8146-8fb560f33d38 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:10.589365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9de953-f891-430f-875c-53bd971e3dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:10.590037 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9de953-f891-430f-875c-53bd971e3dff None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:10.590319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9de953-f891-430f-875c-53bd971e3dff None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:10.590594 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9de953-f891-430f-875c-53bd971e3dff None admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:10.591338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9de953-f891-430f-875c-53bd971e3dff None admin] RBAC: Adding query filter params (name=admin) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:10.591641 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9de953-f891-430f-875c-53bd971e3dff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:10.593028 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9de953-f891-430f-875c-53bd971e3dff None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:10.600828 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 634/1277] 10.222.0.93 () {56 vars in 1099 bytes} [Thu Jun 16 18:41:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:10.607145 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dac9ba-3bd4-46ce-83ea-5d4e5f1f4bc1 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:10.706150 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dac9ba-3bd4-46ce-83ea-5d4e5f1f4bc1 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:10.738130 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89eb192-e390-489c-b3bc-ec11b298b8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:10.738912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89eb192-e390-489c-b3bc-ec11b298b8d4 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:10.739196 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89eb192-e390-489c-b3bc-ec11b298b8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:10.739466 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89eb192-e390-489c-b3bc-ec11b298b8d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:10.750170 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89eb192-e390-489c-b3bc-ec11b298b8d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:10.751846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89eb192-e390-489c-b3bc-ec11b298b8d4 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:10.768916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-b89eb192-e390-489c-b3bc-ec11b298b8d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:41:10.768916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:10.768916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:41:10.768916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:41:10.768916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:41:10.768916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:41:10.768916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:41:10.768916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:41:10.768916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:41:10.768916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:41:10.768916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:41:10.768916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:41:10.768916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:41:10.768916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:41:10.768916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:41:10.770026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:41:10.770026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:41:10.770026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:41:10.770026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:41:10.770026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:41:10.770026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:41:10.770026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:41:10.770026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:41:10.770026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:41:10.770026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:41:10.770026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:41:10.770026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:41:10.770026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:41:10.770026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:41:10.770026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:41:10.770026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:41:10.770026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:41:10.771133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:41:10.771133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:41:10.771133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:41:10.771133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:41:10.771133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 644/1278] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:41:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:41:10.775862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9de953-f891-430f-875c-53bd971e3dff None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:10.878449 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9de953-f891-430f-875c-53bd971e3dff None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:10.911500 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a559dc-4e6e-4484-a984-0596d5c3df51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:10.912157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a559dc-4e6e-4484-a984-0596d5c3df51 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:10.912465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a559dc-4e6e-4484-a984-0596d5c3df51 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:10.912741 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a559dc-4e6e-4484-a984-0596d5c3df51 None admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:10.913450 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a559dc-4e6e-4484-a984-0596d5c3df51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:10.913795 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a559dc-4e6e-4484-a984-0596d5c3df51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:10.915645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a559dc-4e6e-4484-a984-0596d5c3df51 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:10.927980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 635/1279] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:10.934161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89eb192-e390-489c-b3bc-ec11b298b8d4 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:10.964020 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:11.029857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89eb192-e390-489c-b3bc-ec11b298b8d4 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:11.063143 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c830b2-1839-471d-963a-4f36e6051115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:11.063955 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c830b2-1839-471d-963a-4f36e6051115 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:11.064241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c830b2-1839-471d-963a-4f36e6051115 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:11.064553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c830b2-1839-471d-963a-4f36e6051115 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:11.071802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c830b2-1839-471d-963a-4f36e6051115 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:11.073277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c830b2-1839-471d-963a-4f36e6051115 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:11.088592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-58c830b2-1839-471d-963a-4f36e6051115 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:41:11.088592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:11.088592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:41:11.088592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:41:11.088592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:41:11.088592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:41:11.088592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:41:11.088592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:41:11.088592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:41:11.088592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:41:11.088592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:41:11.088592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:41:11.088592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:41:11.088592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:41:11.088592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:41:11.088592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:41:11.089780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:41:11.089780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:41:11.089780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:41:11.089780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:41:11.089780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:41:11.089780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:41:11.089780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:41:11.089780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:41:11.089780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:41:11.089780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:41:11.089780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:41:11.089780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:41:11.089780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:41:11.089780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:41:11.089780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:41:11.089780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:41:11.089780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:41:11.089780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:41:11.090983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:41:11.090983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:41:11.090983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:41:11.090983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:41:11.090983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:41:11.090983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:41:11.090983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:41:11.090983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:41:11.090983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:41:11.090983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:41:11.090983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 645/1280] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:41:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:41:11.095620 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a559dc-4e6e-4484-a984-0596d5c3df51 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:11.099477 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:11.196023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a559dc-4e6e-4484-a984-0596d5c3df51 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:11.230962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8c108-ac41-4144-92f6-d46494a400f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:11.231575 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8c108-ac41-4144-92f6-d46494a400f5 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:11.231858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8c108-ac41-4144-92f6-d46494a400f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:11.232147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8c108-ac41-4144-92f6-d46494a400f5 None admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:11.233012 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8c108-ac41-4144-92f6-d46494a400f5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:11.233324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8c108-ac41-4144-92f6-d46494a400f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:11.234780 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8c108-ac41-4144-92f6-d46494a400f5 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:11.252809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 636/1281] 10.222.0.93 () {56 vars in 1143 bytes} [Thu Jun 16 18:41:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:11.259071 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c830b2-1839-471d-963a-4f36e6051115 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:11.351754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:11.360970 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c830b2-1839-471d-963a-4f36e6051115 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:11.394883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93451fb1-2691-468e-95b7-819ba2917819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:11.399422 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93451fb1-2691-468e-95b7-819ba2917819 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:11.399422 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93451fb1-2691-468e-95b7-819ba2917819 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:11.399422 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93451fb1-2691-468e-95b7-819ba2917819 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:11.459483 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93451fb1-2691-468e-95b7-819ba2917819 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:11.461009 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93451fb1-2691-468e-95b7-819ba2917819 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:11.553930 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 646/1282] 10.222.0.93 () {58 vars in 1282 bytes} [Thu Jun 16 18:41:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:41:11.560232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8c108-ac41-4144-92f6-d46494a400f5 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:11.565690 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:11.620362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:11.657289 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8c108-ac41-4144-92f6-d46494a400f5 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:11.691565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecc39c-0bce-4471-af41-3cbd4b58f48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:11.692455 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecc39c-0bce-4471-af41-3cbd4b58f48f None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:11.692771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecc39c-0bce-4471-af41-3cbd4b58f48f None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:11.693129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecc39c-0bce-4471-af41-3cbd4b58f48f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:11.703993 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecc39c-0bce-4471-af41-3cbd4b58f48f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:11.705506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecc39c-0bce-4471-af41-3cbd4b58f48f None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:11.722699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-53ecc39c-0bce-4471-af41-3cbd4b58f48f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:41:11.722699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:11.722699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:41:11.722699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:41:11.722699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:41:11.722699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:41:11.722699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:41:11.722699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:41:11.722699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:41:11.722699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:41:11.722699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:41:11.722699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:41:11.722699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:41:11.722699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:41:11.722699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:41:11.731126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:41:11.731126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:41:11.731126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:41:11.731126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:41:11.731126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:41:11.731126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:41:11.731126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:41:11.731126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:41:11.731126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:41:11.731126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:41:11.731126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:41:11.731126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:41:11.731126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:41:11.731126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:41:11.731126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:41:11.731126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:41:11.731126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:41:11.732255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:41:11.732255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:41:11.732255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:41:11.732255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:41:11.732255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 637/1283] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:41:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:41:11.732637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93451fb1-2691-468e-95b7-819ba2917819 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:11.831412 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93451fb1-2691-468e-95b7-819ba2917819 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:11.864886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed6791-7420-4ce4-b442-484276a3af95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:11.865542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed6791-7420-4ce4-b442-484276a3af95 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:11.865824 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed6791-7420-4ce4-b442-484276a3af95 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:11.866094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed6791-7420-4ce4-b442-484276a3af95 None admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:11.866807 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed6791-7420-4ce4-b442-484276a3af95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:11.867110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed6791-7420-4ce4-b442-484276a3af95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:11.869142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed6791-7420-4ce4-b442-484276a3af95 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:11.880454 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 647/1284] 10.222.0.93 () {56 vars in 1109 bytes} [Thu Jun 16 18:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:11.886139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecc39c-0bce-4471-af41-3cbd4b58f48f None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:11.984296 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecc39c-0bce-4471-af41-3cbd4b58f48f None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:11.998965 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:12.018729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98439d-77cb-4e7a-b457-ab086e505dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:12.019515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98439d-77cb-4e7a-b457-ab086e505dc6 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:12.019797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98439d-77cb-4e7a-b457-ab086e505dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:12.020072 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98439d-77cb-4e7a-b457-ab086e505dc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:12.027379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98439d-77cb-4e7a-b457-ab086e505dc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:12.028942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98439d-77cb-4e7a-b457-ab086e505dc6 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:12.043341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application [None req-4f98439d-77cb-4e7a-b457-ab086e505dc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:41:12.043341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:12.043341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:41:12.043341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:41:12.043341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:41:12.043341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:41:12.043341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:41:12.043341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:41:12.043341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:41:12.043341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:41:12.043341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:41:12.043341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:41:12.043341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:41:12.043341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:41:12.043341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:41:12.044497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:41:12.044497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:41:12.044497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:41:12.044497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:41:12.044497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:41:12.044497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:41:12.044497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:41:12.044497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:41:12.044497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application with Lock( Jun 16 18:41:12.044497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:41:12.044497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:41:12.044497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:41:12.044497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:41:12.044497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:41:12.044497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:41:12.044497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:41:12.044497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:41:12.045535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:41:12.045535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:41:12.045535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:41:12.045535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:41:12.045535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:41:12.045535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:41:12.045535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:41:12.045535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: ERROR keystone.server.flask.application Jun 16 18:41:12.045535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 638/1285] 10.222.0.93 () {56 vars in 1111 bytes} [Thu Jun 16 18:41:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:41:12.050584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed6791-7420-4ce4-b442-484276a3af95 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:12.099010 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:12.147967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed6791-7420-4ce4-b442-484276a3af95 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:12.180560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b6f4a-1789-4928-8f12-5a568689cba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:12.181216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b6f4a-1789-4928-8f12-5a568689cba9 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:12.181500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b6f4a-1789-4928-8f12-5a568689cba9 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:12.181775 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b6f4a-1789-4928-8f12-5a568689cba9 None admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:12.182554 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b6f4a-1789-4928-8f12-5a568689cba9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:12.182865 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b6f4a-1789-4928-8f12-5a568689cba9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:12.184295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b6f4a-1789-4928-8f12-5a568689cba9 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:12.195935 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 648/1286] 10.222.0.93 () {56 vars in 1148 bytes} [Thu Jun 16 18:41:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:12.201927 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98439d-77cb-4e7a-b457-ab086e505dc6 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:12.299198 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98439d-77cb-4e7a-b457-ab086e505dc6 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:12.332403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3820c04-f72f-4060-b96c-574a15ffb56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:12.333165 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3820c04-f72f-4060-b96c-574a15ffb56d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:12.333447 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3820c04-f72f-4060-b96c-574a15ffb56d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:12.333723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3820c04-f72f-4060-b96c-574a15ffb56d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:12.334546 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3820c04-f72f-4060-b96c-574a15ffb56d None admin] RBAC: Adding query filter params (role.id=416a52031d5d49b6a3fa0e9baa814436, scope.project.id=d6d43f779d67418baf199556b8e497c7, user.id=3abe1d47a1164776bf3a82fe4b129d9d) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:12.334859 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3820c04-f72f-4060-b96c-574a15ffb56d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:12.336277 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3820c04-f72f-4060-b96c-574a15ffb56d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:12.342683 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 639/1287] 10.222.0.93 () {56 vars in 1374 bytes} [Thu Jun 16 18:41:12 2022] GET /identity/v3/role_assignments?user.id=3abe1d47a1164776bf3a82fe4b129d9d&scope.project.id=d6d43f779d67418baf199556b8e497c7&role.id=416a52031d5d49b6a3fa0e9baa814436 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:14.476556 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4601e6-1acb-41ff-9799-b413f76dbc2e None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:14.477096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4601e6-1acb-41ff-9799-b413f76dbc2e None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:14.477210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4601e6-1acb-41ff-9799-b413f76dbc2e None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:14.479052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 649/1288] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:41:14.484187 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b4685-3823-4a6b-98f7-c7e16cf03a13 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:14.484621 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b4685-3823-4a6b-98f7-c7e16cf03a13 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:14.484783 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b4685-3823-4a6b-98f7-c7e16cf03a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:14.502201 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-949b4685-3823-4a6b-98f7-c7e16cf03a13 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:41:14.503385 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-949b4685-3823-4a6b-98f7-c7e16cf03a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:14.535263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:14.567976 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 640/1289] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:41:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:41:14.590979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4601e6-1acb-41ff-9799-b413f76dbc2e None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:14.690255 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4601e6-1acb-41ff-9799-b413f76dbc2e None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:14.700617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:14.723202 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3a986-53e8-4ce9-8ec7-4184ba621076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:14.723996 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3a986-53e8-4ce9-8ec7-4184ba621076 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:14.724276 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3a986-53e8-4ce9-8ec7-4184ba621076 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:14.724580 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3a986-53e8-4ce9-8ec7-4184ba621076 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:14.725228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3a986-53e8-4ce9-8ec7-4184ba621076 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:14.726587 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3a986-53e8-4ce9-8ec7-4184ba621076 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:14.738778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-c6c3a986-53e8-4ce9-8ec7-4184ba621076 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 18:41:14.738778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:14.738778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:41:14.738778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:41:14.738778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:41:14.738778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:41:14.738778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:41:14.738778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:41:14.738778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 18:41:14.738778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:41:14.738778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:41:14.738778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:41:14.738778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:14.738778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:41:14.738778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:41:14.738778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:41:14.738778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:41:14.740012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:41:14.740012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:41:14.740012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:41:14.740012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:41:14.740012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:41:14.740012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:41:14.740012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:41:14.740012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:41:14.740012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:41:14.740012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:41:14.740012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:41:14.740012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:41:14.740012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:41:14.740012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:41:14.740012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:41:14.740012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:41:14.741129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:41:14.741129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:41:14.741129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:41:14.741129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:41:14.741129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:41:14.741129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:41:14.741129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:41:14.741129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:41:14.741129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:41:14.741129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:41:14.741129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:41:14.741129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:41:14.741129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 18:41:14.741129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:41:14.741129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 650/1290] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Jun 16 18:41:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:41:14.746133 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b4685-3823-4a6b-98f7-c7e16cf03a13 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:14.843906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b4685-3823-4a6b-98f7-c7e16cf03a13 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:14.878907 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b15b4-5256-41a6-b1fb-b33ec90dfcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:14.879561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b15b4-5256-41a6-b1fb-b33ec90dfcde None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:14.879847 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b15b4-5256-41a6-b1fb-b33ec90dfcde None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:14.880124 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b15b4-5256-41a6-b1fb-b33ec90dfcde None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:14.880858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b15b4-5256-41a6-b1fb-b33ec90dfcde None admin] RBAC: Adding query filter params (name=placement) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:14.881168 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b15b4-5256-41a6-b1fb-b33ec90dfcde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:14.882554 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b15b4-5256-41a6-b1fb-b33ec90dfcde None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:14.887895 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 641/1291] 10.222.0.93 () {56 vars in 1116 bytes} [Thu Jun 16 18:41:14 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:41:14.893729 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3a986-53e8-4ce9-8ec7-4184ba621076 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:14.991067 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3a986-53e8-4ce9-8ec7-4184ba621076 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:15.024302 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2959c4d-bc6d-43d8-b2d5-5de5ff27e99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:15.025126 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2959c4d-bc6d-43d8-b2d5-5de5ff27e99d None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:15.025507 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2959c4d-bc6d-43d8-b2d5-5de5ff27e99d None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:15.025928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2959c4d-bc6d-43d8-b2d5-5de5ff27e99d None admin] PATH_INFO: `/v3/services` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:15.026800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2959c4d-bc6d-43d8-b2d5-5de5ff27e99d None admin] RBAC: Adding query filter params (type=placement) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:15.027202 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2959c4d-bc6d-43d8-b2d5-5de5ff27e99d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:15.028696 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2959c4d-bc6d-43d8-b2d5-5de5ff27e99d None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:15.033432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 651/1292] 10.222.0.93 () {56 vars in 1116 bytes} [Thu Jun 16 18:41:14 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:41:17.160745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e81948-e724-4d2e-a56f-ef489e99963b None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:17.161294 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e81948-e724-4d2e-a56f-ef489e99963b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:17.161294 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e81948-e724-4d2e-a56f-ef489e99963b None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:17.162669 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 642/1293] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:41:17.168328 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08149207-c48a-40eb-afc2-785bfaecfa5f None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:17.168788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08149207-c48a-40eb-afc2-785bfaecfa5f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:17.168930 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08149207-c48a-40eb-afc2-785bfaecfa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:17.186452 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-08149207-c48a-40eb-afc2-785bfaecfa5f None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:41:17.187664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-08149207-c48a-40eb-afc2-785bfaecfa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:17.217599 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:17.254107 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 652/1294] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:41:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:41:17.277962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e81948-e724-4d2e-a56f-ef489e99963b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:17.309101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:17.379088 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e81948-e724-4d2e-a56f-ef489e99963b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:17.412748 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69238b-17d4-491c-af29-ca1011b806b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:17.413350 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69238b-17d4-491c-af29-ca1011b806b7 None admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:17.413637 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69238b-17d4-491c-af29-ca1011b806b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:17.413919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69238b-17d4-491c-af29-ca1011b806b7 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:17.414660 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69238b-17d4-491c-af29-ca1011b806b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:17.416031 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69238b-17d4-491c-af29-ca1011b806b7 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:17.502041 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 643/1295] 10.222.0.93 () {60 vars in 1141 bytes} [Thu Jun 16 18:41:17 2022] POST /identity/v3/services => generated 246 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:41:19.631344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb58ce-0237-4135-b03c-4f1e85ecceb7 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:19.631859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb58ce-0237-4135-b03c-4f1e85ecceb7 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:19.631859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb58ce-0237-4135-b03c-4f1e85ecceb7 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:19.633433 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 653/1296] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:41:19.638329 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4b684-e6fa-4e65-817c-c7a637072173 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:19.638757 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4b684-e6fa-4e65-817c-c7a637072173 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:19.638883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4b684-e6fa-4e65-817c-c7a637072173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:19.655686 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5dd4b684-e6fa-4e65-817c-c7a637072173 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:41:19.656910 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5dd4b684-e6fa-4e65-817c-c7a637072173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:19.728834 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 644/1297] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:41:19 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:41:19.751955 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb58ce-0237-4135-b03c-4f1e85ecceb7 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:19.865415 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb58ce-0237-4135-b03c-4f1e85ecceb7 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:19.905460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2c3db-22dd-4e12-8e21-d9ae712dac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:19.906184 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2c3db-22dd-4e12-8e21-d9ae712dac23 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:19.906467 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2c3db-22dd-4e12-8e21-d9ae712dac23 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:19.906738 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2c3db-22dd-4e12-8e21-d9ae712dac23 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:19.907414 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2c3db-22dd-4e12-8e21-d9ae712dac23 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:19.908811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2c3db-22dd-4e12-8e21-d9ae712dac23 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:19.920928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-a4c2c3db-22dd-4e12-8e21-d9ae712dac23 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 18:41:19.920928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:19.920928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:41:19.920928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:41:19.920928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:41:19.920928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:41:19.920928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:41:19.920928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:41:19.920928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 18:41:19.920928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:41:19.920928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:41:19.920928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:41:19.920928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:19.920928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:41:19.920928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:41:19.920928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:41:19.920928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:41:19.925295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:41:19.925295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:41:19.925295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:41:19.925295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:41:19.925295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:41:19.925295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:41:19.925295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:41:19.925295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:41:19.925295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:41:19.925295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:41:19.925295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:41:19.925295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:41:19.925295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:41:19.925295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:41:19.925295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:41:19.925295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:41:19.926357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:41:19.926357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:41:19.926357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:41:19.926357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:41:19.926357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:41:19.926357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:41:19.926357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:41:19.926357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:41:19.926357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:41:19.926357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:41:19.926357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:41:19.926357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:41:19.926357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 18:41:19.926357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:41:19.926357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 654/1298] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Jun 16 18:41:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:41:19.928138 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4b684-e6fa-4e65-817c-c7a637072173 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:19.945895 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:20.022955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4b684-e6fa-4e65-817c-c7a637072173 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:20.057361 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464f907-fcbb-413e-a58d-52a98a9ef970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:20.058024 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464f907-fcbb-413e-a58d-52a98a9ef970 None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:20.058306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464f907-fcbb-413e-a58d-52a98a9ef970 None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:20.058578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464f907-fcbb-413e-a58d-52a98a9ef970 None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:20.059282 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464f907-fcbb-413e-a58d-52a98a9ef970 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:20.059589 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464f907-fcbb-413e-a58d-52a98a9ef970 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:20.060990 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464f907-fcbb-413e-a58d-52a98a9ef970 None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:20.066726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 645/1299] 10.222.0.93 () {56 vars in 1116 bytes} [Thu Jun 16 18:41:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:20.072786 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2c3db-22dd-4e12-8e21-d9ae712dac23 None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:20.103795 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:20.168677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2c3db-22dd-4e12-8e21-d9ae712dac23 None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:20.201606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a492db-e8d7-4356-a407-836e2a1bc565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:20.202258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a492db-e8d7-4356-a407-836e2a1bc565 None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:20.202537 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a492db-e8d7-4356-a407-836e2a1bc565 None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:20.209836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a492db-e8d7-4356-a407-836e2a1bc565 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:20.209836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a492db-e8d7-4356-a407-836e2a1bc565 None admin] RBAC: Adding query filter params (interface=public, service_id=6af987103bdb45fbb7118d712b933163, region_id=RegionOne) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:20.209836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a492db-e8d7-4356-a407-836e2a1bc565 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:20.209836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a492db-e8d7-4356-a407-836e2a1bc565 None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:20.213630 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 655/1300] 10.222.0.93 () {56 vars in 1251 bytes} [Thu Jun 16 18:41:20 2022] GET /identity/v3/endpoints?service_id=6af987103bdb45fbb7118d712b933163&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:20.219468 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464f907-fcbb-413e-a58d-52a98a9ef970 None admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:20.307775 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:20.324940 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464f907-fcbb-413e-a58d-52a98a9ef970 None admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:20.357771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f138af9-70a7-4be5-8575-9aa2dc335a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:20.358429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f138af9-70a7-4be5-8575-9aa2dc335a4b None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:20.358711 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f138af9-70a7-4be5-8575-9aa2dc335a4b None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:20.359025 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f138af9-70a7-4be5-8575-9aa2dc335a4b None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:20.359704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f138af9-70a7-4be5-8575-9aa2dc335a4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:20.361096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f138af9-70a7-4be5-8575-9aa2dc335a4b None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:20.369260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 646/1301] 10.222.0.93 () {56 vars in 1087 bytes} [Thu Jun 16 18:41:20 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:41:22.496398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719cfbd-fe32-4d33-bb50-9f7e624539b3 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:22.496958 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719cfbd-fe32-4d33-bb50-9f7e624539b3 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:22.497046 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719cfbd-fe32-4d33-bb50-9f7e624539b3 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:22.498371 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 656/1302] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:41:22.503960 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db3440-c451-4f6e-9667-001a338ff2c3 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:22.504389 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db3440-c451-4f6e-9667-001a338ff2c3 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:22.504613 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db3440-c451-4f6e-9667-001a338ff2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:22.520906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-54db3440-c451-4f6e-9667-001a338ff2c3 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:41:22.521978 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-54db3440-c451-4f6e-9667-001a338ff2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:22.589349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 647/1303] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:41:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:41:22.613024 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719cfbd-fe32-4d33-bb50-9f7e624539b3 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:22.707447 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:22.714003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719cfbd-fe32-4d33-bb50-9f7e624539b3 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:22.747506 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d7f4c-9200-4688-aa63-408ae6d365ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:22.748301 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d7f4c-9200-4688-aa63-408ae6d365ae None admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:22.748613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d7f4c-9200-4688-aa63-408ae6d365ae None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:22.748889 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d7f4c-9200-4688-aa63-408ae6d365ae None admin] PATH_INFO: `/v3/services/placement` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:22.749532 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d7f4c-9200-4688-aa63-408ae6d365ae None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:22.751141 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d7f4c-9200-4688-aa63-408ae6d365ae None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:22.763023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application [None req-6b6d7f4c-9200-4688-aa63-408ae6d365ae None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 18:41:22.763023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:22.763023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:41:22.763023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:41:22.763023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:41:22.763023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:41:22.763023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:41:22.763023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:41:22.763023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 18:41:22.763023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:41:22.763023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:41:22.763023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:41:22.763023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:41:22.763023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:41:22.763023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:41:22.763023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:41:22.763023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:41:22.764271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:41:22.764271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:41:22.764271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:41:22.764271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:41:22.764271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:41:22.764271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:41:22.764271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:41:22.764271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:41:22.764271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:41:22.764271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:41:22.764271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:41:22.764271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:41:22.764271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:41:22.764271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:41:22.764271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:41:22.764271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:41:22.765434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:41:22.765434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application with Lock( Jun 16 18:41:22.765434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:41:22.765434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:41:22.765434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:41:22.765434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:41:22.765434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:41:22.765434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:41:22.765434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:41:22.765434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:41:22.765434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:41:22.765434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:41:22.765434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 18:41:22.765434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: ERROR keystone.server.flask.application Jun 16 18:41:22.765434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 657/1304] 10.222.0.93 () {56 vars in 1117 bytes} [Thu Jun 16 18:41:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:41:22.770489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db3440-c451-4f6e-9667-001a338ff2c3 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:22.855024 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:22.879228 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db3440-c451-4f6e-9667-001a338ff2c3 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:22.919511 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433d9ed-521e-4782-97c5-8b34ed451b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:22.920203 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433d9ed-521e-4782-97c5-8b34ed451b8d None admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:22.920524 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433d9ed-521e-4782-97c5-8b34ed451b8d None admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:22.920810 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433d9ed-521e-4782-97c5-8b34ed451b8d None admin] PATH_INFO: `/v3/services` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:22.921538 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433d9ed-521e-4782-97c5-8b34ed451b8d None admin] RBAC: Adding query filter params (name=placement) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:41:22.921852 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433d9ed-521e-4782-97c5-8b34ed451b8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:22.923252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433d9ed-521e-4782-97c5-8b34ed451b8d None admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:22.929121 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 648/1305] 10.222.0.93 () {56 vars in 1116 bytes} [Thu Jun 16 18:41:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:41:22.935487 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d7f4c-9200-4688-aa63-408ae6d365ae None admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:23.041171 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d7f4c-9200-4688-aa63-408ae6d365ae None admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:23.075264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544be320-0add-4ef6-8d56-09aa05c42bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:23.075937 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544be320-0add-4ef6-8d56-09aa05c42bcf None admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:23.076222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544be320-0add-4ef6-8d56-09aa05c42bcf None admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:23.076526 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544be320-0add-4ef6-8d56-09aa05c42bcf None admin] PATH_INFO: `/v3/endpoints` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:23.077288 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544be320-0add-4ef6-8d56-09aa05c42bcf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:23.078670 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544be320-0add-4ef6-8d56-09aa05c42bcf None admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:23.189748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 658/1306] 10.222.0.93 () {60 vars in 1144 bytes} [Thu Jun 16 18:41:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:41:33.023837 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=30 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:33.184663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:22.123751 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18322b4b-17c0-432d-a38b-4c04daa4a505 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:22.124315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18322b4b-17c0-432d-a38b-4c04daa4a505 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:22.124315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18322b4b-17c0-432d-a38b-4c04daa4a505 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:22.133354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f2123-8d0a-4e47-8e90-46a46310483f None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:22.133929 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f2123-8d0a-4e47-8e90-46a46310483f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:22.134175 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f2123-8d0a-4e47-8e90-46a46310483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:22.136764 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 649/1307] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:48:22 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:22.213679 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-004f2123-8d0a-4e47-8e90-46a46310483f None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:22.214975 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-004f2123-8d0a-4e47-8e90-46a46310483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:22.351161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 659/1308] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:22.385945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11698762-08f6-46de-9dc6-646d9c67f6da None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:22.385945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11698762-08f6-46de-9dc6-646d9c67f6da None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:22.385945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11698762-08f6-46de-9dc6-646d9c67f6da None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:22.385945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 650/1309] 10.222.0.93 () {54 vars in 964 bytes} [Thu Jun 16 18:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:22.392081 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c836989-8368-4d7d-9adf-5f40f528a394 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:22.392376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c836989-8368-4d7d-9adf-5f40f528a394 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:22.392708 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c836989-8368-4d7d-9adf-5f40f528a394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:22.539977 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-2c836989-8368-4d7d-9adf-5f40f528a394 None None] MFA Rules not processed for user `753728a82bdb406892015f8373932ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:22.541757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2c836989-8368-4d7d-9adf-5f40f528a394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:22.572595 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:22.673500 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11698762-08f6-46de-9dc6-646d9c67f6da None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:22.675875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-11698762-08f6-46de-9dc6-646d9c67f6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:22.684525 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 660/1310] 10.222.0.93 () {58 vars in 1061 bytes} [Thu Jun 16 18:48:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:22.825391 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11698762-08f6-46de-9dc6-646d9c67f6da None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:22.916152 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa368481-ab4f-4566-bd42-2846f2ae61aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:22.916762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa368481-ab4f-4566-bd42-2846f2ae61aa service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:22.917050 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa368481-ab4f-4566-bd42-2846f2ae61aa service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:22.917326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa368481-ab4f-4566-bd42-2846f2ae61aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:22.919029 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-aa368481-ab4f-4566-bd42-2846f2ae61aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:22.975671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:23.033235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa368481-ab4f-4566-bd42-2846f2ae61aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:23.034693 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa368481-ab4f-4566-bd42-2846f2ae61aa service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:23.055400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 651/1311] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:48:25.493621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad51e2d-70dd-498c-a443-f051a8767e2d None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:25.494160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad51e2d-70dd-498c-a443-f051a8767e2d None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:25.494160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad51e2d-70dd-498c-a443-f051a8767e2d None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:25.495700 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 661/1312] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:25.500900 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872d2bd-6363-45e4-8cc9-c64c893a38a9 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:25.501588 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872d2bd-6363-45e4-8cc9-c64c893a38a9 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:25.501728 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872d2bd-6363-45e4-8cc9-c64c893a38a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:25.592479 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6872d2bd-6363-45e4-8cc9-c64c893a38a9 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:25.594176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6872d2bd-6363-45e4-8cc9-c64c893a38a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:25.712480 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 652/1313] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:25.766264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119760a7-1fd1-4cd9-8b0e-776120a8759c None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:25.766713 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119760a7-1fd1-4cd9-8b0e-776120a8759c None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:25.767106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119760a7-1fd1-4cd9-8b0e-776120a8759c None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:25.768699 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 662/1314] 10.222.0.93 () {54 vars in 964 bytes} [Thu Jun 16 18:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:25.775995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f88eb-0b2c-4718-b051-0dbb1befcf09 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:25.776342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f88eb-0b2c-4718-b051-0dbb1befcf09 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:25.776621 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f88eb-0b2c-4718-b051-0dbb1befcf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:25.788483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:25.861237 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-cc1f88eb-0b2c-4718-b051-0dbb1befcf09 None None] MFA Rules not processed for user `753728a82bdb406892015f8373932ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:25.862590 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cc1f88eb-0b2c-4718-b051-0dbb1befcf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:25.946309 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 653/1315] 10.222.0.93 () {58 vars in 1061 bytes} [Thu Jun 16 18:48:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:25.955727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119760a7-1fd1-4cd9-8b0e-776120a8759c None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:25.957971 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-119760a7-1fd1-4cd9-8b0e-776120a8759c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:26.059896 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119760a7-1fd1-4cd9-8b0e-776120a8759c None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:26.134084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:26.136658 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a46fb-f2f0-4b2d-8eb8-a28b04603e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:26.137309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a46fb-f2f0-4b2d-8eb8-a28b04603e83 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:26.137593 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a46fb-f2f0-4b2d-8eb8-a28b04603e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:26.137872 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a46fb-f2f0-4b2d-8eb8-a28b04603e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:26.139517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-036a46fb-f2f0-4b2d-8eb8-a28b04603e83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:26.244415 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a46fb-f2f0-4b2d-8eb8-a28b04603e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:26.245871 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a46fb-f2f0-4b2d-8eb8-a28b04603e83 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:26.266208 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 663/1316] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:48:29.090724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6924b-2558-4dcf-8742-f111bbdc3409 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:29.091277 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6924b-2558-4dcf-8742-f111bbdc3409 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:29.091277 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6924b-2558-4dcf-8742-f111bbdc3409 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:29.092662 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 654/1317] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:29.098299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa14cd-7bf5-449a-bd57-79625bdda2ea None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:29.098760 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa14cd-7bf5-449a-bd57-79625bdda2ea None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:29.098857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa14cd-7bf5-449a-bd57-79625bdda2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:29.160970 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-adaa14cd-7bf5-449a-bd57-79625bdda2ea None None] MFA Rules not processed for user `59620a79bdb14f1e91544e1d0944daf9`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:29.162149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-adaa14cd-7bf5-449a-bd57-79625bdda2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:29.211448 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:29.255609 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 664/1318] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:48:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:29.296512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6924b-2558-4dcf-8742-f111bbdc3409 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:29.298075 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-45c6924b-2558-4dcf-8742-f111bbdc3409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:29.399771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6924b-2558-4dcf-8742-f111bbdc3409 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:29.402536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:29.471986 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c009fd-8388-46c6-9b40-5b7e884b47a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:29.473214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c009fd-8388-46c6-9b40-5b7e884b47a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:29.473500 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c009fd-8388-46c6-9b40-5b7e884b47a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:29.473776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c009fd-8388-46c6-9b40-5b7e884b47a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:29.475429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-04c009fd-8388-46c6-9b40-5b7e884b47a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:29.580523 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c009fd-8388-46c6-9b40-5b7e884b47a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:29.582500 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c009fd-8388-46c6-9b40-5b7e884b47a6 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:29.602068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 655/1319] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:48:32.500350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93aa4a-be17-47f1-a2b4-e97ea79c4879 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:32.501143 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93aa4a-be17-47f1-a2b4-e97ea79c4879 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:32.501303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93aa4a-be17-47f1-a2b4-e97ea79c4879 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:32.502770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 665/1320] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:48:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:32.508629 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1148b-f5b0-42bb-b54a-72bfd849f55e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:32.509104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1148b-f5b0-42bb-b54a-72bfd849f55e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:32.509347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1148b-f5b0-42bb-b54a-72bfd849f55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:32.547663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:32.572986 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-11d1148b-f5b0-42bb-b54a-72bfd849f55e None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:32.574192 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-11d1148b-f5b0-42bb-b54a-72bfd849f55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:32.677696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 656/1321] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:48:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:32.715617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93aa4a-be17-47f1-a2b4-e97ea79c4879 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:32.717194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-1b93aa4a-be17-47f1-a2b4-e97ea79c4879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:32.816291 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93aa4a-be17-47f1-a2b4-e97ea79c4879 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:32.886795 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8580eda-80d9-406d-a09d-9328dc5d577b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:32.887441 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8580eda-80d9-406d-a09d-9328dc5d577b service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:32.887721 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8580eda-80d9-406d-a09d-9328dc5d577b service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:32.887992 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8580eda-80d9-406d-a09d-9328dc5d577b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:32.889650 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c8580eda-80d9-406d-a09d-9328dc5d577b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:32.898081 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:32.996562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8580eda-80d9-406d-a09d-9328dc5d577b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:32.998002 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8580eda-80d9-406d-a09d-9328dc5d577b service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:33.016553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 666/1322] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:48:36.497038 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c56d2-49f2-444e-9acc-5e12fd435774 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:36.497547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c56d2-49f2-444e-9acc-5e12fd435774 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:36.497547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c56d2-49f2-444e-9acc-5e12fd435774 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:36.499008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 657/1323] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:36.504244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169e705-2355-4cc8-aa4e-4fd3f9f974e3 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:36.504707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169e705-2355-4cc8-aa4e-4fd3f9f974e3 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:36.504870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169e705-2355-4cc8-aa4e-4fd3f9f974e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:36.569070 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-9169e705-2355-4cc8-aa4e-4fd3f9f974e3 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:36.570266 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-9169e705-2355-4cc8-aa4e-4fd3f9f974e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:36.627859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:36.666275 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 667/1324] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:36.705219 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c56d2-49f2-444e-9acc-5e12fd435774 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:36.706752 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-720c56d2-49f2-444e-9acc-5e12fd435774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:36.816858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c56d2-49f2-444e-9acc-5e12fd435774 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:36.829597 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:36.895608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b494372-e2d2-4019-946d-be2c3b7f4962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:36.896695 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b494372-e2d2-4019-946d-be2c3b7f4962 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:36.896695 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b494372-e2d2-4019-946d-be2c3b7f4962 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:36.896915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b494372-e2d2-4019-946d-be2c3b7f4962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:36.898476 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0b494372-e2d2-4019-946d-be2c3b7f4962 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:37.009532 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b494372-e2d2-4019-946d-be2c3b7f4962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:37.010970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b494372-e2d2-4019-946d-be2c3b7f4962 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:37.029777 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 658/1325] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:48:39.328335 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d855ca8-a567-4d81-ad34-a540b33f7302 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:39.328886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d855ca8-a567-4d81-ad34-a540b33f7302 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:39.328886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d855ca8-a567-4d81-ad34-a540b33f7302 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:39.330272 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 668/1326] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:39.335696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9f3af-9cfa-4875-9684-e06a165acbc1 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:39.336145 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9f3af-9cfa-4875-9684-e06a165acbc1 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:39.336410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9f3af-9cfa-4875-9684-e06a165acbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:39.388788 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:39.406732 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6ed9f3af-9cfa-4875-9684-e06a165acbc1 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:39.408075 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6ed9f3af-9cfa-4875-9684-e06a165acbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:39.509323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 659/1327] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:39.544838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d855ca8-a567-4d81-ad34-a540b33f7302 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:39.546372 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-3d855ca8-a567-4d81-ad34-a540b33f7302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:39.649713 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d855ca8-a567-4d81-ad34-a540b33f7302 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:39.727099 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac5dfc-ed93-44db-8397-dde02b3dcea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:39.727777 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac5dfc-ed93-44db-8397-dde02b3dcea7 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:39.728064 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac5dfc-ed93-44db-8397-dde02b3dcea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:39.728340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac5dfc-ed93-44db-8397-dde02b3dcea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:39.730127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2aac5dfc-ed93-44db-8397-dde02b3dcea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:39.748576 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:39.840711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac5dfc-ed93-44db-8397-dde02b3dcea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:39.842165 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac5dfc-ed93-44db-8397-dde02b3dcea7 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:39.860766 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 669/1328] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:48:42.053925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d87bf-34c3-4e7b-bd18-5cd557f63b31 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:42.054438 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d87bf-34c3-4e7b-bd18-5cd557f63b31 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:42.054438 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d87bf-34c3-4e7b-bd18-5cd557f63b31 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:42.055777 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 660/1329] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:42.061152 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de9a5a-d86e-4f3f-af7c-68e8d471ea4f None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:42.061625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de9a5a-d86e-4f3f-af7c-68e8d471ea4f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:42.061852 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de9a5a-d86e-4f3f-af7c-68e8d471ea4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:42.128065 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-47de9a5a-d86e-4f3f-af7c-68e8d471ea4f None None] MFA Rules not processed for user `59620a79bdb14f1e91544e1d0944daf9`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:42.129292 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-47de9a5a-d86e-4f3f-af7c-68e8d471ea4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:42.192997 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:42.225210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 670/1330] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:48:42 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:42.262029 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d87bf-34c3-4e7b-bd18-5cd557f63b31 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:42.263552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-534d87bf-34c3-4e7b-bd18-5cd557f63b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:42.368271 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d87bf-34c3-4e7b-bd18-5cd557f63b31 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:42.388673 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:42.440956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912600fb-d31d-40cc-be3d-1ace6af01471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:42.441594 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912600fb-d31d-40cc-be3d-1ace6af01471 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:42.441871 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912600fb-d31d-40cc-be3d-1ace6af01471 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:42.442139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912600fb-d31d-40cc-be3d-1ace6af01471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:42.443772 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-912600fb-d31d-40cc-be3d-1ace6af01471 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:42.577034 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912600fb-d31d-40cc-be3d-1ace6af01471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:42.578491 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912600fb-d31d-40cc-be3d-1ace6af01471 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:42.598186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 661/1331] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:42 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:48:45.440961 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b3a03-fb68-4cf0-b93c-2227078a036d None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:45.441528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b3a03-fb68-4cf0-b93c-2227078a036d None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:45.441659 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b3a03-fb68-4cf0-b93c-2227078a036d None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:45.443037 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 671/1332] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:45.448254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3527eca-ae55-4258-9f16-101a383349a3 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:45.448688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3527eca-ae55-4258-9f16-101a383349a3 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:45.448879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3527eca-ae55-4258-9f16-101a383349a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:45.514019 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:45.516695 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c3527eca-ae55-4258-9f16-101a383349a3 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:45.517912 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c3527eca-ae55-4258-9f16-101a383349a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:45.617932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 662/1333] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:45.653817 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b3a03-fb68-4cf0-b93c-2227078a036d None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:45.655383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-3c8b3a03-fb68-4cf0-b93c-2227078a036d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:45.760037 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b3a03-fb68-4cf0-b93c-2227078a036d None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:45.835952 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c6811-ce78-4ff0-8e41-a7033d941353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:45.836644 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c6811-ce78-4ff0-8e41-a7033d941353 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:45.836934 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c6811-ce78-4ff0-8e41-a7033d941353 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:45.837214 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c6811-ce78-4ff0-8e41-a7033d941353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:45.838870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-bd1c6811-ce78-4ff0-8e41-a7033d941353 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:45.869214 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:45.948775 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c6811-ce78-4ff0-8e41-a7033d941353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:45.950218 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c6811-ce78-4ff0-8e41-a7033d941353 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:45.968605 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 672/1334] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:48:48.174892 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34199761-61b9-418a-96d7-a8c5f161c837 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:48.175454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34199761-61b9-418a-96d7-a8c5f161c837 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:48.175454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34199761-61b9-418a-96d7-a8c5f161c837 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:48.176924 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 663/1335] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:48:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:48.182131 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146a70b-a6c3-4438-901b-bd90dd19b817 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:48.182522 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146a70b-a6c3-4438-901b-bd90dd19b817 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:48.182688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146a70b-a6c3-4438-901b-bd90dd19b817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:48.245823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-9146a70b-a6c3-4438-901b-bd90dd19b817 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:48.247020 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-9146a70b-a6c3-4438-901b-bd90dd19b817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:48.321902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:48.342493 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 673/1336] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:48.383137 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34199761-61b9-418a-96d7-a8c5f161c837 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:48.384731 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-34199761-61b9-418a-96d7-a8c5f161c837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:48.484918 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34199761-61b9-418a-96d7-a8c5f161c837 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:48.512903 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:48.557850 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a172610-dc67-47b1-8d7d-c05f233f9fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:48.558498 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a172610-dc67-47b1-8d7d-c05f233f9fad service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:48.558784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a172610-dc67-47b1-8d7d-c05f233f9fad service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:48.559061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a172610-dc67-47b1-8d7d-c05f233f9fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:48.560740 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8a172610-dc67-47b1-8d7d-c05f233f9fad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:48.665929 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a172610-dc67-47b1-8d7d-c05f233f9fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:48.667286 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a172610-dc67-47b1-8d7d-c05f233f9fad service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:48.685228 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 664/1337] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:48:51.530005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf7b3a-f786-4551-b792-230aa5f55408 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:51.530579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf7b3a-f786-4551-b792-230aa5f55408 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:51.530579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf7b3a-f786-4551-b792-230aa5f55408 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:51.531881 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 674/1338] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:51.537052 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2b5be-ae6f-4c57-a216-7edd10b5032c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:51.537467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2b5be-ae6f-4c57-a216-7edd10b5032c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:51.537611 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2b5be-ae6f-4c57-a216-7edd10b5032c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:51.608968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-8fb2b5be-ae6f-4c57-a216-7edd10b5032c None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:51.610191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8fb2b5be-ae6f-4c57-a216-7edd10b5032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:51.618436 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:51.711786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 665/1339] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:48:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:51.747453 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf7b3a-f786-4551-b792-230aa5f55408 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:51.749000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-fbdf7b3a-f786-4551-b792-230aa5f55408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:51.848723 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf7b3a-f786-4551-b792-230aa5f55408 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:51.918761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd38439-3863-45e9-af8d-1e66638b07e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:51.919404 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd38439-3863-45e9-af8d-1e66638b07e7 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:51.919681 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd38439-3863-45e9-af8d-1e66638b07e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:51.919953 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd38439-3863-45e9-af8d-1e66638b07e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:51.921615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-fcd38439-3863-45e9-af8d-1e66638b07e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:51.956820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:52.028767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd38439-3863-45e9-af8d-1e66638b07e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:52.030205 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd38439-3863-45e9-af8d-1e66638b07e7 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:52.048278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 675/1340] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:48:56.629411 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c64425-a09d-47a3-a229-b833dbc3f304 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:56.629960 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c64425-a09d-47a3-a229-b833dbc3f304 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:56.629960 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c64425-a09d-47a3-a229-b833dbc3f304 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:56.631356 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 666/1341] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:56.636764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a71f75-5d01-48d2-8be4-29a7910b4c26 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:56.637228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a71f75-5d01-48d2-8be4-29a7910b4c26 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:56.637319 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a71f75-5d01-48d2-8be4-29a7910b4c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:56.712675 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-78a71f75-5d01-48d2-8be4-29a7910b4c26 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:56.713779 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-78a71f75-5d01-48d2-8be4-29a7910b4c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:56.812569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:56.825234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 676/1342] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:56.864400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c64425-a09d-47a3-a229-b833dbc3f304 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:56.866575 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-92c64425-a09d-47a3-a229-b833dbc3f304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:56.965994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c64425-a09d-47a3-a229-b833dbc3f304 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:56.969553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24a9b1-14ab-49ec-b8f8-240804086a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:56.970206 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24a9b1-14ab-49ec-b8f8-240804086a06 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:56.970552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24a9b1-14ab-49ec-b8f8-240804086a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:56.971326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24a9b1-14ab-49ec-b8f8-240804086a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:56.980345 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24a9b1-14ab-49ec-b8f8-240804086a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:56.981803 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24a9b1-14ab-49ec-b8f8-240804086a06 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:56.991745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 667/1343] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:00.132565 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e81bf-f575-48a8-acbc-ea16dfec8eb8 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:00.134853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e81bf-f575-48a8-acbc-ea16dfec8eb8 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:00.134853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e81bf-f575-48a8-acbc-ea16dfec8eb8 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:00.134853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 677/1344] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:00.139646 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e850790-e6ca-4bdf-94dc-5b12677291f0 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:00.140078 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e850790-e6ca-4bdf-94dc-5b12677291f0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:00.140187 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e850790-e6ca-4bdf-94dc-5b12677291f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:00.167475 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-2e850790-e6ca-4bdf-94dc-5b12677291f0 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:00.168667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2e850790-e6ca-4bdf-94dc-5b12677291f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:00.199896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:00.251957 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 668/1345] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:49:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:00.289579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e81bf-f575-48a8-acbc-ea16dfec8eb8 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:49:00.300804 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e81bf-f575-48a8-acbc-ea16dfec8eb8 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:49:00.304283 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730a237-4ebd-4242-a3b7-db514dc88a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:49:00.304958 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730a237-4ebd-4242-a3b7-db514dc88a9d service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:00.305245 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730a237-4ebd-4242-a3b7-db514dc88a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:00.305523 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730a237-4ebd-4242-a3b7-db514dc88a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:00.314492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730a237-4ebd-4242-a3b7-db514dc88a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:49:00.315960 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730a237-4ebd-4242-a3b7-db514dc88a9d service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:49:00.325940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 678/1346] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:49:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:04.828048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ac2f0-8de7-4958-a858-0c76567503b4 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:04.828048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ac2f0-8de7-4958-a858-0c76567503b4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:04.828048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ac2f0-8de7-4958-a858-0c76567503b4 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:04.828729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 669/1347] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:04.834002 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05690d-83aa-47f8-9103-6dbcd8e69b57 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:04.834411 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05690d-83aa-47f8-9103-6dbcd8e69b57 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:04.834612 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05690d-83aa-47f8-9103-6dbcd8e69b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:04.870338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-3c05690d-83aa-47f8-9103-6dbcd8e69b57 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:04.871570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-3c05690d-83aa-47f8-9103-6dbcd8e69b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:04.881148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 679/1348] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:04.919472 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ac2f0-8de7-4958-a858-0c76567503b4 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:49:04.921229 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-188ac2f0-8de7-4958-a858-0c76567503b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:04.934520 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ac2f0-8de7-4958-a858-0c76567503b4 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:49:04.938025 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef19301-ab0c-4635-add5-a93b73bcfcf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:49:04.938722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef19301-ab0c-4635-add5-a93b73bcfcf3 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:04.939010 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef19301-ab0c-4635-add5-a93b73bcfcf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:04.939293 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef19301-ab0c-4635-add5-a93b73bcfcf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:04.949726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef19301-ab0c-4635-add5-a93b73bcfcf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:49:04.951185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef19301-ab0c-4635-add5-a93b73bcfcf3 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:49:04.962583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 670/1349] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:10.003475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d914969-5681-4df7-8120-d844199bbff9 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:10.003475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d914969-5681-4df7-8120-d844199bbff9 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:10.003475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d914969-5681-4df7-8120-d844199bbff9 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:10.003475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 680/1350] 10.222.0.93 () {54 vars in 921 bytes} [Thu Jun 16 18:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:10.004214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5630a8-bcfb-4eaa-9c8d-2c2af12cec2e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:10.004612 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5630a8-bcfb-4eaa-9c8d-2c2af12cec2e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:10.004612 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5630a8-bcfb-4eaa-9c8d-2c2af12cec2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:10.075480 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-8c5630a8-bcfb-4eaa-9c8d-2c2af12cec2e None None] MFA Rules not processed for user `3abe1d47a1164776bf3a82fe4b129d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:10.076699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8c5630a8-bcfb-4eaa-9c8d-2c2af12cec2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:10.159588 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 671/1351] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Jun 16 18:49:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:14.337037 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c967ce-e560-4e23-8360-08441f85bf4f None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:14.337570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c967ce-e560-4e23-8360-08441f85bf4f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:14.337570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c967ce-e560-4e23-8360-08441f85bf4f None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:14.339233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 681/1352] 10.222.0.93 () {54 vars in 921 bytes} [Thu Jun 16 18:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:14.346050 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb97ec3-46ef-4f1e-be1b-a06833245e54 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:14.346458 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb97ec3-46ef-4f1e-be1b-a06833245e54 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:14.346600 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb97ec3-46ef-4f1e-be1b-a06833245e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:14.364261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-8bb97ec3-46ef-4f1e-be1b-a06833245e54 None None] MFA Rules not processed for user `3abe1d47a1164776bf3a82fe4b129d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:14.365467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8bb97ec3-46ef-4f1e-be1b-a06833245e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:14.374155 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 672/1353] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Jun 16 18:49:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:14.859700 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=13 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:16.006549 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e1ff9-237a-44ff-b23c-86b042bba4a1 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:16.007210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e1ff9-237a-44ff-b23c-86b042bba4a1 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:16.007210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e1ff9-237a-44ff-b23c-86b042bba4a1 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:16.008749 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 682/1354] 10.222.0.93 () {54 vars in 921 bytes} [Thu Jun 16 18:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:16.013427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f919123-92ee-4c57-bef5-9621db2839fb None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:16.013847 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f919123-92ee-4c57-bef5-9621db2839fb None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:16.014072 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f919123-92ee-4c57-bef5-9621db2839fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:16.032502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4f919123-92ee-4c57-bef5-9621db2839fb None None] MFA Rules not processed for user `3abe1d47a1164776bf3a82fe4b129d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:16.034197 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4f919123-92ee-4c57-bef5-9621db2839fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:16.042497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 673/1355] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Jun 16 18:49:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:49:19.759455 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c2435-ccb7-434d-b0ae-1efa5319d8ee None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:19.760319 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c2435-ccb7-434d-b0ae-1efa5319d8ee None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:19.760826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c2435-ccb7-434d-b0ae-1efa5319d8ee None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:19.762630 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 683/1356] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:49:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:19.767600 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9f3c3-d583-495e-96b3-dfee05bf5405 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:19.768064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9f3c3-d583-495e-96b3-dfee05bf5405 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:19.768173 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9f3c3-d583-495e-96b3-dfee05bf5405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:19.786936 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-15b9f3c3-d583-495e-96b3-dfee05bf5405 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:19.788186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-15b9f3c3-d583-495e-96b3-dfee05bf5405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:19.799550 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 674/1357] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:19.850506 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd3d23-b891-4a35-a627-2ea5000b11d5 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:19.851225 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd3d23-b891-4a35-a627-2ea5000b11d5 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:19.851932 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd3d23-b891-4a35-a627-2ea5000b11d5 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:19.853976 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 684/1358] 10.222.0.93 () {54 vars in 961 bytes} [Thu Jun 16 18:49:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:19.860485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cd91e-e5c7-4e15-812d-52b453699be7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:19.861434 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cd91e-e5c7-4e15-812d-52b453699be7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:19.862113 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cd91e-e5c7-4e15-812d-52b453699be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:19.905433 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:19.914009 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b95cd91e-e5c7-4e15-812d-52b453699be7 None None] MFA Rules not processed for user `3503ec98bea14693a17a84e686586bad`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:19.915218 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b95cd91e-e5c7-4e15-812d-52b453699be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:20.003065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 675/1359] 10.222.0.93 () {58 vars in 1058 bytes} [Thu Jun 16 18:49:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:49:20.011581 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd3d23-b891-4a35-a627-2ea5000b11d5 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:49:20.030516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd3d23-b891-4a35-a627-2ea5000b11d5 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:49:20.036321 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61d65d-566d-4df1-bc25-e1c92dcc050d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:49:20.037129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61d65d-566d-4df1-bc25-e1c92dcc050d service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:20.037763 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61d65d-566d-4df1-bc25-e1c92dcc050d service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:20.038165 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61d65d-566d-4df1-bc25-e1c92dcc050d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:20.047939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61d65d-566d-4df1-bc25-e1c92dcc050d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:49:20.049587 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61d65d-566d-4df1-bc25-e1c92dcc050d service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:49:20.059835 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 685/1360] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:22.450378 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8e8f0-1296-4f3f-a518-b5a64092a7b5 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:22.450978 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8e8f0-1296-4f3f-a518-b5a64092a7b5 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:22.450978 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8e8f0-1296-4f3f-a518-b5a64092a7b5 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:22.452347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 676/1361] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:22.457755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78da73-bfe8-4cbd-9048-50034edfba82 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:22.458204 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78da73-bfe8-4cbd-9048-50034edfba82 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:22.458294 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78da73-bfe8-4cbd-9048-50034edfba82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:22.476589 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-3d78da73-bfe8-4cbd-9048-50034edfba82 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:22.477820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-3d78da73-bfe8-4cbd-9048-50034edfba82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:22.488687 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 686/1362] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:22.534073 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8e8f0-1296-4f3f-a518-b5a64092a7b5 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:49:22.550042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8e8f0-1296-4f3f-a518-b5a64092a7b5 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:49:22.556884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166be46-ee60-4f4c-bba2-2135ef268613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:49:22.557551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166be46-ee60-4f4c-bba2-2135ef268613 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:22.557837 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166be46-ee60-4f4c-bba2-2135ef268613 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:22.558111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166be46-ee60-4f4c-bba2-2135ef268613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:22.567175 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166be46-ee60-4f4c-bba2-2135ef268613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:49:22.568909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166be46-ee60-4f4c-bba2-2135ef268613 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:49:22.580409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 677/1363] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:49:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:49:25.196207 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ada73-dcc8-4b91-bede-d885e992b1f9 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:25.196790 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ada73-dcc8-4b91-bede-d885e992b1f9 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:25.196790 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ada73-dcc8-4b91-bede-d885e992b1f9 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:25.198166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 687/1364] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:25.203509 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b09e1e-505f-4a03-9391-6cbdcc6a3842 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:25.203999 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b09e1e-505f-4a03-9391-6cbdcc6a3842 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:25.204110 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b09e1e-505f-4a03-9391-6cbdcc6a3842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:25.222609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-33b09e1e-505f-4a03-9391-6cbdcc6a3842 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:25.223807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-33b09e1e-505f-4a03-9391-6cbdcc6a3842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:25.231636 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 678/1365] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:25.279890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ddd52-ab6c-4019-b9e3-27f9812e5918 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:25.280180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ddd52-ab6c-4019-b9e3-27f9812e5918 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:25.280594 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ddd52-ab6c-4019-b9e3-27f9812e5918 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:25.282082 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 688/1366] 10.222.0.93 () {54 vars in 961 bytes} [Thu Jun 16 18:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:25.287429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb92dd-a5e4-439a-a542-6ffdd20d2594 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:25.292776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb92dd-a5e4-439a-a542-6ffdd20d2594 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:25.292776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb92dd-a5e4-439a-a542-6ffdd20d2594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:25.307561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-dbfb92dd-a5e4-439a-a542-6ffdd20d2594 None None] MFA Rules not processed for user `3503ec98bea14693a17a84e686586bad`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:25.308983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-dbfb92dd-a5e4-439a-a542-6ffdd20d2594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:25.318998 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 679/1367] 10.222.0.93 () {58 vars in 1058 bytes} [Thu Jun 16 18:49:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:25.328409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ddd52-ab6c-4019-b9e3-27f9812e5918 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:49:25.358521 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ddd52-ab6c-4019-b9e3-27f9812e5918 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:49:25.365531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070f826-7929-44fa-ace5-15647c9e2b85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:49:25.366195 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070f826-7929-44fa-ace5-15647c9e2b85 service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:25.366481 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070f826-7929-44fa-ace5-15647c9e2b85 service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:25.366792 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070f826-7929-44fa-ace5-15647c9e2b85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:25.376695 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070f826-7929-44fa-ace5-15647c9e2b85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:49:25.378290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070f826-7929-44fa-ace5-15647c9e2b85 service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:49:25.388256 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 689/1368] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:27.782191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a50d3-e5e3-4006-8bc7-b7c78ca8eccf None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:27.782729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a50d3-e5e3-4006-8bc7-b7c78ca8eccf None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:27.782729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a50d3-e5e3-4006-8bc7-b7c78ca8eccf None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:27.784119 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 680/1369] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:49:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:27.789521 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50bea8-fad7-405a-becd-6b9d3a77b40f None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:27.789913 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50bea8-fad7-405a-becd-6b9d3a77b40f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:27.790082 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50bea8-fad7-405a-becd-6b9d3a77b40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:27.808699 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-ea50bea8-fad7-405a-becd-6b9d3a77b40f None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:27.810123 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-ea50bea8-fad7-405a-becd-6b9d3a77b40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:27.818232 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 690/1370] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:27.864856 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a50d3-e5e3-4006-8bc7-b7c78ca8eccf None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:49:27.879772 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a50d3-e5e3-4006-8bc7-b7c78ca8eccf None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:49:27.885845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3606b-23f7-444f-b4db-517c09944941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:49:27.886522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3606b-23f7-444f-b4db-517c09944941 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:27.886821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3606b-23f7-444f-b4db-517c09944941 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:27.887097 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3606b-23f7-444f-b4db-517c09944941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:27.896558 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3606b-23f7-444f-b4db-517c09944941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:49:27.898162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3606b-23f7-444f-b4db-517c09944941 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:49:27.908826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 681/1371] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:49:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:28.024417 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06606ea-947d-44ba-88d2-9b34741393bb None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:28.024750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06606ea-947d-44ba-88d2-9b34741393bb None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:28.025034 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06606ea-947d-44ba-88d2-9b34741393bb None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:28.026378 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 691/1372] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:28.032456 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed107e-b106-40cf-9e05-f3cc987e08f8 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:28.032716 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed107e-b106-40cf-9e05-f3cc987e08f8 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:28.033321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed107e-b106-40cf-9e05-f3cc987e08f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:28.052464 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f7ed107e-b106-40cf-9e05-f3cc987e08f8 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:28.053767 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f7ed107e-b106-40cf-9e05-f3cc987e08f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:28.062014 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 682/1373] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:28.379775 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ead4c-3920-4e38-a8e0-66d6c9fdc605 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:28.379775 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ead4c-3920-4e38-a8e0-66d6c9fdc605 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:28.380094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ead4c-3920-4e38-a8e0-66d6c9fdc605 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:28.381181 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 692/1374] 10.222.0.93 () {54 vars in 963 bytes} [Thu Jun 16 18:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:28.386467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce2340-4c79-4b9f-9584-0d40d52e5a81 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:28.386782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce2340-4c79-4b9f-9584-0d40d52e5a81 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:28.387060 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce2340-4c79-4b9f-9584-0d40d52e5a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:28.440942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-18ce2340-4c79-4b9f-9584-0d40d52e5a81 None None] MFA Rules not processed for user `3862d73c187e403fb1e1ef4e1984cee7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:28.442140 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-18ce2340-4c79-4b9f-9584-0d40d52e5a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:28.504632 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 683/1375] 10.222.0.93 () {58 vars in 1060 bytes} [Thu Jun 16 18:49:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:28.513013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ead4c-3920-4e38-a8e0-66d6c9fdc605 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:49:28.524629 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ead4c-3920-4e38-a8e0-66d6c9fdc605 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:49:28.528400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51214c6e-9327-4e62-b301-e08bf80fe990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:49:28.529399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51214c6e-9327-4e62-b301-e08bf80fe990 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:28.529885 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51214c6e-9327-4e62-b301-e08bf80fe990 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:28.530758 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51214c6e-9327-4e62-b301-e08bf80fe990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:28.540516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51214c6e-9327-4e62-b301-e08bf80fe990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:49:28.542083 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51214c6e-9327-4e62-b301-e08bf80fe990 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:49:28.553017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 693/1376] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:49:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:30.300007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcfbed-2550-4645-9ae2-74d9e5a0f578 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:30.300590 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcfbed-2550-4645-9ae2-74d9e5a0f578 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:30.300860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcfbed-2550-4645-9ae2-74d9e5a0f578 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:30.302329 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 684/1377] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:30.308043 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cff4c0-c21e-4c62-a73e-5c72c641005a None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:30.308602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cff4c0-c21e-4c62-a73e-5c72c641005a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:30.308687 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cff4c0-c21e-4c62-a73e-5c72c641005a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:30.328662 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-f3cff4c0-c21e-4c62-a73e-5c72c641005a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:30.329811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f3cff4c0-c21e-4c62-a73e-5c72c641005a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:30.338191 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 694/1378] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:30.384846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcfbed-2550-4645-9ae2-74d9e5a0f578 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:49:30.399860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcfbed-2550-4645-9ae2-74d9e5a0f578 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:49:30.406149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40d86a-7190-42e5-935e-90ebe9dd09c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:49:30.406799 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40d86a-7190-42e5-935e-90ebe9dd09c7 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:30.407216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40d86a-7190-42e5-935e-90ebe9dd09c7 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:30.407490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40d86a-7190-42e5-935e-90ebe9dd09c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:30.416073 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40d86a-7190-42e5-935e-90ebe9dd09c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:49:30.418273 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40d86a-7190-42e5-935e-90ebe9dd09c7 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:49:30.422410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:30.429196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 685/1379] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:49:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:32.804761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd14283-36ef-4457-bc9f-67741133da52 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:32.805325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd14283-36ef-4457-bc9f-67741133da52 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:32.805608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd14283-36ef-4457-bc9f-67741133da52 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:32.807088 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 695/1380] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:49:32.812286 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a52407-784f-460d-8995-b5524558e6ee None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:32.812726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a52407-784f-460d-8995-b5524558e6ee None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:32.812898 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a52407-784f-460d-8995-b5524558e6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:32.831742 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-e8a52407-784f-460d-8995-b5524558e6ee None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:32.833103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e8a52407-784f-460d-8995-b5524558e6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:32.841330 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 686/1381] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:32.885436 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd14283-36ef-4457-bc9f-67741133da52 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:49:32.901302 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd14283-36ef-4457-bc9f-67741133da52 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:49:32.907448 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452e9c3-cf01-48e2-9112-e9ae59bc28f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:49:32.908081 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452e9c3-cf01-48e2-9112-e9ae59bc28f8 service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:32.908365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452e9c3-cf01-48e2-9112-e9ae59bc28f8 service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:32.908670 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452e9c3-cf01-48e2-9112-e9ae59bc28f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:32.917619 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452e9c3-cf01-48e2-9112-e9ae59bc28f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:49:32.919240 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452e9c3-cf01-48e2-9112-e9ae59bc28f8 service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:49:32.929153 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 696/1382] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:35.237385 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a4b4e-16f0-4f48-b653-e5fcd7126fa8 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:35.237932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a4b4e-16f0-4f48-b653-e5fcd7126fa8 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:35.237932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a4b4e-16f0-4f48-b653-e5fcd7126fa8 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:35.239299 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 687/1383] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:35.245239 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849798a1-6bd0-4c12-9983-5c4ed58a1279 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:35.246257 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849798a1-6bd0-4c12-9983-5c4ed58a1279 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:35.246777 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849798a1-6bd0-4c12-9983-5c4ed58a1279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:35.266551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-849798a1-6bd0-4c12-9983-5c4ed58a1279 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:35.268130 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-849798a1-6bd0-4c12-9983-5c4ed58a1279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:35.276507 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 697/1384] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:35.318607 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a4b4e-16f0-4f48-b653-e5fcd7126fa8 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:49:35.334031 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a4b4e-16f0-4f48-b653-e5fcd7126fa8 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:49:35.339821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fa007-fd15-4e2d-97eb-b94525687810 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:49:35.340599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fa007-fd15-4e2d-97eb-b94525687810 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:35.340963 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fa007-fd15-4e2d-97eb-b94525687810 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:35.341310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fa007-fd15-4e2d-97eb-b94525687810 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:35.350228 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fa007-fd15-4e2d-97eb-b94525687810 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:49:35.351878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fa007-fd15-4e2d-97eb-b94525687810 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:49:35.361948 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 688/1385] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:37.518939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e6c11-b634-40d5-af44-9eb8740ad1c1 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:37.519514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e6c11-b634-40d5-af44-9eb8740ad1c1 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:37.519514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e6c11-b634-40d5-af44-9eb8740ad1c1 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:37.520977 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 698/1386] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:37.526544 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60036c81-d7fb-4170-8667-a6b216132182 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:37.527004 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60036c81-d7fb-4170-8667-a6b216132182 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:37.527107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60036c81-d7fb-4170-8667-a6b216132182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:37.546444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-60036c81-d7fb-4170-8667-a6b216132182 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:37.547662 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-60036c81-d7fb-4170-8667-a6b216132182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:37.555697 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 689/1387] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:37.600604 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e6c11-b634-40d5-af44-9eb8740ad1c1 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:49:37.615100 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e6c11-b634-40d5-af44-9eb8740ad1c1 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:49:37.620568 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae069bb-d84b-486c-b3c3-a9740d9e4b96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:49:37.621218 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae069bb-d84b-486c-b3c3-a9740d9e4b96 service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:37.621505 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae069bb-d84b-486c-b3c3-a9740d9e4b96 service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:37.621782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae069bb-d84b-486c-b3c3-a9740d9e4b96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:37.630977 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae069bb-d84b-486c-b3c3-a9740d9e4b96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:49:37.632605 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae069bb-d84b-486c-b3c3-a9740d9e4b96 service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:49:37.642889 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 699/1388] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:49:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:39.937236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87042f44-6cb9-4537-813b-308bab21cbc4 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:39.937811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87042f44-6cb9-4537-813b-308bab21cbc4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:39.937811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87042f44-6cb9-4537-813b-308bab21cbc4 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:39.939291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 690/1389] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:39.944590 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495208f4-e5fa-45ae-92dd-b007bbbc2ff2 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:39.945087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495208f4-e5fa-45ae-92dd-b007bbbc2ff2 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:39.945240 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495208f4-e5fa-45ae-92dd-b007bbbc2ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:39.962994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-495208f4-e5fa-45ae-92dd-b007bbbc2ff2 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:39.964206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-495208f4-e5fa-45ae-92dd-b007bbbc2ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:39.973456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 700/1390] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:40.020561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87042f44-6cb9-4537-813b-308bab21cbc4 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:49:40.037790 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87042f44-6cb9-4537-813b-308bab21cbc4 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:49:40.044758 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb6a41-e606-4eaa-b743-703ec7f01834 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:49:40.045555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb6a41-e606-4eaa-b743-703ec7f01834 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:40.045906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb6a41-e606-4eaa-b743-703ec7f01834 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:40.046254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb6a41-e606-4eaa-b743-703ec7f01834 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:40.057477 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb6a41-e606-4eaa-b743-703ec7f01834 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:49:40.059445 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb6a41-e606-4eaa-b743-703ec7f01834 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:49:40.070970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 691/1391] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:42.447694 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd47cd6-4fc0-4353-a527-62707240a09b None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:42.448219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd47cd6-4fc0-4353-a527-62707240a09b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:42.448219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd47cd6-4fc0-4353-a527-62707240a09b None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:42.449685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 701/1392] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:42.455456 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15eaa26-ae16-4dd5-91bf-5aa32bba654b None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:42.455922 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15eaa26-ae16-4dd5-91bf-5aa32bba654b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:42.456022 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15eaa26-ae16-4dd5-91bf-5aa32bba654b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:42.474160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f15eaa26-ae16-4dd5-91bf-5aa32bba654b None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:42.475357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f15eaa26-ae16-4dd5-91bf-5aa32bba654b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:42.483217 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 692/1393] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:42.529426 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd47cd6-4fc0-4353-a527-62707240a09b None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:49:42.544124 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd47cd6-4fc0-4353-a527-62707240a09b None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:49:42.549635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f6c83-7083-4bd3-97c7-ade963a10c7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:49:42.550283 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f6c83-7083-4bd3-97c7-ade963a10c7c service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:42.550620 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f6c83-7083-4bd3-97c7-ade963a10c7c service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:42.550854 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f6c83-7083-4bd3-97c7-ade963a10c7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:42.559419 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f6c83-7083-4bd3-97c7-ade963a10c7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:49:42.561080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f6c83-7083-4bd3-97c7-ade963a10c7c service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:49:42.570493 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 702/1394] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:49:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:44.271405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf89d2-5533-4d39-9fb9-2a7e0e68130b None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:44.271839 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf89d2-5533-4d39-9fb9-2a7e0e68130b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:44.271977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf89d2-5533-4d39-9fb9-2a7e0e68130b None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:44.273392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 693/1395] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:44.278694 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d93994-1bb2-4587-b5d3-00016c33e0f1 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:44.279140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d93994-1bb2-4587-b5d3-00016c33e0f1 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:44.279459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d93994-1bb2-4587-b5d3-00016c33e0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:44.297325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-28d93994-1bb2-4587-b5d3-00016c33e0f1 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:44.298502 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-28d93994-1bb2-4587-b5d3-00016c33e0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:44.306258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 703/1396] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:44.362835 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c558a68-d9b5-4b6e-938c-0fc01cbfc819 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:44.363123 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c558a68-d9b5-4b6e-938c-0fc01cbfc819 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:44.363402 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c558a68-d9b5-4b6e-938c-0fc01cbfc819 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:44.364823 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 694/1397] 10.222.0.93 () {54 vars in 962 bytes} [Thu Jun 16 18:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:44.370052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d61ae-f93e-4294-a2c7-0cdd6e9fd3f1 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:44.370412 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d61ae-f93e-4294-a2c7-0cdd6e9fd3f1 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:44.370730 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d61ae-f93e-4294-a2c7-0cdd6e9fd3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:44.419253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-f01d61ae-f93e-4294-a2c7-0cdd6e9fd3f1 None None] MFA Rules not processed for user `00c13f10b14449cea284eb629a316d83`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:44.420356 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f01d61ae-f93e-4294-a2c7-0cdd6e9fd3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:44.480427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 704/1398] 10.222.0.93 () {58 vars in 1059 bytes} [Thu Jun 16 18:49:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:44.488152 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c558a68-d9b5-4b6e-938c-0fc01cbfc819 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:49:44.499872 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c558a68-d9b5-4b6e-938c-0fc01cbfc819 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:49:44.503691 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130332a-9734-4a98-9bd1-ed9d881b8ece service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00c13f10b14449cea284eb629a316d83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:49:44.504566 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130332a-9734-4a98-9bd1-ed9d881b8ece service glance] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:44.504854 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130332a-9734-4a98-9bd1-ed9d881b8ece service glance] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:44.505132 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130332a-9734-4a98-9bd1-ed9d881b8ece service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:44.515150 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130332a-9734-4a98-9bd1-ed9d881b8ece service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:49:44.516606 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130332a-9734-4a98-9bd1-ed9d881b8ece service glance] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:49:44.526181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 695/1399] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:44.969495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c0d75-0efe-4dc9-b574-1742cc46430d None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:44.969790 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c0d75-0efe-4dc9-b574-1742cc46430d None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:44.970167 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c0d75-0efe-4dc9-b574-1742cc46430d None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:44.971694 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 705/1400] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:49:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:44.978431 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84806820-9112-4c6d-9c47-5fe4598d43d7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:44.978802 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84806820-9112-4c6d-9c47-5fe4598d43d7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:44.979022 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84806820-9112-4c6d-9c47-5fe4598d43d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:45.002049 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-84806820-9112-4c6d-9c47-5fe4598d43d7 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:45.003275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-84806820-9112-4c6d-9c47-5fe4598d43d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:45.011216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 696/1401] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:45.061447 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c0d75-0efe-4dc9-b574-1742cc46430d None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:49:45.070508 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=93 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:45.081075 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c0d75-0efe-4dc9-b574-1742cc46430d None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:49:45.087021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34cb63-50eb-45e7-a6d0-2e942c6ebe76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:49:45.087708 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34cb63-50eb-45e7-a6d0-2e942c6ebe76 service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:45.087999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34cb63-50eb-45e7-a6d0-2e942c6ebe76 service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:45.088283 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34cb63-50eb-45e7-a6d0-2e942c6ebe76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:45.099092 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34cb63-50eb-45e7-a6d0-2e942c6ebe76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:49:45.100750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34cb63-50eb-45e7-a6d0-2e942c6ebe76 service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:49:45.113389 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 706/1402] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:45.487703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe326b29-1936-46e2-ab54-f57487e3592f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:45.488223 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe326b29-1936-46e2-ab54-f57487e3592f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:45.488331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe326b29-1936-46e2-ab54-f57487e3592f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:45.539542 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-fe326b29-1936-46e2-ab54-f57487e3592f None None] MFA Rules not processed for user `1eefe0d721484433b72afca03a2c1bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:45.540718 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fe326b29-1936-46e2-ab54-f57487e3592f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:45.605447 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 697/1403] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Jun 16 18:49:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:45.649935 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6b291-dda9-4430-8c25-ade68f31de72 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:45.650431 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6b291-dda9-4430-8c25-ade68f31de72 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:45.650547 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6b291-dda9-4430-8c25-ade68f31de72 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:45.651866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 707/1404] 10.222.0.93 () {54 vars in 942 bytes} [Thu Jun 16 18:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:45.658679 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e905f3-97ad-4ae6-929a-1a016a0db416 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:45.659039 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e905f3-97ad-4ae6-929a-1a016a0db416 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:45.659389 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e905f3-97ad-4ae6-929a-1a016a0db416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:45.708491 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-84e905f3-97ad-4ae6-929a-1a016a0db416 None None] MFA Rules not processed for user `b45db002889846eda5b2a3e6917fcbe1`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:45.711719 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-84e905f3-97ad-4ae6-929a-1a016a0db416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:45.743793 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:45.782436 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 698/1405] 10.222.0.93 () {58 vars in 1039 bytes} [Thu Jun 16 18:49:45 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:45.792589 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6b291-dda9-4430-8c25-ade68f31de72 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:49:45.806234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6b291-dda9-4430-8c25-ade68f31de72 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:49:45.813626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02007ac-880c-402f-b230-9b414c57638c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b45db002889846eda5b2a3e6917fcbe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:49:45.814333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02007ac-880c-402f-b230-9b414c57638c service swift] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:45.814688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02007ac-880c-402f-b230-9b414c57638c service swift] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:45.815040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02007ac-880c-402f-b230-9b414c57638c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:45.824052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02007ac-880c-402f-b230-9b414c57638c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:49:45.826251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02007ac-880c-402f-b230-9b414c57638c service swift] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:49:45.834500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 708/1406] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Jun 16 18:49:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 18:49:47.476850 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d84de-c53a-45bc-a892-a80540f716f0 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:47.477404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d84de-c53a-45bc-a892-a80540f716f0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:47.477404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d84de-c53a-45bc-a892-a80540f716f0 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:47.478924 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 699/1407] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:49:47.484284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4cbb4-09fc-41d3-91a6-ec008e8525da None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:47.484824 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4cbb4-09fc-41d3-91a6-ec008e8525da None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:47.485107 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4cbb4-09fc-41d3-91a6-ec008e8525da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:47.508180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-b6a4cbb4-09fc-41d3-91a6-ec008e8525da None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:49:47.509415 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b6a4cbb4-09fc-41d3-91a6-ec008e8525da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:49:47.524564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 709/1408] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:49:47.570164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d84de-c53a-45bc-a892-a80540f716f0 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:49:47.586083 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d84de-c53a-45bc-a892-a80540f716f0 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:49:47.591889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454e6b2-83c7-4a6d-acc5-4c73dbd5680e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:49:47.592689 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454e6b2-83c7-4a6d-acc5-4c73dbd5680e service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:49:47.592990 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454e6b2-83c7-4a6d-acc5-4c73dbd5680e service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:49:47.593268 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454e6b2-83c7-4a6d-acc5-4c73dbd5680e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:49:47.604494 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454e6b2-83c7-4a6d-acc5-4c73dbd5680e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:49:47.606083 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454e6b2-83c7-4a6d-acc5-4c73dbd5680e service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:49:47.617647 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 700/1409] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:57.503091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=14 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:57.613287 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=21 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:10.001069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1ffe3-22ce-41a0-8e8b-4c699ddb9443 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:10.001695 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1ffe3-22ce-41a0-8e8b-4c699ddb9443 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:10.001695 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1ffe3-22ce-41a0-8e8b-4c699ddb9443 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:10.002985 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 710/1410] 10.222.0.93 () {54 vars in 918 bytes} [Thu Jun 16 18:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:10.008175 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2c2c3-e262-4865-b9d4-50a495fbc69d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:10.008622 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2c2c3-e262-4865-b9d4-50a495fbc69d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:10.008769 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2c2c3-e262-4865-b9d4-50a495fbc69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:10.028637 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-23c2c2c3-e262-4865-b9d4-50a495fbc69d None None] MFA Rules not processed for user `3abe1d47a1164776bf3a82fe4b129d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:10.029870 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-23c2c2c3-e262-4865-b9d4-50a495fbc69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:10.040831 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 701/1411] 10.222.0.93 () {58 vars in 1015 bytes} [Thu Jun 16 18:50:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:50:10.056512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4f595-6368-44f5-9805-25d716ff17f4 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:10.056801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4f595-6368-44f5-9805-25d716ff17f4 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:10.057080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4f595-6368-44f5-9805-25d716ff17f4 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:10.058999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 711/1412] 10.222.0.93 () {54 vars in 918 bytes} [Thu Jun 16 18:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:10.063510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523669c9-98da-4f04-bff2-de3bcac4f1ce None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:10.063931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523669c9-98da-4f04-bff2-de3bcac4f1ce None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:10.064214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523669c9-98da-4f04-bff2-de3bcac4f1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:10.083809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-523669c9-98da-4f04-bff2-de3bcac4f1ce None None] MFA Rules not processed for user `3503ec98bea14693a17a84e686586bad`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:10.085032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-523669c9-98da-4f04-bff2-de3bcac4f1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:10.094330 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 702/1413] 10.222.0.93 () {58 vars in 1015 bytes} [Thu Jun 16 18:50:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:12.690058 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7393-7e7f-4ca3-a46a-2af2a42b434d None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:12.690649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7393-7e7f-4ca3-a46a-2af2a42b434d None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:12.690649 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7393-7e7f-4ca3-a46a-2af2a42b434d None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:12.692391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:50:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:12.698302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56882de-50e5-41e9-a5f9-2efe5bf601f0 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:12.698729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56882de-50e5-41e9-a5f9-2efe5bf601f0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:12.698832 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56882de-50e5-41e9-a5f9-2efe5bf601f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:12.716565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f56882de-50e5-41e9-a5f9-2efe5bf601f0 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:12.717746 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f56882de-50e5-41e9-a5f9-2efe5bf601f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:12.725486 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:12.767385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7393-7e7f-4ca3-a46a-2af2a42b434d None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:12.783396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7393-7e7f-4ca3-a46a-2af2a42b434d None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:12.788840 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce0a83-6973-4fa3-83cf-46f274656089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:12.789479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce0a83-6973-4fa3-83cf-46f274656089 service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:12.789776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce0a83-6973-4fa3-83cf-46f274656089 service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:12.790052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce0a83-6973-4fa3-83cf-46f274656089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:12.798152 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce0a83-6973-4fa3-83cf-46f274656089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:12.799742 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce0a83-6973-4fa3-83cf-46f274656089 service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:12.809235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 713/1416] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:13.757242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23610524-6d15-404d-802c-c696094a0463 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:13.757804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23610524-6d15-404d-802c-c696094a0463 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:13.757804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23610524-6d15-404d-802c-c696094a0463 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:13.759189 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:13.764675 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f2c37-dce8-452b-bb1d-6736b47edaec None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:13.765104 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f2c37-dce8-452b-bb1d-6736b47edaec None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:13.765242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f2c37-dce8-452b-bb1d-6736b47edaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:13.787598 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-a73f2c37-dce8-452b-bb1d-6736b47edaec None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:13.788849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-a73f2c37-dce8-452b-bb1d-6736b47edaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:13.796732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:13.953105 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23610524-6d15-404d-802c-c696094a0463 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:13.967388 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23610524-6d15-404d-802c-c696094a0463 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:13.972856 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6961c6-aff4-4767-91b3-7825655d0239 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:13.973497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6961c6-aff4-4767-91b3-7825655d0239 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:13.973784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6961c6-aff4-4767-91b3-7825655d0239 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:13.974066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6961c6-aff4-4767-91b3-7825655d0239 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:13.982691 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6961c6-aff4-4767-91b3-7825655d0239 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:13.984264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6961c6-aff4-4767-91b3-7825655d0239 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:13.993644 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 705/1419] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:14.918506 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd4680-02c3-400d-b4f4-ec8c58e8067e None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.919058 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd4680-02c3-400d-b4f4-ec8c58e8067e None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.919058 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd4680-02c3-400d-b4f4-ec8c58e8067e None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.920428 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:14.925259 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918ba3-461b-41dc-8ae1-608c22c199a6 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.925694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918ba3-461b-41dc-8ae1-608c22c199a6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.925809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918ba3-461b-41dc-8ae1-608c22c199a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.944756 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-ac918ba3-461b-41dc-8ae1-608c22c199a6 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:14.946011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ac918ba3-461b-41dc-8ae1-608c22c199a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:14.954979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:15.108418 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd4680-02c3-400d-b4f4-ec8c58e8067e None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.123518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd4680-02c3-400d-b4f4-ec8c58e8067e None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.129277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95d622-3ee0-4c05-8049-1861e96e9695 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.129979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95d622-3ee0-4c05-8049-1861e96e9695 service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.130265 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95d622-3ee0-4c05-8049-1861e96e9695 service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.130543 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95d622-3ee0-4c05-8049-1861e96e9695 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.139159 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95d622-3ee0-4c05-8049-1861e96e9695 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.140830 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95d622-3ee0-4c05-8049-1861e96e9695 service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.151468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 716/1422] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:16.067976 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a07ce-b146-44e0-876f-290d73f8d2ba None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:16.068590 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a07ce-b146-44e0-876f-290d73f8d2ba None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:16.068590 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a07ce-b146-44e0-876f-290d73f8d2ba None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:16.069914 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:16.074673 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7ea08-2a8d-4815-ad7c-07746276c5a8 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:16.075076 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7ea08-2a8d-4815-ad7c-07746276c5a8 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:16.075232 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7ea08-2a8d-4815-ad7c-07746276c5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:16.094733 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-f5f7ea08-2a8d-4815-ad7c-07746276c5a8 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:16.095914 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f5f7ea08-2a8d-4815-ad7c-07746276c5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:16.103587 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:16.253289 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a07ce-b146-44e0-876f-290d73f8d2ba None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:16.267927 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a07ce-b146-44e0-876f-290d73f8d2ba None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:16.273322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b628b-d6d2-4e0f-81d8-7638cef1b45a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:16.273967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b628b-d6d2-4e0f-81d8-7638cef1b45a service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:16.274256 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b628b-d6d2-4e0f-81d8-7638cef1b45a service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:16.274535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b628b-d6d2-4e0f-81d8-7638cef1b45a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:16.283433 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b628b-d6d2-4e0f-81d8-7638cef1b45a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:16.285056 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b628b-d6d2-4e0f-81d8-7638cef1b45a service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:16.294359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 708/1425] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:17.193004 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27b7fd-a44d-4354-82e0-58fe3c3ad541 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:17.193552 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27b7fd-a44d-4354-82e0-58fe3c3ad541 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:17.193552 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27b7fd-a44d-4354-82e0-58fe3c3ad541 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:17.194965 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:17.200607 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f0480-3526-4517-8550-5eab7ee9a4c0 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:17.201072 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f0480-3526-4517-8550-5eab7ee9a4c0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:17.201179 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f0480-3526-4517-8550-5eab7ee9a4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:17.219598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c81f0480-3526-4517-8550-5eab7ee9a4c0 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:17.220821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c81f0480-3526-4517-8550-5eab7ee9a4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:17.228541 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:17.377739 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27b7fd-a44d-4354-82e0-58fe3c3ad541 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:17.392360 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27b7fd-a44d-4354-82e0-58fe3c3ad541 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:17.397940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4afc03-9a36-4181-bf15-194cc0310a74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:17.398577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4afc03-9a36-4181-bf15-194cc0310a74 service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:17.398862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4afc03-9a36-4181-bf15-194cc0310a74 service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:17.399141 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4afc03-9a36-4181-bf15-194cc0310a74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:17.407183 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4afc03-9a36-4181-bf15-194cc0310a74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:17.408796 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4afc03-9a36-4181-bf15-194cc0310a74 service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:17.417958 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 719/1428] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:18.318281 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c810d3-f73d-42b7-8b6f-b5498f17c83c None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:18.318827 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c810d3-f73d-42b7-8b6f-b5498f17c83c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:18.318827 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c810d3-f73d-42b7-8b6f-b5498f17c83c None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:18.320183 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:18.325557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc44b4-6e5f-4b43-bfeb-4f3b43f40fec None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:18.325977 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc44b4-6e5f-4b43-bfeb-4f3b43f40fec None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:18.326118 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc44b4-6e5f-4b43-bfeb-4f3b43f40fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:18.344033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-cacc44b4-6e5f-4b43-bfeb-4f3b43f40fec None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:18.345236 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-cacc44b4-6e5f-4b43-bfeb-4f3b43f40fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:18.352855 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:18.501036 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c810d3-f73d-42b7-8b6f-b5498f17c83c None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:18.515444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c810d3-f73d-42b7-8b6f-b5498f17c83c None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:18.520729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f15f5-2890-4c28-ba37-fee7d8de8124 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:18.521361 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f15f5-2890-4c28-ba37-fee7d8de8124 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:18.521640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f15f5-2890-4c28-ba37-fee7d8de8124 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:18.521911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f15f5-2890-4c28-ba37-fee7d8de8124 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:18.530582 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f15f5-2890-4c28-ba37-fee7d8de8124 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:18.532143 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f15f5-2890-4c28-ba37-fee7d8de8124 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:18.541505 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 711/1431] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:19.488039 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd005bc-9802-4106-928d-b797a1ea20ac None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:19.488602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd005bc-9802-4106-928d-b797a1ea20ac None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:19.488602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd005bc-9802-4106-928d-b797a1ea20ac None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:19.489923 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:19.495601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297e0e8-fc72-4843-bb97-fb5b9e607107 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:19.496049 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297e0e8-fc72-4843-bb97-fb5b9e607107 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:19.496216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297e0e8-fc72-4843-bb97-fb5b9e607107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:19.514248 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a297e0e8-fc72-4843-bb97-fb5b9e607107 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:19.515491 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a297e0e8-fc72-4843-bb97-fb5b9e607107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:19.523490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:19.675311 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd005bc-9802-4106-928d-b797a1ea20ac None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:19.690058 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd005bc-9802-4106-928d-b797a1ea20ac None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:19.695417 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f548a-c5bb-4f48-aa85-66bff747c6e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:19.696052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f548a-c5bb-4f48-aa85-66bff747c6e6 service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:19.696340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f548a-c5bb-4f48-aa85-66bff747c6e6 service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:19.696654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f548a-c5bb-4f48-aa85-66bff747c6e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:19.705169 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f548a-c5bb-4f48-aa85-66bff747c6e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:19.706756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f548a-c5bb-4f48-aa85-66bff747c6e6 service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:19.716122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 722/1434] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:20.636780 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6dfeb-ad97-4ccc-afe3-8e13eab1c927 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:20.637375 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6dfeb-ad97-4ccc-afe3-8e13eab1c927 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:20.637375 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6dfeb-ad97-4ccc-afe3-8e13eab1c927 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:20.638746 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:20.643507 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d306d-568c-4658-9184-f86fde3527a8 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:20.643937 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d306d-568c-4658-9184-f86fde3527a8 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:20.644076 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d306d-568c-4658-9184-f86fde3527a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:20.662132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-d03d306d-568c-4658-9184-f86fde3527a8 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:20.663324 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-d03d306d-568c-4658-9184-f86fde3527a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:20.671833 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:20.821316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6dfeb-ad97-4ccc-afe3-8e13eab1c927 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:20.836009 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6dfeb-ad97-4ccc-afe3-8e13eab1c927 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:20.842038 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8fc28-fdc3-462d-9d36-111bbad11e2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:20.842677 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8fc28-fdc3-462d-9d36-111bbad11e2e service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:20.842964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8fc28-fdc3-462d-9d36-111bbad11e2e service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:20.843245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8fc28-fdc3-462d-9d36-111bbad11e2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:20.851277 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8fc28-fdc3-462d-9d36-111bbad11e2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:20.852894 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8fc28-fdc3-462d-9d36-111bbad11e2e service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:20.862091 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 714/1437] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:21.852088 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033f1d-dd4a-4545-bb8e-3b60f7851b02 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:21.852714 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033f1d-dd4a-4545-bb8e-3b60f7851b02 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:21.852714 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033f1d-dd4a-4545-bb8e-3b60f7851b02 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:21.854089 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:21.858912 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3999e8-d215-4642-a0b2-ebc6842bf84f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:21.859449 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3999e8-d215-4642-a0b2-ebc6842bf84f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:21.859582 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3999e8-d215-4642-a0b2-ebc6842bf84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:21.878186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-9c3999e8-d215-4642-a0b2-ebc6842bf84f None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:21.879330 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9c3999e8-d215-4642-a0b2-ebc6842bf84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:21.887982 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:22.037825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54033f1d-dd4a-4545-bb8e-3b60f7851b02 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:22.051688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54033f1d-dd4a-4545-bb8e-3b60f7851b02 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:22.057445 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d3d95-1c1c-4440-af0b-4fb789b8192b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:22.058078 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d3d95-1c1c-4440-af0b-4fb789b8192b service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:22.058360 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d3d95-1c1c-4440-af0b-4fb789b8192b service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:22.058635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d3d95-1c1c-4440-af0b-4fb789b8192b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:22.066484 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d3d95-1c1c-4440-af0b-4fb789b8192b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:22.068076 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d3d95-1c1c-4440-af0b-4fb789b8192b service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:22.077769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 725/1440] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:24.122226 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee82bc9-9b4a-42bd-af43-15c48e398545 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:24.122768 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee82bc9-9b4a-42bd-af43-15c48e398545 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:24.122768 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee82bc9-9b4a-42bd-af43-15c48e398545 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:24.124139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:24.129776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b467285-a841-4b3d-9273-62fd8b2be2f4 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:24.130209 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b467285-a841-4b3d-9273-62fd8b2be2f4 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:24.130340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b467285-a841-4b3d-9273-62fd8b2be2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:24.148247 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-8b467285-a841-4b3d-9273-62fd8b2be2f4 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:24.149492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-8b467285-a841-4b3d-9273-62fd8b2be2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:24.157300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:24.197417 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee82bc9-9b4a-42bd-af43-15c48e398545 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:24.207926 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee82bc9-9b4a-42bd-af43-15c48e398545 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:24.211423 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2750055-af36-43e5-9d7f-2c113099e678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:24.212064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2750055-af36-43e5-9d7f-2c113099e678 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:24.212352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2750055-af36-43e5-9d7f-2c113099e678 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:24.212664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2750055-af36-43e5-9d7f-2c113099e678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:24.221788 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2750055-af36-43e5-9d7f-2c113099e678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:24.223213 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2750055-af36-43e5-9d7f-2c113099e678 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:24.232503 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 717/1443] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:26.582630 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73933be1-a297-43eb-a514-3f41c057698e None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:26.583196 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73933be1-a297-43eb-a514-3f41c057698e None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:26.583196 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73933be1-a297-43eb-a514-3f41c057698e None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:26.584585 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:26.590350 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2f1c4-2322-413e-9b67-b906ca117b64 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:26.590809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2f1c4-2322-413e-9b67-b906ca117b64 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:26.590909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2f1c4-2322-413e-9b67-b906ca117b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:26.609250 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-45c2f1c4-2322-413e-9b67-b906ca117b64 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:26.610459 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-45c2f1c4-2322-413e-9b67-b906ca117b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:26.618198 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:26.656763 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73933be1-a297-43eb-a514-3f41c057698e None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:26.667947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73933be1-a297-43eb-a514-3f41c057698e None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:26.671404 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc22fe-7f5b-4ba0-9f18-c2ccc33a1152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:26.672033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc22fe-7f5b-4ba0-9f18-c2ccc33a1152 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:26.672314 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc22fe-7f5b-4ba0-9f18-c2ccc33a1152 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:26.672629 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc22fe-7f5b-4ba0-9f18-c2ccc33a1152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:26.681401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc22fe-7f5b-4ba0-9f18-c2ccc33a1152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:26.682813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc22fe-7f5b-4ba0-9f18-c2ccc33a1152 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:26.691892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 728/1446] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:29.175225 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176688f8-5a59-46a6-872c-2f9338f0cccf None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:29.175814 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176688f8-5a59-46a6-872c-2f9338f0cccf None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:29.175814 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176688f8-5a59-46a6-872c-2f9338f0cccf None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:29.177212 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:29.182654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024424b9-1522-4f14-8ed1-69b6c68fff82 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:29.183081 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024424b9-1522-4f14-8ed1-69b6c68fff82 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:29.183222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024424b9-1522-4f14-8ed1-69b6c68fff82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:29.201050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-024424b9-1522-4f14-8ed1-69b6c68fff82 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:29.202225 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-024424b9-1522-4f14-8ed1-69b6c68fff82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:29.209893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:29.248062 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176688f8-5a59-46a6-872c-2f9338f0cccf None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:29.258591 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176688f8-5a59-46a6-872c-2f9338f0cccf None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:29.262624 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c810df-1599-4d66-b822-f63fdb86b702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:29.263254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c810df-1599-4d66-b822-f63fdb86b702 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:29.263536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c810df-1599-4d66-b822-f63fdb86b702 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:29.263811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c810df-1599-4d66-b822-f63fdb86b702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:29.272935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c810df-1599-4d66-b822-f63fdb86b702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:29.275003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c810df-1599-4d66-b822-f63fdb86b702 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:29.284308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 720/1449] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:31.564570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b61701-cd79-4103-b0eb-110757fddf49 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:31.565096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b61701-cd79-4103-b0eb-110757fddf49 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:31.565193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b61701-cd79-4103-b0eb-110757fddf49 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:31.566501 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:31.572555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866516b8-9803-46cd-b7c9-3bee4eeda1b7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:31.572952 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866516b8-9803-46cd-b7c9-3bee4eeda1b7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:31.573126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866516b8-9803-46cd-b7c9-3bee4eeda1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:31.591559 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-866516b8-9803-46cd-b7c9-3bee4eeda1b7 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:31.592805 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-866516b8-9803-46cd-b7c9-3bee4eeda1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:31.600689 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:31.640529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b61701-cd79-4103-b0eb-110757fddf49 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:31.651654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b61701-cd79-4103-b0eb-110757fddf49 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:31.655420 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc606ca-2149-4b58-bd97-61eb9a5b57f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:31.657021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc606ca-2149-4b58-bd97-61eb9a5b57f1 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:31.657021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc606ca-2149-4b58-bd97-61eb9a5b57f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:31.657021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc606ca-2149-4b58-bd97-61eb9a5b57f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:31.666256 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc606ca-2149-4b58-bd97-61eb9a5b57f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:31.667683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc606ca-2149-4b58-bd97-61eb9a5b57f1 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:31.677091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 731/1452] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:33.843174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f24f42-81a9-47cf-a929-e30491733deb None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:33.843720 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f24f42-81a9-47cf-a929-e30491733deb None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:33.843720 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f24f42-81a9-47cf-a929-e30491733deb None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:33.845132 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:33.850270 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993763a-e0e8-444f-8217-95d4b6d3cd7b None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:33.850669 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993763a-e0e8-444f-8217-95d4b6d3cd7b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:33.850836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993763a-e0e8-444f-8217-95d4b6d3cd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:33.869488 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-2993763a-e0e8-444f-8217-95d4b6d3cd7b None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:33.870678 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2993763a-e0e8-444f-8217-95d4b6d3cd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:33.878479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:33.915950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f24f42-81a9-47cf-a929-e30491733deb None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:33.926589 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f24f42-81a9-47cf-a929-e30491733deb None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:33.930176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08564f0-1fd6-4f27-98f3-fa73d10ed733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:33.931354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08564f0-1fd6-4f27-98f3-fa73d10ed733 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:33.931638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08564f0-1fd6-4f27-98f3-fa73d10ed733 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:33.931916 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08564f0-1fd6-4f27-98f3-fa73d10ed733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:33.941303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08564f0-1fd6-4f27-98f3-fa73d10ed733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:33.942727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08564f0-1fd6-4f27-98f3-fa73d10ed733 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:33.952115 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 723/1455] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:36.150159 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673eea1c-a96d-4a85-9adb-16facb289485 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:36.150738 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673eea1c-a96d-4a85-9adb-16facb289485 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:36.150738 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673eea1c-a96d-4a85-9adb-16facb289485 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:36.152177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:36.157626 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17266f1c-28fe-4639-8bfd-6d173fc12708 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:36.158039 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17266f1c-28fe-4639-8bfd-6d173fc12708 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:36.158189 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17266f1c-28fe-4639-8bfd-6d173fc12708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:36.176336 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-17266f1c-28fe-4639-8bfd-6d173fc12708 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:36.177561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-17266f1c-28fe-4639-8bfd-6d173fc12708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:36.185451 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:36.222966 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673eea1c-a96d-4a85-9adb-16facb289485 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:36.233687 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673eea1c-a96d-4a85-9adb-16facb289485 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:36.237270 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b8abf-6b22-4bd8-b1dd-dbf6779a2703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:36.237927 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b8abf-6b22-4bd8-b1dd-dbf6779a2703 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:36.238211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b8abf-6b22-4bd8-b1dd-dbf6779a2703 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:36.238484 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b8abf-6b22-4bd8-b1dd-dbf6779a2703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:36.247532 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b8abf-6b22-4bd8-b1dd-dbf6779a2703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:36.248995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b8abf-6b22-4bd8-b1dd-dbf6779a2703 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:36.259085 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 734/1458] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:38.456663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d633ed3-2216-4c58-b962-c1159d4d27ad None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:38.457181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d633ed3-2216-4c58-b962-c1159d4d27ad None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:38.457181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d633ed3-2216-4c58-b962-c1159d4d27ad None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:38.458513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:38.463737 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3a7ae-5718-48c3-9dda-d6e609ca251b None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:38.464138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3a7ae-5718-48c3-9dda-d6e609ca251b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:38.464308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3a7ae-5718-48c3-9dda-d6e609ca251b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:38.470322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=70 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:38.482593 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-81f3a7ae-5718-48c3-9dda-d6e609ca251b None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:38.483787 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-81f3a7ae-5718-48c3-9dda-d6e609ca251b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:38.491777 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:38.529653 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d633ed3-2216-4c58-b962-c1159d4d27ad None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:38.535014 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=73 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:38.541250 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d633ed3-2216-4c58-b962-c1159d4d27ad None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:38.544977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402337b-78f5-4084-b17e-a215d27f94f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:38.545623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402337b-78f5-4084-b17e-a215d27f94f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:38.547552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402337b-78f5-4084-b17e-a215d27f94f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:38.547552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402337b-78f5-4084-b17e-a215d27f94f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:38.556038 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0402337b-78f5-4084-b17e-a215d27f94f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:38.557584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0402337b-78f5-4084-b17e-a215d27f94f8 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:38.567215 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 726/1461] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:40.747963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ccd71-719f-498f-bae3-b276c8ed3f1d None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:40.748525 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ccd71-719f-498f-bae3-b276c8ed3f1d None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:40.748525 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ccd71-719f-498f-bae3-b276c8ed3f1d None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:40.749930 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:40.755187 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f1a16-1f38-4daf-a312-950384a9d986 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:40.755638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f1a16-1f38-4daf-a312-950384a9d986 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:40.755778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f1a16-1f38-4daf-a312-950384a9d986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:40.773351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-403f1a16-1f38-4daf-a312-950384a9d986 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:40.774542 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-403f1a16-1f38-4daf-a312-950384a9d986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:40.782275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:40.819893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ccd71-719f-498f-bae3-b276c8ed3f1d None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:40.830857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ccd71-719f-498f-bae3-b276c8ed3f1d None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:40.834368 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c6d84-8bf8-483f-9ec9-4d6c0497f6a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:40.835013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c6d84-8bf8-483f-9ec9-4d6c0497f6a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:40.835301 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c6d84-8bf8-483f-9ec9-4d6c0497f6a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:40.835608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c6d84-8bf8-483f-9ec9-4d6c0497f6a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:40.844604 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c6d84-8bf8-483f-9ec9-4d6c0497f6a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:40.846063 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c6d84-8bf8-483f-9ec9-4d6c0497f6a8 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:40.855950 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 737/1464] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:43.058363 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff742c-3e22-4f62-8ec2-c74fcc346a83 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:43.058950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff742c-3e22-4f62-8ec2-c74fcc346a83 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:43.058950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff742c-3e22-4f62-8ec2-c74fcc346a83 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:43.060276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:43.065420 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c489d7-883f-4543-9d88-605451b2d219 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:43.065836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c489d7-883f-4543-9d88-605451b2d219 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:43.065982 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c489d7-883f-4543-9d88-605451b2d219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:43.083799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-f0c489d7-883f-4543-9d88-605451b2d219 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:43.085018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f0c489d7-883f-4543-9d88-605451b2d219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:43.093463 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:43.129333 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff742c-3e22-4f62-8ec2-c74fcc346a83 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:43.140869 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff742c-3e22-4f62-8ec2-c74fcc346a83 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:43.144485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33267bd6-b525-48b7-8076-f0d2f5d4791c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:43.145130 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267bd6-b525-48b7-8076-f0d2f5d4791c service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:43.145419 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267bd6-b525-48b7-8076-f0d2f5d4791c service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:43.145700 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267bd6-b525-48b7-8076-f0d2f5d4791c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:43.155193 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33267bd6-b525-48b7-8076-f0d2f5d4791c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:43.156646 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33267bd6-b525-48b7-8076-f0d2f5d4791c service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:43.166036 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 729/1467] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:45.403918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd038523-1b55-4bbe-870f-d038878029e7 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:45.404479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd038523-1b55-4bbe-870f-d038878029e7 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:45.404607 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd038523-1b55-4bbe-870f-d038878029e7 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:45.405926 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:45.411102 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55396a2-16c1-4096-8021-07a560ae5627 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:45.411521 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55396a2-16c1-4096-8021-07a560ae5627 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:45.411672 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55396a2-16c1-4096-8021-07a560ae5627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:45.431149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b55396a2-16c1-4096-8021-07a560ae5627 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:45.432352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b55396a2-16c1-4096-8021-07a560ae5627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:45.440161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:45.475818 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd038523-1b55-4bbe-870f-d038878029e7 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:45.486822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd038523-1b55-4bbe-870f-d038878029e7 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:45.490306 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be7549-aada-4fb0-a084-02b0e38c8c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:45.490942 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be7549-aada-4fb0-a084-02b0e38c8c1a service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:45.491225 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be7549-aada-4fb0-a084-02b0e38c8c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:45.491503 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be7549-aada-4fb0-a084-02b0e38c8c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:45.501455 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be7549-aada-4fb0-a084-02b0e38c8c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:45.502949 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be7549-aada-4fb0-a084-02b0e38c8c1a service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:45.512256 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 740/1470] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:55.425487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=17 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:55.508161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=17 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:05.811554 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171f90d-87c0-454c-8c04-54630800e1fc None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:05.812037 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171f90d-87c0-454c-8c04-54630800e1fc None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:05.812136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171f90d-87c0-454c-8c04-54630800e1fc None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:05.813500 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 731/1471] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:51:05.818945 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77526619-fc63-4483-a8fc-543c4c40d3a0 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:05.827516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77526619-fc63-4483-a8fc-543c4c40d3a0 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:05.827516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77526619-fc63-4483-a8fc-543c4c40d3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:05.838798 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-77526619-fc63-4483-a8fc-543c4c40d3a0 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:05.840051 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-77526619-fc63-4483-a8fc-543c4c40d3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:05.848081 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 741/1472] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:05.896534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e7178-ad8c-455a-b3ab-3e7e94146140 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:05.896831 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e7178-ad8c-455a-b3ab-3e7e94146140 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:05.897114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e7178-ad8c-455a-b3ab-3e7e94146140 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:05.898514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 732/1473] 10.222.0.93 () {54 vars in 962 bytes} [Thu Jun 16 18:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:51:05.903496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b0e77-a8d5-4c86-a25d-9c1cd6cb6591 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:05.916013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b0e77-a8d5-4c86-a25d-9c1cd6cb6591 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:05.916013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b0e77-a8d5-4c86-a25d-9c1cd6cb6591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:05.922405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-739b0e77-a8d5-4c86-a25d-9c1cd6cb6591 None None] MFA Rules not processed for user `00c13f10b14449cea284eb629a316d83`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:05.923597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-739b0e77-a8d5-4c86-a25d-9c1cd6cb6591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:05.930600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 742/1474] 10.222.0.93 () {58 vars in 1059 bytes} [Thu Jun 16 18:51:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:05.937758 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e7178-ad8c-455a-b3ab-3e7e94146140 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:05.948244 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e7178-ad8c-455a-b3ab-3e7e94146140 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:05.951743 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ff575-06c9-4fc3-a7dd-5b9a27dfbc65 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00c13f10b14449cea284eb629a316d83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:05.952376 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ff575-06c9-4fc3-a7dd-5b9a27dfbc65 service glance] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:05.952694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ff575-06c9-4fc3-a7dd-5b9a27dfbc65 service glance] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:05.952972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ff575-06c9-4fc3-a7dd-5b9a27dfbc65 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:05.961898 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ff575-06c9-4fc3-a7dd-5b9a27dfbc65 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:05.963435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ff575-06c9-4fc3-a7dd-5b9a27dfbc65 service glance] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:05.972801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 733/1475] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:08.212395 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b214d-b209-4fd2-ab74-30230e5aa305 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:08.212999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b214d-b209-4fd2-ab74-30230e5aa305 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:08.212999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b214d-b209-4fd2-ab74-30230e5aa305 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:08.214465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 743/1476] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:51:08.219676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342152b-aea3-4edf-8877-bbccb201a9a1 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:08.220088 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342152b-aea3-4edf-8877-bbccb201a9a1 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:08.220246 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342152b-aea3-4edf-8877-bbccb201a9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:08.237699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-9342152b-aea3-4edf-8877-bbccb201a9a1 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:08.238892 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9342152b-aea3-4edf-8877-bbccb201a9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:08.247883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 734/1477] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:08.271565 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b214d-b209-4fd2-ab74-30230e5aa305 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:08.284738 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b214d-b209-4fd2-ab74-30230e5aa305 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:08.289207 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e13b8-3a97-4e0b-a048-1f229847cf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:08.289862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e13b8-3a97-4e0b-a048-1f229847cf9c admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:08.290147 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e13b8-3a97-4e0b-a048-1f229847cf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:08.290426 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e13b8-3a97-4e0b-a048-1f229847cf9c admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:08.291161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e13b8-3a97-4e0b-a048-1f229847cf9c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:08.292984 dv-cinder-813229-10-smb devstack@keystone.service[86943]: WARNING py.warnings [None req-061e13b8-3a97-4e0b-a048-1f229847cf9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:51:08.292984 dv-cinder-813229-10-smb devstack@keystone.service[86943]: warnings.warn(msg) Jun 16 18:51:08.292984 dv-cinder-813229-10-smb devstack@keystone.service[86943]: Jun 16 18:51:08.294173 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e13b8-3a97-4e0b-a048-1f229847cf9c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:08.313023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 744/1478] 10.222.0.93 () {56 vars in 1108 bytes} [Thu Jun 16 18:51:08 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:10.468872 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4286999-905d-4875-ba97-943e18967e02 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:10.469734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4286999-905d-4875-ba97-943e18967e02 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:10.469734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4286999-905d-4875-ba97-943e18967e02 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:10.471296 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 735/1479] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:51:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:51:10.476620 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f581-539f-4c1e-bc0a-447d7ad6437e None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:10.477087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f581-539f-4c1e-bc0a-447d7ad6437e None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:10.477307 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f581-539f-4c1e-bc0a-447d7ad6437e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:10.496210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-5c27f581-539f-4c1e-bc0a-447d7ad6437e None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:10.497531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5c27f581-539f-4c1e-bc0a-447d7ad6437e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:10.506329 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 745/1480] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:10.550908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4286999-905d-4875-ba97-943e18967e02 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:10.565184 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4286999-905d-4875-ba97-943e18967e02 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:10.571159 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a19ec-c61d-41f5-af3e-2be52c3b96dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:10.571797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a19ec-c61d-41f5-af3e-2be52c3b96dc service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:10.572087 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a19ec-c61d-41f5-af3e-2be52c3b96dc service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:10.572408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a19ec-c61d-41f5-af3e-2be52c3b96dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:10.580707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a19ec-c61d-41f5-af3e-2be52c3b96dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:10.582296 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a19ec-c61d-41f5-af3e-2be52c3b96dc service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:10.592528 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 736/1481] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:12.964898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047233e-6d26-4689-842f-1b2667fb8d85 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:12.965926 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047233e-6d26-4689-842f-1b2667fb8d85 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:12.965926 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047233e-6d26-4689-842f-1b2667fb8d85 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:12.967039 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 746/1482] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:51:12.972143 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d585e-1d29-4ceb-ba12-ef45ee35cbf0 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:12.972661 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d585e-1d29-4ceb-ba12-ef45ee35cbf0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:12.972760 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d585e-1d29-4ceb-ba12-ef45ee35cbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:12.991135 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-dc4d585e-1d29-4ceb-ba12-ef45ee35cbf0 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:12.992342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-dc4d585e-1d29-4ceb-ba12-ef45ee35cbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:13.000550 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 737/1483] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:13.036629 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047233e-6d26-4689-842f-1b2667fb8d85 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:13.047666 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047233e-6d26-4689-842f-1b2667fb8d85 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:13.051157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347729e-a850-4275-9357-c14975deb7d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:13.051784 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347729e-a850-4275-9357-c14975deb7d6 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:13.052088 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347729e-a850-4275-9357-c14975deb7d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:13.052365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347729e-a850-4275-9357-c14975deb7d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:13.061015 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347729e-a850-4275-9357-c14975deb7d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:13.062430 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347729e-a850-4275-9357-c14975deb7d6 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:13.071546 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 747/1484] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:15.250619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23b704-29d4-437a-8f28-afee33d37da4 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:15.251185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23b704-29d4-437a-8f28-afee33d37da4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:15.251185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23b704-29d4-437a-8f28-afee33d37da4 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:15.252575 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 738/1485] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:51:15.257924 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa0406-7712-4f55-bd02-db11be60b8c8 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:15.258364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa0406-7712-4f55-bd02-db11be60b8c8 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:15.258479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa0406-7712-4f55-bd02-db11be60b8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:15.278698 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-f3fa0406-7712-4f55-bd02-db11be60b8c8 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:15.279893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f3fa0406-7712-4f55-bd02-db11be60b8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:15.287895 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 748/1486] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:15.325992 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23b704-29d4-437a-8f28-afee33d37da4 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:15.337583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23b704-29d4-437a-8f28-afee33d37da4 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:15.341094 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc796513-b816-4135-8861-0cd1d37db47f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:15.341745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc796513-b816-4135-8861-0cd1d37db47f service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:15.342029 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc796513-b816-4135-8861-0cd1d37db47f service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:15.342306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc796513-b816-4135-8861-0cd1d37db47f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:15.351284 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc796513-b816-4135-8861-0cd1d37db47f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:15.353388 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc796513-b816-4135-8861-0cd1d37db47f service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:15.362975 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 739/1487] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:51:17.656276 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da475e8-f3ed-46b6-abdc-c53ef91d893f None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:17.656884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da475e8-f3ed-46b6-abdc-c53ef91d893f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:17.656884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da475e8-f3ed-46b6-abdc-c53ef91d893f None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:17.658139 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 749/1488] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:51:17.663222 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533d454-d298-44e5-94ab-6a4348160bd6 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:17.663695 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533d454-d298-44e5-94ab-6a4348160bd6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:17.663812 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533d454-d298-44e5-94ab-6a4348160bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:17.681568 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a533d454-d298-44e5-94ab-6a4348160bd6 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:17.682755 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a533d454-d298-44e5-94ab-6a4348160bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:17.690450 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 740/1489] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:17.730367 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da475e8-f3ed-46b6-abdc-c53ef91d893f None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:17.741548 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da475e8-f3ed-46b6-abdc-c53ef91d893f None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:17.745354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c63c0-8766-41c5-a948-1d2d8d2f89c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:17.745991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c63c0-8766-41c5-a948-1d2d8d2f89c1 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:17.746274 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c63c0-8766-41c5-a948-1d2d8d2f89c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:17.746549 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c63c0-8766-41c5-a948-1d2d8d2f89c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:17.755426 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c63c0-8766-41c5-a948-1d2d8d2f89c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:17.756894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c63c0-8766-41c5-a948-1d2d8d2f89c1 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:17.766668 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 750/1490] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:20.440699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f90ae8-43de-47e3-b07b-2af4759deffc None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:20.441295 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f90ae8-43de-47e3-b07b-2af4759deffc None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:20.441295 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f90ae8-43de-47e3-b07b-2af4759deffc None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:20.442593 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 741/1491] 10.222.0.93 () {54 vars in 926 bytes} [Thu Jun 16 18:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:51:20.447737 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af71240-07e1-4d13-91b7-09ecd2087b87 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:20.448229 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af71240-07e1-4d13-91b7-09ecd2087b87 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:20.448346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af71240-07e1-4d13-91b7-09ecd2087b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:20.466135 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-3af71240-07e1-4d13-91b7-09ecd2087b87 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:20.467318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-3af71240-07e1-4d13-91b7-09ecd2087b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:20.475443 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 751/1492] 10.222.0.93 () {58 vars in 1023 bytes} [Thu Jun 16 18:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:20.515854 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f90ae8-43de-47e3-b07b-2af4759deffc None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:20.526887 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f90ae8-43de-47e3-b07b-2af4759deffc None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:20.530334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc569dd5-5c07-43c7-b29e-1b01ed955b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:20.530960 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc569dd5-5c07-43c7-b29e-1b01ed955b9f service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:20.531241 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc569dd5-5c07-43c7-b29e-1b01ed955b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:20.531515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc569dd5-5c07-43c7-b29e-1b01ed955b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:20.540747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc569dd5-5c07-43c7-b29e-1b01ed955b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:20.542156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc569dd5-5c07-43c7-b29e-1b01ed955b9f service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:20.551362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 742/1493] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:30.460751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=33 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:30.547218 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=33 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:54.210420 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bd138-a016-4930-b4e8-badf7ffb649e None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:54.211019 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bd138-a016-4930-b4e8-badf7ffb649e None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:54.211019 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bd138-a016-4930-b4e8-badf7ffb649e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:54.228950 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-cb7bd138-a016-4930-b4e8-badf7ffb649e None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:54.230125 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-cb7bd138-a016-4930-b4e8-badf7ffb649e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:54.238399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 752/1494] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:54.247450 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fd2ac-cf36-4ac3-8e83-acbef2350d1a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:54.247972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fd2ac-cf36-4ac3-8e83-acbef2350d1a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:54.248076 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fd2ac-cf36-4ac3-8e83-acbef2350d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:54.265766 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-ca0fd2ac-cf36-4ac3-8e83-acbef2350d1a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:54.266955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ca0fd2ac-cf36-4ac3-8e83-acbef2350d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:54.274765 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 743/1495] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:54.279210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bd138-a016-4930-b4e8-badf7ffb649e None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:54.289394 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bd138-a016-4930-b4e8-badf7ffb649e None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:54.293848 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da18aec-282a-471b-9ec7-893f1e408cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:54.294501 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da18aec-282a-471b-9ec7-893f1e408cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:54.294781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da18aec-282a-471b-9ec7-893f1e408cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:54.295053 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da18aec-282a-471b-9ec7-893f1e408cd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:54.295765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da18aec-282a-471b-9ec7-893f1e408cd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:52:54.296068 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da18aec-282a-471b-9ec7-893f1e408cd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:54.297111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: WARNING py.warnings [None req-7da18aec-282a-471b-9ec7-893f1e408cd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:52:54.297111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: warnings.warn(msg) Jun 16 18:52:54.297111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: Jun 16 18:52:54.297996 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da18aec-282a-471b-9ec7-893f1e408cd7 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:54.309847 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 753/1496] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:52:54.317860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fd2ac-cf36-4ac3-8e83-acbef2350d1a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:54.326989 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fd2ac-cf36-4ac3-8e83-acbef2350d1a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:54.331579 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99794e-d00e-4aca-9d89-07e641cf681d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:54.332231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99794e-d00e-4aca-9d89-07e641cf681d admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:54.332554 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99794e-d00e-4aca-9d89-07e641cf681d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:54.332836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99794e-d00e-4aca-9d89-07e641cf681d admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:54.333547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99794e-d00e-4aca-9d89-07e641cf681d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:54.335320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: WARNING py.warnings [None req-1d99794e-d00e-4aca-9d89-07e641cf681d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:52:54.335320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: warnings.warn(msg) Jun 16 18:52:54.335320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: Jun 16 18:52:54.336547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99794e-d00e-4aca-9d89-07e641cf681d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:54.500135 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 744/1497] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:52:54 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:54.504764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da18aec-282a-471b-9ec7-893f1e408cd7 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:54.514557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da18aec-282a-471b-9ec7-893f1e408cd7 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:54.570180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f1f84-f766-4259-b21c-efaacfe57e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:54.570861 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f1f84-f766-4259-b21c-efaacfe57e7d admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:54.571151 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f1f84-f766-4259-b21c-efaacfe57e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:54.571434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f1f84-f766-4259-b21c-efaacfe57e7d admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:54.572185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f1f84-f766-4259-b21c-efaacfe57e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:54.573337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: WARNING py.warnings [None req-438f1f84-f766-4259-b21c-efaacfe57e7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:52:54.573337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: warnings.warn(msg) Jun 16 18:52:54.573337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: Jun 16 18:52:54.574551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f1f84-f766-4259-b21c-efaacfe57e7d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:54.647181 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 754/1498] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:52:54 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:54.651335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99794e-d00e-4aca-9d89-07e641cf681d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:54.662174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99794e-d00e-4aca-9d89-07e641cf681d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:54.666777 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472f04f-1926-4960-9333-692bc6738e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:54.667461 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472f04f-1926-4960-9333-692bc6738e75 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:54.667730 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472f04f-1926-4960-9333-692bc6738e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:54.668008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472f04f-1926-4960-9333-692bc6738e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:54.668782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472f04f-1926-4960-9333-692bc6738e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:54.669808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: WARNING py.warnings [None req-1472f04f-1926-4960-9333-692bc6738e75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:52:54.669808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: warnings.warn(msg) Jun 16 18:52:54.669808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: Jun 16 18:52:54.670687 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472f04f-1926-4960-9333-692bc6738e75 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:54.683327 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 745/1499] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:54.687463 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f1f84-f766-4259-b21c-efaacfe57e7d admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:54.697174 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f1f84-f766-4259-b21c-efaacfe57e7d admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:54.701680 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c0fc1-ed46-47d2-a7a8-6ae3320853bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:54.702338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c0fc1-ed46-47d2-a7a8-6ae3320853bd admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:54.702621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c0fc1-ed46-47d2-a7a8-6ae3320853bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:54.702897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c0fc1-ed46-47d2-a7a8-6ae3320853bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:54.703618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c0fc1-ed46-47d2-a7a8-6ae3320853bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:54.704657 dv-cinder-813229-10-smb devstack@keystone.service[86943]: WARNING py.warnings [None req-249c0fc1-ed46-47d2-a7a8-6ae3320853bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:52:54.704657 dv-cinder-813229-10-smb devstack@keystone.service[86943]: warnings.warn(msg) Jun 16 18:52:54.704657 dv-cinder-813229-10-smb devstack@keystone.service[86943]: Jun 16 18:52:54.705528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c0fc1-ed46-47d2-a7a8-6ae3320853bd admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:54.719191 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 755/1500] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:54.723831 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472f04f-1926-4960-9333-692bc6738e75 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:54.733964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472f04f-1926-4960-9333-692bc6738e75 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:54.738467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5474c92-3b03-467a-8fc1-e7aaded0ba5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:54.739394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5474c92-3b03-467a-8fc1-e7aaded0ba5c admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:54.739680 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5474c92-3b03-467a-8fc1-e7aaded0ba5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:54.739953 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5474c92-3b03-467a-8fc1-e7aaded0ba5c admin admin] PATH_INFO: `/v3/projects/d0a210ff96894d32b161f101c4161fff/users/d4d863e5bc744e0bbd8c2dab18d17191/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:54.754448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5474c92-3b03-467a-8fc1-e7aaded0ba5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a210ff96894d32b161f101c4161fff, user_id=d4d863e5bc744e0bbd8c2dab18d17191, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:54.755430 dv-cinder-813229-10-smb devstack@keystone.service[86942]: WARNING py.warnings [None req-f5474c92-3b03-467a-8fc1-e7aaded0ba5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:52:54.755430 dv-cinder-813229-10-smb devstack@keystone.service[86942]: warnings.warn(msg) Jun 16 18:52:54.755430 dv-cinder-813229-10-smb devstack@keystone.service[86942]: Jun 16 18:52:54.757387 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5474c92-3b03-467a-8fc1-e7aaded0ba5c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:54.824767 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 746/1501] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:52:54 2022] PUT /identity/v3/projects/d0a210ff96894d32b161f101c4161fff/users/d4d863e5bc744e0bbd8c2dab18d17191/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:54.836835 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc6e3b-fb8c-465c-8c25-ad3905251fd0 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:54.837122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc6e3b-fb8c-465c-8c25-ad3905251fd0 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:54.837398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc6e3b-fb8c-465c-8c25-ad3905251fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:54.863492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-02bc6e3b-fb8c-465c-8c25-ad3905251fd0 None None] MFA Rules not processed for user `d4d863e5bc744e0bbd8c2dab18d17191`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:54.867687 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-02bc6e3b-fb8c-465c-8c25-ad3905251fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:54.927495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 756/1502] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:52:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:54.941372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f2123-d02f-43af-b8ec-ebe84c81855f None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:54.941668 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f2123-d02f-43af-b8ec-ebe84c81855f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:54.941945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f2123-d02f-43af-b8ec-ebe84c81855f None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:54.943302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 747/1503] 10.222.0.93 () {54 vars in 963 bytes} [Thu Jun 16 18:52:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:52:54.948285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0bec1-9349-4a3e-8899-e2b258ee0e3e None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:54.948620 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0bec1-9349-4a3e-8899-e2b258ee0e3e None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:54.948905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0bec1-9349-4a3e-8899-e2b258ee0e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:54.966896 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-00c0bec1-9349-4a3e-8899-e2b258ee0e3e None None] MFA Rules not processed for user `3862d73c187e403fb1e1ef4e1984cee7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:54.968074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-00c0bec1-9349-4a3e-8899-e2b258ee0e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:55.010086 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:55.017405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 757/1504] 10.222.0.93 () {58 vars in 1060 bytes} [Thu Jun 16 18:52:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:52:55.025676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f2123-d02f-43af-b8ec-ebe84c81855f None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:55.036206 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f2123-d02f-43af-b8ec-ebe84c81855f None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:55.039702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff540c-f13a-4e47-be53-a66fad4e0439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:55.040338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff540c-f13a-4e47-be53-a66fad4e0439 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:55.040655 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff540c-f13a-4e47-be53-a66fad4e0439 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:55.040938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff540c-f13a-4e47-be53-a66fad4e0439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:55.049257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff540c-f13a-4e47-be53-a66fad4e0439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:55.050714 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff540c-f13a-4e47-be53-a66fad4e0439 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:55.059572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 748/1505] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:55.102984 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e57db-73fc-4178-89e4-7caf2a661f26 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:55.103279 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e57db-73fc-4178-89e4-7caf2a661f26 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:55.103587 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e57db-73fc-4178-89e4-7caf2a661f26 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:55.104912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 758/1506] 10.222.0.93 () {52 vars in 829 bytes} [Thu Jun 16 18:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:52:55.108571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff540c-f13a-4e47-be53-a66fad4e0439 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:55.169289 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff540c-f13a-4e47-be53-a66fad4e0439 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:55.173700 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e076c5-f720-4d06-9682-c47a3c7ed1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:55.174563 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e076c5-f720-4d06-9682-c47a3c7ed1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:55.175356 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e076c5-f720-4d06-9682-c47a3c7ed1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:55.175631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e076c5-f720-4d06-9682-c47a3c7ed1b7 admin admin] PATH_INFO: `/v3/users/d4d863e5bc744e0bbd8c2dab18d17191` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:55.176845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e076c5-f720-4d06-9682-c47a3c7ed1b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d863e5bc744e0bbd8c2dab18d17191)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:55.177860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: WARNING py.warnings [None req-21e076c5-f720-4d06-9682-c47a3c7ed1b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:52:55.177860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: warnings.warn(msg) Jun 16 18:52:55.177860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: Jun 16 18:52:55.179066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e076c5-f720-4d06-9682-c47a3c7ed1b7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:55.418881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-21e076c5-f720-4d06-9682-c47a3c7ed1b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d863e5bc744e0bbd8c2dab18d17191'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:55.419627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-21e076c5-f720-4d06-9682-c47a3c7ed1b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d863e5bc744e0bbd8c2dab18d17191'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:55.481301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-21e076c5-f720-4d06-9682-c47a3c7ed1b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d863e5bc744e0bbd8c2dab18d17191'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:55.494414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-21e076c5-f720-4d06-9682-c47a3c7ed1b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d863e5bc744e0bbd8c2dab18d17191'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:55.510630 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:55.513516 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-21e076c5-f720-4d06-9682-c47a3c7ed1b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d863e5bc744e0bbd8c2dab18d17191'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:55.519967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 749/1507] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:52:55 2022] DELETE /identity/v3/users/d4d863e5bc744e0bbd8c2dab18d17191 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:55.524455 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51819a1e-a596-4aa0-b434-c6dd208d3fd4 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:55.524991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51819a1e-a596-4aa0-b434-c6dd208d3fd4 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:55.524991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51819a1e-a596-4aa0-b434-c6dd208d3fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:55.542952 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-51819a1e-a596-4aa0-b434-c6dd208d3fd4 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:55.544147 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-51819a1e-a596-4aa0-b434-c6dd208d3fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:55.601789 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 759/1508] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:55.611437 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e076c5-f720-4d06-9682-c47a3c7ed1b7 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:55.613454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-21e076c5-f720-4d06-9682-c47a3c7ed1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:55.670347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e076c5-f720-4d06-9682-c47a3c7ed1b7 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:55.673898 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e86388-b310-4fdc-82e5-f3040c07e31e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:55.674546 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e86388-b310-4fdc-82e5-f3040c07e31e service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:55.674833 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e86388-b310-4fdc-82e5-f3040c07e31e service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:55.676158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e86388-b310-4fdc-82e5-f3040c07e31e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:55.688222 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e86388-b310-4fdc-82e5-f3040c07e31e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:55.689721 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e86388-b310-4fdc-82e5-f3040c07e31e service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:55.699970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 750/1509] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:56.129781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51819a1e-a596-4aa0-b434-c6dd208d3fd4 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:56.131199 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-51819a1e-a596-4aa0-b434-c6dd208d3fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:56.142943 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51819a1e-a596-4aa0-b434-c6dd208d3fd4 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:56.147572 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fe195-77a9-4e7a-8d9c-efb82ee18c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:56.148450 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fe195-77a9-4e7a-8d9c-efb82ee18c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:56.151188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fe195-77a9-4e7a-8d9c-efb82ee18c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:56.151188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fe195-77a9-4e7a-8d9c-efb82ee18c10 admin admin] PATH_INFO: `/v3/projects/d0a210ff96894d32b161f101c4161fff` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:56.151188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628fe195-77a9-4e7a-8d9c-efb82ee18c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a210ff96894d32b161f101c4161fff)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:56.151188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: WARNING py.warnings [None req-628fe195-77a9-4e7a-8d9c-efb82ee18c10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:52:56.151188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: warnings.warn(msg) Jun 16 18:52:56.151188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: Jun 16 18:52:56.152338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628fe195-77a9-4e7a-8d9c-efb82ee18c10 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:56.260027 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-628fe195-77a9-4e7a-8d9c-efb82ee18c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a210ff96894d32b161f101c4161fff', 'request_id': 'req-628fe195-77a9-4e7a-8d9c-efb82ee18c10'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:56.304574 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-628fe195-77a9-4e7a-8d9c-efb82ee18c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a210ff96894d32b161f101c4161fff', 'request_id': 'req-628fe195-77a9-4e7a-8d9c-efb82ee18c10'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:56.318485 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-628fe195-77a9-4e7a-8d9c-efb82ee18c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a210ff96894d32b161f101c4161fff', 'request_id': 'req-628fe195-77a9-4e7a-8d9c-efb82ee18c10'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:56.329668 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-628fe195-77a9-4e7a-8d9c-efb82ee18c10 admin admin] The token cache is being invalidate because project d0a210ff96894d32b161f101c4161fff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:52:56.329962 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-628fe195-77a9-4e7a-8d9c-efb82ee18c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:56.330721 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-628fe195-77a9-4e7a-8d9c-efb82ee18c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:56.332345 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 760/1510] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:52:56 2022] DELETE /identity/v3/projects/d0a210ff96894d32b161f101c4161fff => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:53:05.695787 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:06.326316 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:47.797179 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74faab3e-72e7-4d74-bf53-875b4d3fb485 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:47.797779 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74faab3e-72e7-4d74-bf53-875b4d3fb485 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:47.797779 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74faab3e-72e7-4d74-bf53-875b4d3fb485 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:47.799123 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:54:47.804101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217894b4-07a1-433a-9fed-c5b767ba236b None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:47.804556 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217894b4-07a1-433a-9fed-c5b767ba236b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:47.804694 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217894b4-07a1-433a-9fed-c5b767ba236b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:47.823361 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-217894b4-07a1-433a-9fed-c5b767ba236b None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:54:47.824593 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-217894b4-07a1-433a-9fed-c5b767ba236b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:54:47.881943 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:54:48.052650 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74faab3e-72e7-4d74-bf53-875b4d3fb485 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:54:48.054417 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-74faab3e-72e7-4d74-bf53-875b4d3fb485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:54:48.130253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74faab3e-72e7-4d74-bf53-875b4d3fb485 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:54:48.135961 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c2b31-5de8-4e46-8f54-7d4a0d4f7d78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:54:48.136645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c2b31-5de8-4e46-8f54-7d4a0d4f7d78 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:48.136940 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c2b31-5de8-4e46-8f54-7d4a0d4f7d78 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:48.137221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c2b31-5de8-4e46-8f54-7d4a0d4f7d78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:48.145536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c2b31-5de8-4e46-8f54-7d4a0d4f7d78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:54:48.147132 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c2b31-5de8-4e46-8f54-7d4a0d4f7d78 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:54:48.156532 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 752/1513] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:54:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:54:49.048858 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29fabe-405a-4cb4-9590-65555d42c3ee None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:49.049458 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29fabe-405a-4cb4-9590-65555d42c3ee None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:49.049799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29fabe-405a-4cb4-9590-65555d42c3ee None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:49.052489 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:54:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:54:49.057567 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325f3bb-d14b-4b3d-a787-dd92ea1c9eda None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:49.058047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325f3bb-d14b-4b3d-a787-dd92ea1c9eda None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:49.058198 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325f3bb-d14b-4b3d-a787-dd92ea1c9eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:49.078712 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c325f3bb-d14b-4b3d-a787-dd92ea1c9eda None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:54:49.080827 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c325f3bb-d14b-4b3d-a787-dd92ea1c9eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:54:49.090089 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:54:49.106496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded39fd9-512e-4289-871e-71411314535a None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:49.106856 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded39fd9-512e-4289-871e-71411314535a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:49.107254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded39fd9-512e-4289-871e-71411314535a None None] PATH_INFO: `/v3` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:49.108644 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 763/1516] 10.222.0.43 () {54 vars in 925 bytes} [Thu Jun 16 18:54:49 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:54:49.114267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cbbf6-5ab7-4df2-8224-6b6cb8c15699 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:49.120201 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cbbf6-5ab7-4df2-8224-6b6cb8c15699 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:49.120201 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cbbf6-5ab7-4df2-8224-6b6cb8c15699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:49.136198 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-7c3cbbf6-5ab7-4df2-8224-6b6cb8c15699 None None] MFA Rules not processed for user `3abe1d47a1164776bf3a82fe4b129d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:54:49.137434 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7c3cbbf6-5ab7-4df2-8224-6b6cb8c15699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:54:49.200091 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 754/1517] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Jun 16 18:54:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:54:49.245615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded39fd9-512e-4289-871e-71411314535a None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:54:49.261119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded39fd9-512e-4289-871e-71411314535a None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:54:49.266516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc6b5d-551a-4f13-88b9-70bb5c0a1a68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:54:49.267161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc6b5d-551a-4f13-88b9-70bb5c0a1a68 service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:49.267470 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc6b5d-551a-4f13-88b9-70bb5c0a1a68 service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:49.267734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc6b5d-551a-4f13-88b9-70bb5c0a1a68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:49.276262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc6b5d-551a-4f13-88b9-70bb5c0a1a68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:54:49.277910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc6b5d-551a-4f13-88b9-70bb5c0a1a68 service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:54:49.287412 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 764/1518] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:54:53.187438 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a79a2-32d8-4136-959b-db200d5974f8 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:53.188234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a79a2-32d8-4136-959b-db200d5974f8 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:53.188417 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a79a2-32d8-4136-959b-db200d5974f8 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:53.190395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 755/1519] 10.222.0.93 () {54 vars in 960 bytes} [Thu Jun 16 18:54:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:54:53.195418 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa4430-dc37-4378-964d-2eb1ebffa8db None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:53.195868 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa4430-dc37-4378-964d-2eb1ebffa8db None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:53.196020 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa4430-dc37-4378-964d-2eb1ebffa8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:53.215290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-75aa4430-dc37-4378-964d-2eb1ebffa8db None None] MFA Rules not processed for user `3abe1d47a1164776bf3a82fe4b129d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:54:53.216611 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-75aa4430-dc37-4378-964d-2eb1ebffa8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:54:53.225359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 765/1520] 10.222.0.93 () {58 vars in 1057 bytes} [Thu Jun 16 18:54:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:54:53.233581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a79a2-32d8-4136-959b-db200d5974f8 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:54:53.246969 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a79a2-32d8-4136-959b-db200d5974f8 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:54:53.252001 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ba2c5-7c34-4dd3-922d-abb9f3aa27da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3abe1d47a1164776bf3a82fe4b129d9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:54:53.252729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ba2c5-7c34-4dd3-922d-abb9f3aa27da service placement] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:53.253021 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ba2c5-7c34-4dd3-922d-abb9f3aa27da service placement] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:53.253307 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ba2c5-7c34-4dd3-922d-abb9f3aa27da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:53.262899 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ba2c5-7c34-4dd3-922d-abb9f3aa27da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:54:53.264549 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ba2c5-7c34-4dd3-922d-abb9f3aa27da service placement] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:54:53.274766 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 756/1521] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:54:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:00.581261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efe76f-434f-4a22-b7fe-e376ce20ed20 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:00.582134 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efe76f-434f-4a22-b7fe-e376ce20ed20 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:00.582134 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efe76f-434f-4a22-b7fe-e376ce20ed20 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:00.583671 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:55:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:55:00.590004 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a709cd-9bae-405d-b6dc-c515ef8ba4ed None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:00.590517 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a709cd-9bae-405d-b6dc-c515ef8ba4ed None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:00.590656 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a709cd-9bae-405d-b6dc-c515ef8ba4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:00.608425 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-50a709cd-9bae-405d-b6dc-c515ef8ba4ed None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:00.609669 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-50a709cd-9bae-405d-b6dc-c515ef8ba4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:00.617817 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:55:00.773793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efe76f-434f-4a22-b7fe-e376ce20ed20 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:00.788713 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efe76f-434f-4a22-b7fe-e376ce20ed20 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:00.794746 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f26538-a02b-4c97-b9e7-22d71465e8be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:00.795399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f26538-a02b-4c97-b9e7-22d71465e8be service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:00.795693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f26538-a02b-4c97-b9e7-22d71465e8be service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:00.795974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f26538-a02b-4c97-b9e7-22d71465e8be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:00.805112 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f26538-a02b-4c97-b9e7-22d71465e8be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:00.806792 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f26538-a02b-4c97-b9e7-22d71465e8be service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:00.816920 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 767/1524] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:01.709032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb0876-ecbf-4716-9ec5-d80c082a1b15 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:01.709628 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb0876-ecbf-4716-9ec5-d80c082a1b15 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:01.709628 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb0876-ecbf-4716-9ec5-d80c082a1b15 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:01.710884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:55:01.715957 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d759d-5f1a-4e79-9144-b772baf4db9b None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:01.716421 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d759d-5f1a-4e79-9144-b772baf4db9b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:01.716560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d759d-5f1a-4e79-9144-b772baf4db9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:01.734661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-ae6d759d-5f1a-4e79-9144-b772baf4db9b None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:01.735863 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-ae6d759d-5f1a-4e79-9144-b772baf4db9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:01.743754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:01.896547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb0876-ecbf-4716-9ec5-d80c082a1b15 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:01.911298 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb0876-ecbf-4716-9ec5-d80c082a1b15 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:01.917175 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324fadf-588c-4e32-9059-d6418d8a1be8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:01.917806 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324fadf-588c-4e32-9059-d6418d8a1be8 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:01.918086 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324fadf-588c-4e32-9059-d6418d8a1be8 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:01.918357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324fadf-588c-4e32-9059-d6418d8a1be8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:01.926664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324fadf-588c-4e32-9059-d6418d8a1be8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:01.928242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324fadf-588c-4e32-9059-d6418d8a1be8 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:01.937649 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 759/1527] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:06.006890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37224a61-2578-45e0-9c77-4c5a75931cd5 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:06.007478 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37224a61-2578-45e0-9c77-4c5a75931cd5 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:06.007478 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37224a61-2578-45e0-9c77-4c5a75931cd5 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:06.009357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:55:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:55:06.015381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7653657-5471-4277-a744-d16a8c06328a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:06.015851 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7653657-5471-4277-a744-d16a8c06328a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:06.015954 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7653657-5471-4277-a744-d16a8c06328a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:06.034383 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a7653657-5471-4277-a744-d16a8c06328a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:06.035626 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a7653657-5471-4277-a744-d16a8c06328a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:06.043533 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:55:06.079098 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37224a61-2578-45e0-9c77-4c5a75931cd5 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:06.080882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-37224a61-2578-45e0-9c77-4c5a75931cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:06.138749 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37224a61-2578-45e0-9c77-4c5a75931cd5 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:06.142265 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f17e0-635f-41c7-aff7-d41d876652b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:06.142941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f17e0-635f-41c7-aff7-d41d876652b4 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:06.143230 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f17e0-635f-41c7-aff7-d41d876652b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:06.143509 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f17e0-635f-41c7-aff7-d41d876652b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:06.152949 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f17e0-635f-41c7-aff7-d41d876652b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:06.154396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f17e0-635f-41c7-aff7-d41d876652b4 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:06.163696 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 770/1530] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:08.305961 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40264d6-8888-4223-a5a4-78ed2ede1b33 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:08.306547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40264d6-8888-4223-a5a4-78ed2ede1b33 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:08.306674 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40264d6-8888-4223-a5a4-78ed2ede1b33 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:08.308618 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:55:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:55:08.313835 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e2274-4832-45eb-bdfa-8c543f337d53 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:08.314289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e2274-4832-45eb-bdfa-8c543f337d53 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:08.314424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e2274-4832-45eb-bdfa-8c543f337d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:08.335998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-026e2274-4832-45eb-bdfa-8c543f337d53 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:08.337226 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-026e2274-4832-45eb-bdfa-8c543f337d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:08.345559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:08.383659 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40264d6-8888-4223-a5a4-78ed2ede1b33 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:08.385455 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c40264d6-8888-4223-a5a4-78ed2ede1b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:08.398338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40264d6-8888-4223-a5a4-78ed2ede1b33 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:08.401834 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9226c1-8aef-402b-a137-d1d2f7bb8cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:08.402594 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9226c1-8aef-402b-a137-d1d2f7bb8cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:08.402878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9226c1-8aef-402b-a137-d1d2f7bb8cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:08.403155 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9226c1-8aef-402b-a137-d1d2f7bb8cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:08.412605 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9226c1-8aef-402b-a137-d1d2f7bb8cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:08.414112 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9226c1-8aef-402b-a137-d1d2f7bb8cc6 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:08.424528 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 762/1533] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:12.279189 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda9906-9154-41cf-a415-351df1421039 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:12.279694 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda9906-9154-41cf-a415-351df1421039 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:12.279811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda9906-9154-41cf-a415-351df1421039 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:12.281485 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:55:12.287057 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc62a66-4cad-40e8-ac8a-371cc52d6e86 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:12.287552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc62a66-4cad-40e8-ac8a-371cc52d6e86 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:12.287777 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc62a66-4cad-40e8-ac8a-371cc52d6e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:12.306602 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-3bc62a66-4cad-40e8-ac8a-371cc52d6e86 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:12.308482 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3bc62a66-4cad-40e8-ac8a-371cc52d6e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:12.316348 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:12.584262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda9906-9154-41cf-a415-351df1421039 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:12.586124 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-ceda9906-9154-41cf-a415-351df1421039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:12.645574 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda9906-9154-41cf-a415-351df1421039 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:12.649194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5ad8c-2dca-4a30-84b4-130708e39554 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:12.649847 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5ad8c-2dca-4a30-84b4-130708e39554 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:12.650136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5ad8c-2dca-4a30-84b4-130708e39554 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:12.650420 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5ad8c-2dca-4a30-84b4-130708e39554 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:12.659943 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5ad8c-2dca-4a30-84b4-130708e39554 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:12.661406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5ad8c-2dca-4a30-84b4-130708e39554 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:12.666994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:12.672179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 773/1536] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:14.824722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cb451-ad4a-4b5d-ba77-8f47a1ea62f5 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:14.825337 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cb451-ad4a-4b5d-ba77-8f47a1ea62f5 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:14.825337 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cb451-ad4a-4b5d-ba77-8f47a1ea62f5 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:14.826696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:55:14.832104 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc1f2e-8239-475d-b283-b7d5f1d9ac23 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:14.832679 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc1f2e-8239-475d-b283-b7d5f1d9ac23 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:14.832679 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc1f2e-8239-475d-b283-b7d5f1d9ac23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:14.850599 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-58bc1f2e-8239-475d-b283-b7d5f1d9ac23 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:14.851797 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-58bc1f2e-8239-475d-b283-b7d5f1d9ac23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:14.859654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:15.122743 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cb451-ad4a-4b5d-ba77-8f47a1ea62f5 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:15.124453 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-726cb451-ad4a-4b5d-ba77-8f47a1ea62f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:15.138095 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cb451-ad4a-4b5d-ba77-8f47a1ea62f5 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:15.141579 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27fdf6-720b-4953-a837-2b4b1229d075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:15.142219 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27fdf6-720b-4953-a837-2b4b1229d075 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:15.142501 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27fdf6-720b-4953-a837-2b4b1229d075 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:15.142778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27fdf6-720b-4953-a837-2b4b1229d075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:15.151679 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27fdf6-720b-4953-a837-2b4b1229d075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:15.153125 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27fdf6-720b-4953-a837-2b4b1229d075 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:15.162443 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 765/1539] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:24.845541 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:25.158316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:45.998734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173ce1a-469f-4ad8-9cd4-fd6b192f30ff None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:45.999407 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173ce1a-469f-4ad8-9cd4-fd6b192f30ff None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:45.999407 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173ce1a-469f-4ad8-9cd4-fd6b192f30ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.023201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-c173ce1a-469f-4ad8-9cd4-fd6b192f30ff None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:46.024474 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c173ce1a-469f-4ad8-9cd4-fd6b192f30ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:46.037271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 775/1540] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:46.055557 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889e874-7d0e-4326-8e9b-beddf94d6480 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.056768 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889e874-7d0e-4326-8e9b-beddf94d6480 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.057321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889e874-7d0e-4326-8e9b-beddf94d6480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.089582 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-1889e874-7d0e-4326-8e9b-beddf94d6480 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:46.091321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1889e874-7d0e-4326-8e9b-beddf94d6480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:46.102016 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 766/1541] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:56:46.107050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173ce1a-469f-4ad8-9cd4-fd6b192f30ff None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:46.124977 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173ce1a-469f-4ad8-9cd4-fd6b192f30ff None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:46.132149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c9076-97fb-4083-8c6d-5bb86bbfccb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:46.133184 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c9076-97fb-4083-8c6d-5bb86bbfccb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.133942 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c9076-97fb-4083-8c6d-5bb86bbfccb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.134421 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c9076-97fb-4083-8c6d-5bb86bbfccb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.135363 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c9076-97fb-4083-8c6d-5bb86bbfccb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:46.135881 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c9076-97fb-4083-8c6d-5bb86bbfccb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:46.137792 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c9076-97fb-4083-8c6d-5bb86bbfccb9 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:46.157297 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 776/1542] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:56:46.165710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889e874-7d0e-4326-8e9b-beddf94d6480 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:46.176627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889e874-7d0e-4326-8e9b-beddf94d6480 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:46.183232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067a765-9f19-4afc-8b20-0f9a69063799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:46.184178 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067a765-9f19-4afc-8b20-0f9a69063799 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.184699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067a765-9f19-4afc-8b20-0f9a69063799 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.185191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067a765-9f19-4afc-8b20-0f9a69063799 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.186106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067a765-9f19-4afc-8b20-0f9a69063799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:46.188360 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067a765-9f19-4afc-8b20-0f9a69063799 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:46.202908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787f9d5-459d-4ea0-8f61-eef6b108d005 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.203206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787f9d5-459d-4ea0-8f61-eef6b108d005 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.203478 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787f9d5-459d-4ea0-8f61-eef6b108d005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.232553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-5787f9d5-459d-4ea0-8f61-eef6b108d005 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:46.234391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5787f9d5-459d-4ea0-8f61-eef6b108d005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:46.246459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 777/1543] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:56:46.257049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cbb72-bde8-4e30-a242-19ea6667db2d None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.257362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cbb72-bde8-4e30-a242-19ea6667db2d None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.257621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cbb72-bde8-4e30-a242-19ea6667db2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.288473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-2b1cbb72-bde8-4e30-a242-19ea6667db2d None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:46.288674 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2b1cbb72-bde8-4e30-a242-19ea6667db2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:46.295339 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 767/1544] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:46.299598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940b6f2-fe8c-496a-b1e4-8b68844df26c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.299892 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940b6f2-fe8c-496a-b1e4-8b68844df26c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.300172 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940b6f2-fe8c-496a-b1e4-8b68844df26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.305382 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 778/1545] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:46.310025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eefc1a-c283-47c5-b366-1c1b76b6bb98 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.310328 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eefc1a-c283-47c5-b366-1c1b76b6bb98 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.310610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eefc1a-c283-47c5-b366-1c1b76b6bb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.331267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-1940b6f2-fe8c-496a-b1e4-8b68844df26c None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:46.333268 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1940b6f2-fe8c-496a-b1e4-8b68844df26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:46.340235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-99eefc1a-c283-47c5-b366-1c1b76b6bb98 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:46.340235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-99eefc1a-c283-47c5-b366-1c1b76b6bb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:46.398200 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 768/1546] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:46.398954 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940b6f2-fe8c-496a-b1e4-8b68844df26c None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:46.408698 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 779/1547] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:46.409429 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eefc1a-c283-47c5-b366-1c1b76b6bb98 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:46.412068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940b6f2-fe8c-496a-b1e4-8b68844df26c None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:46.417572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc779ff-ca1c-413d-b35a-c07719fc928c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:46.418252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc779ff-ca1c-413d-b35a-c07719fc928c admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.418579 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc779ff-ca1c-413d-b35a-c07719fc928c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.418873 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc779ff-ca1c-413d-b35a-c07719fc928c admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.419893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eefc1a-c283-47c5-b366-1c1b76b6bb98 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:46.420023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc779ff-ca1c-413d-b35a-c07719fc928c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:46.421577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: WARNING py.warnings [None req-5bc779ff-ca1c-413d-b35a-c07719fc928c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:56:46.421577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: warnings.warn(msg) Jun 16 18:56:46.421577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: Jun 16 18:56:46.422814 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc779ff-ca1c-413d-b35a-c07719fc928c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:46.424598 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0898ab-bbcc-430c-a03d-3685f82e04fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:46.425276 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0898ab-bbcc-430c-a03d-3685f82e04fa admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.425565 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0898ab-bbcc-430c-a03d-3685f82e04fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.425845 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0898ab-bbcc-430c-a03d-3685f82e04fa admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.426574 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0898ab-bbcc-430c-a03d-3685f82e04fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:46.426884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0898ab-bbcc-430c-a03d-3685f82e04fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:46.428596 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0898ab-bbcc-430c-a03d-3685f82e04fa admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:46.441462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 780/1548] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:56:46.442904 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1e5aa-06f7-4226-a17a-c24db588d4bb None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.443304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1e5aa-06f7-4226-a17a-c24db588d4bb None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.443589 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1e5aa-06f7-4226-a17a-c24db588d4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.461350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-5ca1e5aa-06f7-4226-a17a-c24db588d4bb None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:46.462552 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5ca1e5aa-06f7-4226-a17a-c24db588d4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:46.470352 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 781/1549] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:46.471726 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3113ffa-4655-42c0-838b-93d017c981e2 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.472022 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3113ffa-4655-42c0-838b-93d017c981e2 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.472299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3113ffa-4655-42c0-838b-93d017c981e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.490068 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-b3113ffa-4655-42c0-838b-93d017c981e2 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:46.491258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b3113ffa-4655-42c0-838b-93d017c981e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:46.497085 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 769/1550] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:46.498734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95837fc0-41b4-4e8e-a1c7-6254e24c3d63 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.499553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95837fc0-41b4-4e8e-a1c7-6254e24c3d63 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.499834 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95837fc0-41b4-4e8e-a1c7-6254e24c3d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.502091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 782/1551] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:46.513366 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b61b41-afe1-4d63-8026-5c3d5b4bbb75 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.513366 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b61b41-afe1-4d63-8026-5c3d5b4bbb75 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.513366 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b61b41-afe1-4d63-8026-5c3d5b4bbb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.519688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-95837fc0-41b4-4e8e-a1c7-6254e24c3d63 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:46.520928 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-95837fc0-41b4-4e8e-a1c7-6254e24c3d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:46.522263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-80b61b41-afe1-4d63-8026-5c3d5b4bbb75 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:46.523505 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-80b61b41-afe1-4d63-8026-5c3d5b4bbb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:46.528981 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 770/1552] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:46.529980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e7341-57a0-4cf4-910d-54115a81f955 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.530263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e7341-57a0-4cf4-910d-54115a81f955 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.530540 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e7341-57a0-4cf4-910d-54115a81f955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.539921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 783/1553] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:46.541540 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f4f44-eb61-4b38-9508-da833909c536 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.541962 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f4f44-eb61-4b38-9508-da833909c536 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.542247 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f4f44-eb61-4b38-9508-da833909c536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.549882 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-447e7341-57a0-4cf4-910d-54115a81f955 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:46.552068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-447e7341-57a0-4cf4-910d-54115a81f955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:46.559372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 771/1554] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:46.560314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e7341-57a0-4cf4-910d-54115a81f955 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:46.560817 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-868f4f44-eb61-4b38-9508-da833909c536 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:46.562629 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-868f4f44-eb61-4b38-9508-da833909c536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:46.570159 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e7341-57a0-4cf4-910d-54115a81f955 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:46.570780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 784/1555] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:46.572080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b49cc-c384-4030-a7fc-acadbe87c2a7 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.572373 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b49cc-c384-4030-a7fc-acadbe87c2a7 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.572674 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b49cc-c384-4030-a7fc-acadbe87c2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.574844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27edcc-8371-435d-9b0a-214cb329fc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:46.575492 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27edcc-8371-435d-9b0a-214cb329fc13 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.575778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27edcc-8371-435d-9b0a-214cb329fc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.576064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27edcc-8371-435d-9b0a-214cb329fc13 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.576813 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27edcc-8371-435d-9b0a-214cb329fc13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:46.578701 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27edcc-8371-435d-9b0a-214cb329fc13 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:46.590434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-b51b49cc-c384-4030-a7fc-acadbe87c2a7 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:46.591599 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b51b49cc-c384-4030-a7fc-acadbe87c2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:46.599430 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 785/1556] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:46.603565 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b49cc-c384-4030-a7fc-acadbe87c2a7 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:46.611173 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b49cc-c384-4030-a7fc-acadbe87c2a7 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:46.615720 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbb1f1-8f92-4b83-b37a-76e0bc89ceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:46.616346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbb1f1-8f92-4b83-b37a-76e0bc89ceba admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.616658 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbb1f1-8f92-4b83-b37a-76e0bc89ceba admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.616929 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbb1f1-8f92-4b83-b37a-76e0bc89ceba admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.617638 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbb1f1-8f92-4b83-b37a-76e0bc89ceba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:46.619197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbb1f1-8f92-4b83-b37a-76e0bc89ceba admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:46.630031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 786/1557] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:46.632248 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d78396-edc7-41f1-a5c9-a77f783c9fca None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.632248 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d78396-edc7-41f1-a5c9-a77f783c9fca None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.632248 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d78396-edc7-41f1-a5c9-a77f783c9fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.649184 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-60d78396-edc7-41f1-a5c9-a77f783c9fca None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:46.650298 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-60d78396-edc7-41f1-a5c9-a77f783c9fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:46.658641 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 787/1558] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:46.664704 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1317538-b06e-4fcd-a469-984a5c203d37 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.664704 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1317538-b06e-4fcd-a469-984a5c203d37 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.664704 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1317538-b06e-4fcd-a469-984a5c203d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.678043 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-e1317538-b06e-4fcd-a469-984a5c203d37 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:46.679202 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-e1317538-b06e-4fcd-a469-984a5c203d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:46.687101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 788/1559] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:46.688298 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02574fff-8024-4f9f-89e5-8ef707472256 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.688615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02574fff-8024-4f9f-89e5-8ef707472256 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.688914 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02574fff-8024-4f9f-89e5-8ef707472256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.691306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 772/1560] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:46.691306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27edcc-8371-435d-9b0a-214cb329fc13 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:46.707242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-02574fff-8024-4f9f-89e5-8ef707472256 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:46.708424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-02574fff-8024-4f9f-89e5-8ef707472256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:46.753747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27edcc-8371-435d-9b0a-214cb329fc13 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:46.758736 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf647b-0d2a-4d96-9091-5f36191410b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:46.759414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf647b-0d2a-4d96-9091-5f36191410b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.759706 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf647b-0d2a-4d96-9091-5f36191410b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.759819 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:46.759985 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf647b-0d2a-4d96-9091-5f36191410b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.760749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf647b-0d2a-4d96-9091-5f36191410b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:46.761079 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf647b-0d2a-4d96-9091-5f36191410b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:46.762073 dv-cinder-813229-10-smb devstack@keystone.service[86942]: WARNING py.warnings [None req-cbcf647b-0d2a-4d96-9091-5f36191410b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:56:46.762073 dv-cinder-813229-10-smb devstack@keystone.service[86942]: warnings.warn(msg) Jun 16 18:56:46.762073 dv-cinder-813229-10-smb devstack@keystone.service[86942]: Jun 16 18:56:46.762973 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf647b-0d2a-4d96-9091-5f36191410b0 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:46.768646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 789/1561] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:46.769462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02574fff-8024-4f9f-89e5-8ef707472256 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:46.775224 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 773/1562] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:56:46.776029 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf647b-0d2a-4d96-9091-5f36191410b0 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:46.778587 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02574fff-8024-4f9f-89e5-8ef707472256 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:46.783592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc33136-728e-48bf-ad6f-c466904fc515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:46.784252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc33136-728e-48bf-ad6f-c466904fc515 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.784561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc33136-728e-48bf-ad6f-c466904fc515 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.784846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc33136-728e-48bf-ad6f-c466904fc515 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.785610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc33136-728e-48bf-ad6f-c466904fc515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:46.785875 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc33136-728e-48bf-ad6f-c466904fc515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:46.787496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc33136-728e-48bf-ad6f-c466904fc515 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:46.787676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf647b-0d2a-4d96-9091-5f36191410b0 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:46.792253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa892783-9118-4521-bff6-8bfd880e719d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:46.792939 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa892783-9118-4521-bff6-8bfd880e719d admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.793232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa892783-9118-4521-bff6-8bfd880e719d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.793518 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa892783-9118-4521-bff6-8bfd880e719d admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.794250 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa892783-9118-4521-bff6-8bfd880e719d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:46.794565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa892783-9118-4521-bff6-8bfd880e719d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:46.796733 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa892783-9118-4521-bff6-8bfd880e719d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:46.800282 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 790/1563] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:56:46.801118 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc33136-728e-48bf-ad6f-c466904fc515 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:46.809185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:46.811677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc33136-728e-48bf-ad6f-c466904fc515 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:46.819968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 774/1564] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:56:46.819968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa892783-9118-4521-bff6-8bfd880e719d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:46.825954 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238be26b-92b6-45e9-9dd0-b7c6d06de4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:46.825954 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238be26b-92b6-45e9-9dd0-b7c6d06de4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.825954 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238be26b-92b6-45e9-9dd0-b7c6d06de4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.825954 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238be26b-92b6-45e9-9dd0-b7c6d06de4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.826361 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238be26b-92b6-45e9-9dd0-b7c6d06de4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:46.826361 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238be26b-92b6-45e9-9dd0-b7c6d06de4a6 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:46.826547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa892783-9118-4521-bff6-8bfd880e719d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:46.832538 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 791/1565] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:46.832787 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1a95f-05a4-4e72-b98e-716104cf571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:46.833464 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1a95f-05a4-4e72-b98e-716104cf571c admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.833834 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238be26b-92b6-45e9-9dd0-b7c6d06de4a6 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:46.834019 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1a95f-05a4-4e72-b98e-716104cf571c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.834477 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1a95f-05a4-4e72-b98e-716104cf571c admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.835168 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1a95f-05a4-4e72-b98e-716104cf571c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:46.835489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1a95f-05a4-4e72-b98e-716104cf571c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:46.837158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1a95f-05a4-4e72-b98e-716104cf571c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:46.844669 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238be26b-92b6-45e9-9dd0-b7c6d06de4a6 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:46.849578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bf4a7-8ee3-4fd1-83e6-356716ab89c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:46.850233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bf4a7-8ee3-4fd1-83e6-356716ab89c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.850519 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bf4a7-8ee3-4fd1-83e6-356716ab89c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.850804 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bf4a7-8ee3-4fd1-83e6-356716ab89c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.850969 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 775/1566] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:56:46.851535 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bf4a7-8ee3-4fd1-83e6-356716ab89c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:46.851708 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1a95f-05a4-4e72-b98e-716104cf571c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:46.851916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bf4a7-8ee3-4fd1-83e6-356716ab89c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:46.853583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bf4a7-8ee3-4fd1-83e6-356716ab89c2 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:46.862182 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1a95f-05a4-4e72-b98e-716104cf571c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:46.866749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb5363-0be2-47fe-8641-e4f250a5dda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:46.867414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb5363-0be2-47fe-8641-e4f250a5dda8 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.867699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb5363-0be2-47fe-8641-e4f250a5dda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.867980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb5363-0be2-47fe-8641-e4f250a5dda8 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.868722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb5363-0be2-47fe-8641-e4f250a5dda8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:46.870745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb5363-0be2-47fe-8641-e4f250a5dda8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:46.872625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 792/1567] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:56:46.873374 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bf4a7-8ee3-4fd1-83e6-356716ab89c2 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:46.887250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bf4a7-8ee3-4fd1-83e6-356716ab89c2 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:46.893944 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316fe1a-6764-4488-9b83-29760376b0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:46.893944 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316fe1a-6764-4488-9b83-29760376b0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.893944 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316fe1a-6764-4488-9b83-29760376b0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.893944 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316fe1a-6764-4488-9b83-29760376b0d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.894350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316fe1a-6764-4488-9b83-29760376b0d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:46.894350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316fe1a-6764-4488-9b83-29760376b0d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:46.895827 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316fe1a-6764-4488-9b83-29760376b0d9 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:46.908309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 793/1568] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:56:46.909099 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316fe1a-6764-4488-9b83-29760376b0d9 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:46.918320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316fe1a-6764-4488-9b83-29760376b0d9 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:46.923720 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c7623-0d27-4b61-9528-a386ec3cb128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:46.924346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c7623-0d27-4b61-9528-a386ec3cb128 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.924658 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c7623-0d27-4b61-9528-a386ec3cb128 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.924964 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c7623-0d27-4b61-9528-a386ec3cb128 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.925641 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c7623-0d27-4b61-9528-a386ec3cb128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:46.926638 dv-cinder-813229-10-smb devstack@keystone.service[86943]: WARNING py.warnings [None req-b23c7623-0d27-4b61-9528-a386ec3cb128 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:56:46.926638 dv-cinder-813229-10-smb devstack@keystone.service[86943]: warnings.warn(msg) Jun 16 18:56:46.926638 dv-cinder-813229-10-smb devstack@keystone.service[86943]: Jun 16 18:56:46.927814 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c7623-0d27-4b61-9528-a386ec3cb128 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:46.971782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 776/1569] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:46.972675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb5363-0be2-47fe-8641-e4f250a5dda8 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:46.982006 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb5363-0be2-47fe-8641-e4f250a5dda8 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:46.987232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23229443-2de9-47fe-8ca7-be937d00034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:46.987858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23229443-2de9-47fe-8ca7-be937d00034b admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:46.988140 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23229443-2de9-47fe-8ca7-be937d00034b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:46.988415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23229443-2de9-47fe-8ca7-be937d00034b admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:46.989139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23229443-2de9-47fe-8ca7-be937d00034b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:46.991017 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23229443-2de9-47fe-8ca7-be937d00034b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:47.032719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 794/1570] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:47.032719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c7623-0d27-4b61-9528-a386ec3cb128 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:47.075175 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 777/1571] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:46 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:47.075979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23229443-2de9-47fe-8ca7-be937d00034b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:47.093730 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c7623-0d27-4b61-9528-a386ec3cb128 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:47.137280 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23229443-2de9-47fe-8ca7-be937d00034b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:47.142526 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb17b59-fd52-40dd-b630-696cd0c5e6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:47.143530 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb17b59-fd52-40dd-b630-696cd0c5e6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:47.143819 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb17b59-fd52-40dd-b630-696cd0c5e6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:47.144230 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb17b59-fd52-40dd-b630-696cd0c5e6f2 admin admin] PATH_INFO: `/v3/projects/4081c97a70084bce91322020f8f1b4f5/users/33a3f9ebb97c48c8886666f6be5202a3/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:47.151083 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d54379-cadf-4fc1-9c11-64c101843af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:47.151756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d54379-cadf-4fc1-9c11-64c101843af3 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:47.152044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d54379-cadf-4fc1-9c11-64c101843af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:47.152325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d54379-cadf-4fc1-9c11-64c101843af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:47.153055 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d54379-cadf-4fc1-9c11-64c101843af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:47.155035 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d54379-cadf-4fc1-9c11-64c101843af3 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:47.159354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb17b59-fd52-40dd-b630-696cd0c5e6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4081c97a70084bce91322020f8f1b4f5, user_id=33a3f9ebb97c48c8886666f6be5202a3, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:47.161970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb17b59-fd52-40dd-b630-696cd0c5e6f2 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:47.223156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 778/1572] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:47 2022] PUT /identity/v3/projects/4081c97a70084bce91322020f8f1b4f5/users/33a3f9ebb97c48c8886666f6be5202a3/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:47.224173 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb17b59-fd52-40dd-b630-696cd0c5e6f2 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:47.248426 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 795/1573] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:47 2022] POST /identity/v3/projects => generated 405 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:47.248426 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d54379-cadf-4fc1-9c11-64c101843af3 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:47.271097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:47.289833 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb17b59-fd52-40dd-b630-696cd0c5e6f2 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:47.313084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d54379-cadf-4fc1-9c11-64c101843af3 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:47.317656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c670021-26cb-4630-88a2-b78c46eb2cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:47.318348 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c670021-26cb-4630-88a2-b78c46eb2cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:47.318630 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c670021-26cb-4630-88a2-b78c46eb2cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:47.318904 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c670021-26cb-4630-88a2-b78c46eb2cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:47.319596 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c670021-26cb-4630-88a2-b78c46eb2cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:47.321528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c670021-26cb-4630-88a2-b78c46eb2cf1 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:47.322481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:47.346289 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d692be-0706-4720-ae4a-6cd2ebf91641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:47.346945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d692be-0706-4720-ae4a-6cd2ebf91641 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:47.347225 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d692be-0706-4720-ae4a-6cd2ebf91641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:47.347499 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d692be-0706-4720-ae4a-6cd2ebf91641 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:47.348181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d692be-0706-4720-ae4a-6cd2ebf91641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:47.350227 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d692be-0706-4720-ae4a-6cd2ebf91641 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:47.432660 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 796/1574] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:47 2022] POST /identity/v3/projects => generated 367 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:47.433407 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c670021-26cb-4630-88a2-b78c46eb2cf1 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:47.461717 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 779/1575] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:47 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:47.464796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d692be-0706-4720-ae4a-6cd2ebf91641 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:47.500524 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c670021-26cb-4630-88a2-b78c46eb2cf1 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:47.524963 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d692be-0706-4720-ae4a-6cd2ebf91641 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:47.529548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7990f-6a91-482b-8405-a20f0a2314fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:47.530215 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7990f-6a91-482b-8405-a20f0a2314fa admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:47.530500 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7990f-6a91-482b-8405-a20f0a2314fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:47.530773 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7990f-6a91-482b-8405-a20f0a2314fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:47.531559 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7990f-6a91-482b-8405-a20f0a2314fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:47.533193 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7990f-6a91-482b-8405-a20f0a2314fa admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:47.542939 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 780/1576] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:47.543776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7990f-6a91-482b-8405-a20f0a2314fa admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:47.552913 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7990f-6a91-482b-8405-a20f0a2314fa admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:47.557380 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b79ed7-0c40-4d82-ac41-f19ca83ea9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:47.558011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b79ed7-0c40-4d82-ac41-f19ca83ea9ca admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:47.558296 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b79ed7-0c40-4d82-ac41-f19ca83ea9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:47.558512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c4728-2c76-48ce-a8a9-eb6db254ff1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:47.558694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b79ed7-0c40-4d82-ac41-f19ca83ea9ca admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:47.559183 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c4728-2c76-48ce-a8a9-eb6db254ff1d admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:47.559309 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b79ed7-0c40-4d82-ac41-f19ca83ea9ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:47.559468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c4728-2c76-48ce-a8a9-eb6db254ff1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:47.559746 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c4728-2c76-48ce-a8a9-eb6db254ff1d admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:47.560460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c4728-2c76-48ce-a8a9-eb6db254ff1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:47.561640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b79ed7-0c40-4d82-ac41-f19ca83ea9ca admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:47.562873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c4728-2c76-48ce-a8a9-eb6db254ff1d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:47.642911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 781/1577] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:47 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:47.643710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b79ed7-0c40-4d82-ac41-f19ca83ea9ca admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:47.654023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b79ed7-0c40-4d82-ac41-f19ca83ea9ca admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:47.654792 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 797/1578] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:47 2022] POST /identity/v3/projects => generated 391 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:47.656129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a3f24-417f-4c7e-aae2-c82da23946c1 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:47.656420 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a3f24-417f-4c7e-aae2-c82da23946c1 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:47.656728 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a3f24-417f-4c7e-aae2-c82da23946c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:47.673367 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-574a3f24-417f-4c7e-aae2-c82da23946c1 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:47.674600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-574a3f24-417f-4c7e-aae2-c82da23946c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:47.705334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:47.713906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef327e-01b2-4eb8-82bb-06e1a3e42e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:47.716864 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef327e-01b2-4eb8-82bb-06e1a3e42e95 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:47.716864 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef327e-01b2-4eb8-82bb-06e1a3e42e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:47.716864 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef327e-01b2-4eb8-82bb-06e1a3e42e95 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:47.716864 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef327e-01b2-4eb8-82bb-06e1a3e42e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:47.717730 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef327e-01b2-4eb8-82bb-06e1a3e42e95 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:47.734294 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 798/1579] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:47.735110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a3f24-417f-4c7e-aae2-c82da23946c1 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:47.746763 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a3f24-417f-4c7e-aae2-c82da23946c1 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:47.751796 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05586956-fc3e-4a6f-bf5a-cfb936629994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:47.752475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05586956-fc3e-4a6f-bf5a-cfb936629994 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:47.752760 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05586956-fc3e-4a6f-bf5a-cfb936629994 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:47.753033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05586956-fc3e-4a6f-bf5a-cfb936629994 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:47.753714 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05586956-fc3e-4a6f-bf5a-cfb936629994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:47.755614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05586956-fc3e-4a6f-bf5a-cfb936629994 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:47.822281 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 782/1580] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:47 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:47.823257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef327e-01b2-4eb8-82bb-06e1a3e42e95 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:47.832696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef327e-01b2-4eb8-82bb-06e1a3e42e95 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:47.837468 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01582a-1561-4d64-9d8c-3d7ad897b99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:47.838145 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01582a-1561-4d64-9d8c-3d7ad897b99b admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:47.838443 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01582a-1561-4d64-9d8c-3d7ad897b99b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:47.838714 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01582a-1561-4d64-9d8c-3d7ad897b99b admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:47.839390 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01582a-1561-4d64-9d8c-3d7ad897b99b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:47.841332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01582a-1561-4d64-9d8c-3d7ad897b99b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:47.851271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 799/1581] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:47 2022] POST /identity/v3/users => generated 303 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:47.857624 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05586956-fc3e-4a6f-bf5a-cfb936629994 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:47.862180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05586956-fc3e-4a6f-bf5a-cfb936629994 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:47.866855 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e99ac-9ac9-4898-a0a3-603a726f46ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:47.867524 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e99ac-9ac9-4898-a0a3-603a726f46ae admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:47.867808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e99ac-9ac9-4898-a0a3-603a726f46ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:47.868103 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e99ac-9ac9-4898-a0a3-603a726f46ae admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:47.868825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e99ac-9ac9-4898-a0a3-603a726f46ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:47.870708 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e99ac-9ac9-4898-a0a3-603a726f46ae admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:47.956553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 783/1582] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:47 2022] POST /identity/v3/users => generated 284 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:47.957446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01582a-1561-4d64-9d8c-3d7ad897b99b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:47.966947 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01582a-1561-4d64-9d8c-3d7ad897b99b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:47.971660 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747b040-fc52-4cec-ac9c-072838dd6de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:47.972310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747b040-fc52-4cec-ac9c-072838dd6de6 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:47.972635 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747b040-fc52-4cec-ac9c-072838dd6de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:47.972919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747b040-fc52-4cec-ac9c-072838dd6de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:47.973678 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747b040-fc52-4cec-ac9c-072838dd6de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:47.975322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747b040-fc52-4cec-ac9c-072838dd6de6 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:47.988833 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 800/1583] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:47 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:47.989058 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 784/1584] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:47.989176 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e99ac-9ac9-4898-a0a3-603a726f46ae admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:47.989274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747b040-fc52-4cec-ac9c-072838dd6de6 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:47.994135 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:47.996922 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e99ac-9ac9-4898-a0a3-603a726f46ae admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.000310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747b040-fc52-4cec-ac9c-072838dd6de6 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.002143 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af736bb-1841-4a04-9651-245ef75a85c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.002813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af736bb-1841-4a04-9651-245ef75a85c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.003102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af736bb-1841-4a04-9651-245ef75a85c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.003379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af736bb-1841-4a04-9651-245ef75a85c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.004101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af736bb-1841-4a04-9651-245ef75a85c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.005096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eac85-a203-4dca-ada0-2b389e009348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.005724 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af736bb-1841-4a04-9651-245ef75a85c0 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.005843 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eac85-a203-4dca-ada0-2b389e009348 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.006035 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eac85-a203-4dca-ada0-2b389e009348 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.006316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eac85-a203-4dca-ada0-2b389e009348 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.007226 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eac85-a203-4dca-ada0-2b389e009348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.009425 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eac85-a203-4dca-ada0-2b389e009348 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.016676 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 801/1585] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:48.017483 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af736bb-1841-4a04-9651-245ef75a85c0 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:48.070599 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af736bb-1841-4a04-9651-245ef75a85c0 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.074268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b0159-0931-40dc-be47-e261a3dcbde7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.074906 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b0159-0931-40dc-be47-e261a3dcbde7 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.075192 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b0159-0931-40dc-be47-e261a3dcbde7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.075468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b0159-0931-40dc-be47-e261a3dcbde7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.084275 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b0159-0931-40dc-be47-e261a3dcbde7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.085722 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b0159-0931-40dc-be47-e261a3dcbde7 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.094906 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 802/1586] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:48.095678 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b0159-0931-40dc-be47-e261a3dcbde7 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:48.106805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b0159-0931-40dc-be47-e261a3dcbde7 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.106947 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 785/1587] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:47 2022] POST /identity/v3/users => generated 296 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:48.106947 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eac85-a203-4dca-ada0-2b389e009348 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:48.116138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901213b-f505-4e60-adc7-2f58d3be25b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.116976 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901213b-f505-4e60-adc7-2f58d3be25b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.117634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901213b-f505-4e60-adc7-2f58d3be25b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.117634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901213b-f505-4e60-adc7-2f58d3be25b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.117871 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eac85-a203-4dca-ada0-2b389e009348 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.118651 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901213b-f505-4e60-adc7-2f58d3be25b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.120458 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901213b-f505-4e60-adc7-2f58d3be25b1 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.122549 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f6985-060a-4483-82f3-1d1df93bff06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.123322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f6985-060a-4483-82f3-1d1df93bff06 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.124286 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f6985-060a-4483-82f3-1d1df93bff06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.124660 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f6985-060a-4483-82f3-1d1df93bff06 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.125497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f6985-060a-4483-82f3-1d1df93bff06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.127149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f6985-060a-4483-82f3-1d1df93bff06 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.131712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 803/1588] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:48.134710 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901213b-f505-4e60-adc7-2f58d3be25b1 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:48.141301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 786/1589] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:48.141301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f6985-060a-4483-82f3-1d1df93bff06 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:48.151424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901213b-f505-4e60-adc7-2f58d3be25b1 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.153737 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f6985-060a-4483-82f3-1d1df93bff06 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.157109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd69d09-5c84-4436-88ef-2654812ec04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.157790 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd69d09-5c84-4436-88ef-2654812ec04e admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.158292 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd69d09-5c84-4436-88ef-2654812ec04e admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.158432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd69d09-5c84-4436-88ef-2654812ec04e admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.159127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd69d09-5c84-4436-88ef-2654812ec04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.159379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a7db4-ee45-464c-975c-bf31a0d7181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.160078 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a7db4-ee45-464c-975c-bf31a0d7181f admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.160361 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a7db4-ee45-464c-975c-bf31a0d7181f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.160686 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a7db4-ee45-464c-975c-bf31a0d7181f admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.160801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd69d09-5c84-4436-88ef-2654812ec04e admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.161452 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a7db4-ee45-464c-975c-bf31a0d7181f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.163060 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a7db4-ee45-464c-975c-bf31a0d7181f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.171834 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 804/1590] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:48.172712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd69d09-5c84-4436-88ef-2654812ec04e admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:48.174603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 787/1591] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:48.175243 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a7db4-ee45-464c-975c-bf31a0d7181f admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:48.182468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd69d09-5c84-4436-88ef-2654812ec04e admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.184938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a7db4-ee45-464c-975c-bf31a0d7181f admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.187203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859d977-d179-4bac-8018-371df31d53bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.188085 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859d977-d179-4bac-8018-371df31d53bc admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.188367 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859d977-d179-4bac-8018-371df31d53bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.188674 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859d977-d179-4bac-8018-371df31d53bc admin admin] PATH_INFO: `/v3/projects/e29336a47ed64a5a9af091e3fab06cd6/users/9813c801a8274c1abe49a0ff7457f119/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.189859 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c0038-dbb4-49bf-8e90-4ddb5e3e80dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.192618 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c0038-dbb4-49bf-8e90-4ddb5e3e80dc admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.192618 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c0038-dbb4-49bf-8e90-4ddb5e3e80dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.192618 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c0038-dbb4-49bf-8e90-4ddb5e3e80dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.192618 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c0038-dbb4-49bf-8e90-4ddb5e3e80dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.193726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c0038-dbb4-49bf-8e90-4ddb5e3e80dc admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.204470 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 788/1592] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:48.205180 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c0038-dbb4-49bf-8e90-4ddb5e3e80dc admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:48.215712 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c0038-dbb4-49bf-8e90-4ddb5e3e80dc admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.221261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd35861-aded-4b77-a7a6-80dd7a2d9f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.221968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd35861-aded-4b77-a7a6-80dd7a2d9f54 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.222260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd35861-aded-4b77-a7a6-80dd7a2d9f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.222544 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd35861-aded-4b77-a7a6-80dd7a2d9f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.223308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd35861-aded-4b77-a7a6-80dd7a2d9f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.225003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd35861-aded-4b77-a7a6-80dd7a2d9f54 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.237093 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 789/1593] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:48.238073 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd35861-aded-4b77-a7a6-80dd7a2d9f54 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:48.255004 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd35861-aded-4b77-a7a6-80dd7a2d9f54 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.260413 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7883594-82b5-41e3-8d2b-c5f39ae9b23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.261162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7883594-82b5-41e3-8d2b-c5f39ae9b23b admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.261445 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7883594-82b5-41e3-8d2b-c5f39ae9b23b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.261720 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7883594-82b5-41e3-8d2b-c5f39ae9b23b admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.262466 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7883594-82b5-41e3-8d2b-c5f39ae9b23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.264116 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7883594-82b5-41e3-8d2b-c5f39ae9b23b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.283064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 790/1594] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:48.283064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7883594-82b5-41e3-8d2b-c5f39ae9b23b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:48.292139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7883594-82b5-41e3-8d2b-c5f39ae9b23b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.297725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2000bd6-4119-4380-9878-ebb1f3ec1bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.298585 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2000bd6-4119-4380-9878-ebb1f3ec1bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.298996 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2000bd6-4119-4380-9878-ebb1f3ec1bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.299187 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2000bd6-4119-4380-9878-ebb1f3ec1bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.299970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2000bd6-4119-4380-9878-ebb1f3ec1bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.301554 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2000bd6-4119-4380-9878-ebb1f3ec1bc9 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.316998 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 791/1595] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:48.316998 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2000bd6-4119-4380-9878-ebb1f3ec1bc9 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:48.328113 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2000bd6-4119-4380-9878-ebb1f3ec1bc9 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.328342 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859d977-d179-4bac-8018-371df31d53bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29336a47ed64a5a9af091e3fab06cd6, user_id=9813c801a8274c1abe49a0ff7457f119, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.329427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: WARNING py.warnings [None req-0859d977-d179-4bac-8018-371df31d53bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:56:48.329427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: warnings.warn(msg) Jun 16 18:56:48.329427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: Jun 16 18:56:48.331367 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859d977-d179-4bac-8018-371df31d53bc admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.333314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1fcb4-599b-4940-a318-c6dd45d1417c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.334051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1fcb4-599b-4940-a318-c6dd45d1417c admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.340410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1fcb4-599b-4940-a318-c6dd45d1417c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.340410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1fcb4-599b-4940-a318-c6dd45d1417c admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.340410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1fcb4-599b-4940-a318-c6dd45d1417c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.340410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1fcb4-599b-4940-a318-c6dd45d1417c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.347807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 792/1596] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:48.348639 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1fcb4-599b-4940-a318-c6dd45d1417c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:48.357891 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1fcb4-599b-4940-a318-c6dd45d1417c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.363021 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87e354-f24e-43b5-862a-6f774ad8ab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.368941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87e354-f24e-43b5-862a-6f774ad8ab29 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.368941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87e354-f24e-43b5-862a-6f774ad8ab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.368941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87e354-f24e-43b5-862a-6f774ad8ab29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.368941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87e354-f24e-43b5-862a-6f774ad8ab29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.368941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87e354-f24e-43b5-862a-6f774ad8ab29 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.376521 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 793/1597] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:48.377958 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87e354-f24e-43b5-862a-6f774ad8ab29 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:48.387471 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87e354-f24e-43b5-862a-6f774ad8ab29 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.392018 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efbf9e-e339-4ba1-8461-3714c104bac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.397809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efbf9e-e339-4ba1-8461-3714c104bac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.397809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efbf9e-e339-4ba1-8461-3714c104bac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.397809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efbf9e-e339-4ba1-8461-3714c104bac4 admin admin] PATH_INFO: `/v3/projects/d4ce09ed100f4358b3a030d7faf5179d/users/2b29439f50a842da8d9a5ee9575a912d/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.407915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efbf9e-e339-4ba1-8461-3714c104bac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ce09ed100f4358b3a030d7faf5179d, user_id=2b29439f50a842da8d9a5ee9575a912d, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.410644 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efbf9e-e339-4ba1-8461-3714c104bac4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.422815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 805/1598] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:48 2022] PUT /identity/v3/projects/e29336a47ed64a5a9af091e3fab06cd6/users/9813c801a8274c1abe49a0ff7457f119/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:48.423772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859d977-d179-4bac-8018-371df31d53bc admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:48.471960 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:48.487140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859d977-d179-4bac-8018-371df31d53bc admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.491966 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337608e-e7ea-4aec-bd35-0d56ce1825d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.492731 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337608e-e7ea-4aec-bd35-0d56ce1825d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.493078 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337608e-e7ea-4aec-bd35-0d56ce1825d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.493412 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337608e-e7ea-4aec-bd35-0d56ce1825d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.494204 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337608e-e7ea-4aec-bd35-0d56ce1825d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.496156 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337608e-e7ea-4aec-bd35-0d56ce1825d4 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.505439 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 794/1599] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:48 2022] PUT /identity/v3/projects/d4ce09ed100f4358b3a030d7faf5179d/users/2b29439f50a842da8d9a5ee9575a912d/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:48.505439 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efbf9e-e339-4ba1-8461-3714c104bac4 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:48.512008 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 806/1600] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:48.512008 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337608e-e7ea-4aec-bd35-0d56ce1825d4 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:48.523176 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337608e-e7ea-4aec-bd35-0d56ce1825d4 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.585781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9406c7-5850-424f-bca7-9d3053190a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.586166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efbf9e-e339-4ba1-8461-3714c104bac4 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.587040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9406c7-5850-424f-bca7-9d3053190a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.587341 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9406c7-5850-424f-bca7-9d3053190a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.587610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9406c7-5850-424f-bca7-9d3053190a2e admin admin] PATH_INFO: `/v3/projects/40b84d887dfc46f785f07375cd469d89/users/3bd15f813aee45088e158603b2120ae0/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.591038 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595fe99-bb64-41c5-a741-faa6a71e1a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.591993 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595fe99-bb64-41c5-a741-faa6a71e1a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.592280 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595fe99-bb64-41c5-a741-faa6a71e1a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.593140 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595fe99-bb64-41c5-a741-faa6a71e1a6e admin admin] PATH_INFO: `/v3/projects/67a251ff7e1c41d19a839e1a8ed60a0a/users/33b0645434304437965de631a774c52d/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.602295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9406c7-5850-424f-bca7-9d3053190a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b84d887dfc46f785f07375cd469d89, user_id=3bd15f813aee45088e158603b2120ae0, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.605008 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9406c7-5850-424f-bca7-9d3053190a2e admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.608757 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595fe99-bb64-41c5-a741-faa6a71e1a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=67a251ff7e1c41d19a839e1a8ed60a0a, user_id=33b0645434304437965de631a774c52d, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.611391 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595fe99-bb64-41c5-a741-faa6a71e1a6e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.699727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 807/1601] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:48 2022] PUT /identity/v3/projects/40b84d887dfc46f785f07375cd469d89/users/3bd15f813aee45088e158603b2120ae0/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:48.701554 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9406c7-5850-424f-bca7-9d3053190a2e admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:48.732482 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 795/1602] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:48 2022] PUT /identity/v3/projects/67a251ff7e1c41d19a839e1a8ed60a0a/users/33b0645434304437965de631a774c52d/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:48.732482 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595fe99-bb64-41c5-a741-faa6a71e1a6e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:48.751915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:48.781465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9406c7-5850-424f-bca7-9d3053190a2e admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.804043 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595fe99-bb64-41c5-a741-faa6a71e1a6e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:48.809074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c671374-4075-43af-8f63-7eb56bc19069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.809984 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c671374-4075-43af-8f63-7eb56bc19069 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.810276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c671374-4075-43af-8f63-7eb56bc19069 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.810558 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c671374-4075-43af-8f63-7eb56bc19069 admin admin] PATH_INFO: `/v3/projects/34a0db0f796c4cd1bcfde3dc1f89bc58/users/1cc1b9c147f14b4ea3c8c6449277d9ce/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.827758 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c671374-4075-43af-8f63-7eb56bc19069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a0db0f796c4cd1bcfde3dc1f89bc58, user_id=1cc1b9c147f14b4ea3c8c6449277d9ce, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.830673 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c671374-4075-43af-8f63-7eb56bc19069 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.852128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f820d9-e2f4-40fa-aa11-ed79167ca9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:48.853050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f820d9-e2f4-40fa-aa11-ed79167ca9fd admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.853336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f820d9-e2f4-40fa-aa11-ed79167ca9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.853616 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f820d9-e2f4-40fa-aa11-ed79167ca9fd admin admin] PATH_INFO: `/v3/projects/30b438039b374ea189c8d7cceda8a055/users/f042c8ef572b4812a605854cda98a035/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.867354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f820d9-e2f4-40fa-aa11-ed79167ca9fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b438039b374ea189c8d7cceda8a055, user_id=f042c8ef572b4812a605854cda98a035, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:48.870050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f820d9-e2f4-40fa-aa11-ed79167ca9fd admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:48.873032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:48.923255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 796/1603] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:48 2022] PUT /identity/v3/projects/34a0db0f796c4cd1bcfde3dc1f89bc58/users/1cc1b9c147f14b4ea3c8c6449277d9ce/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:48.924371 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f0c2e-71a7-4b37-b12c-087dfe9ef16d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.924712 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f0c2e-71a7-4b37-b12c-087dfe9ef16d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.926436 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f0c2e-71a7-4b37-b12c-087dfe9ef16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:48.944702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-954f0c2e-71a7-4b37-b12c-087dfe9ef16d None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:48.945923 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-954f0c2e-71a7-4b37-b12c-087dfe9ef16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:48.988643 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 808/1604] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:48 2022] PUT /identity/v3/projects/30b438039b374ea189c8d7cceda8a055/users/f042c8ef572b4812a605854cda98a035/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:48.988643 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c0880-e2bd-4da8-b1e2-78cc573d9919 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:48.988643 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c0880-e2bd-4da8-b1e2-78cc573d9919 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:48.988643 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c0880-e2bd-4da8-b1e2-78cc573d9919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:49.008029 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-c67c0880-e2bd-4da8-b1e2-78cc573d9919 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:49.009599 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c67c0880-e2bd-4da8-b1e2-78cc573d9919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:49.028109 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 797/1605] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:49.029584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f0c2e-71a7-4b37-b12c-087dfe9ef16d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:49.041456 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f0c2e-71a7-4b37-b12c-087dfe9ef16d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:49.081618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 809/1606] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:49.084422 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39934eb6-1de9-4ce6-a16a-9a0e35784995 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:49.084959 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39934eb6-1de9-4ce6-a16a-9a0e35784995 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:49.085246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39934eb6-1de9-4ce6-a16a-9a0e35784995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:49.106606 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8bc38-6572-4654-8904-db135a80961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:49.107666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8bc38-6572-4654-8904-db135a80961c admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:49.108323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8bc38-6572-4654-8904-db135a80961c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:49.108323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8bc38-6572-4654-8904-db135a80961c admin admin] PATH_INFO: `/v3/projects/49764ca2dd464b908befc973a04d867a/users/3c407a688b8948ed9c26aa2995678107/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:49.111452 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-39934eb6-1de9-4ce6-a16a-9a0e35784995 None None] MFA Rules not processed for user `3bd15f813aee45088e158603b2120ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:49.112687 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-39934eb6-1de9-4ce6-a16a-9a0e35784995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:49.122760 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8bc38-6572-4654-8904-db135a80961c admin admin] RBAC: Authorizing `identity:create_grant(project_id=49764ca2dd464b908befc973a04d867a, user_id=3c407a688b8948ed9c26aa2995678107, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:49.125965 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8bc38-6572-4654-8904-db135a80961c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:49.178298 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 810/1607] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:49.179596 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420a145-e7bc-4625-81fc-dbce264d115f None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:49.179894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420a145-e7bc-4625-81fc-dbce264d115f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:49.180176 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420a145-e7bc-4625-81fc-dbce264d115f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:49.193896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 798/1608] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:49 2022] PUT /identity/v3/projects/49764ca2dd464b908befc973a04d867a/users/3c407a688b8948ed9c26aa2995678107/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:49.195658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608313d1-742b-47c2-bff6-6c5f1bdff59e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:49.196639 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608313d1-742b-47c2-bff6-6c5f1bdff59e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:49.196639 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608313d1-742b-47c2-bff6-6c5f1bdff59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:49.218797 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-9420a145-e7bc-4625-81fc-dbce264d115f None None] MFA Rules not processed for user `33b0645434304437965de631a774c52d`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:49.220787 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-9420a145-e7bc-4625-81fc-dbce264d115f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:49.233594 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-608313d1-742b-47c2-bff6-6c5f1bdff59e None None] MFA Rules not processed for user `1cc1b9c147f14b4ea3c8c6449277d9ce`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:49.234828 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-608313d1-742b-47c2-bff6-6c5f1bdff59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:49.249952 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:49.303374 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 799/1609] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:49.304792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23f93e-ca6f-4f4d-a9dd-0592fcdc194f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:49.305161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23f93e-ca6f-4f4d-a9dd-0592fcdc194f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:49.305566 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23f93e-ca6f-4f4d-a9dd-0592fcdc194f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:49.307342 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 811/1610] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:49.308350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420a145-e7bc-4625-81fc-dbce264d115f None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:49.340648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:49.359627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-aa23f93e-ca6f-4f4d-a9dd-0592fcdc194f None None] MFA Rules not processed for user `f042c8ef572b4812a605854cda98a035`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:49.361221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-aa23f93e-ca6f-4f4d-a9dd-0592fcdc194f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:49.385550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420a145-e7bc-4625-81fc-dbce264d115f None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:49.389507 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd223ae8-90ef-4cb1-9d39-737f45af2fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:49.390156 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd223ae8-90ef-4cb1-9d39-737f45af2fcc service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:49.390469 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd223ae8-90ef-4cb1-9d39-737f45af2fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:49.390749 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd223ae8-90ef-4cb1-9d39-737f45af2fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:49.432338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 800/1611] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:49.434315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23f93e-ca6f-4f4d-a9dd-0592fcdc194f None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:49.443594 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23f93e-ca6f-4f4d-a9dd-0592fcdc194f None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:49.447273 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b355e3c-1a93-429b-9075-2141d6aebb4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:49.447917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b355e3c-1a93-429b-9075-2141d6aebb4e service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:49.448208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b355e3c-1a93-429b-9075-2141d6aebb4e service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:49.448513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b355e3c-1a93-429b-9075-2141d6aebb4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:49.458629 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd223ae8-90ef-4cb1-9d39-737f45af2fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:49.460110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd223ae8-90ef-4cb1-9d39-737f45af2fcc service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:49.471624 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 812/1612] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:49.473654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd223ae8-90ef-4cb1-9d39-737f45af2fcc service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:49.486283 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd223ae8-90ef-4cb1-9d39-737f45af2fcc service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:49.492612 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdda38-26c4-4efc-be18-af4064697bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:49.494969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdda38-26c4-4efc-be18-af4064697bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:49.494969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdda38-26c4-4efc-be18-af4064697bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:49.494969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdda38-26c4-4efc-be18-af4064697bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:49.494969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdda38-26c4-4efc-be18-af4064697bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:49.496942 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdda38-26c4-4efc-be18-af4064697bb4 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:49.529064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b355e3c-1a93-429b-9075-2141d6aebb4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:49.529064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b355e3c-1a93-429b-9075-2141d6aebb4e service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:49.534721 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 801/1613] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:49.536119 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ef212-4bc6-430d-bb88-175a754ab4a8 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:49.536606 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ef212-4bc6-430d-bb88-175a754ab4a8 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:49.536888 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ef212-4bc6-430d-bb88-175a754ab4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:49.566232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-cf2ef212-4bc6-430d-bb88-175a754ab4a8 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:49.567631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cf2ef212-4bc6-430d-bb88-175a754ab4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:49.576587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 802/1614] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:49.578306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8506a0-07cd-4f54-9c04-d6816bafdc9c None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:49.578761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8506a0-07cd-4f54-9c04-d6816bafdc9c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:49.579207 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8506a0-07cd-4f54-9c04-d6816bafdc9c None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:49.580815 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 803/1615] 10.222.0.93 () {54 vars in 961 bytes} [Thu Jun 16 18:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:56:49.582070 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8337d-11c2-4704-a1bf-6fcfed877f28 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:49.582369 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8337d-11c2-4704-a1bf-6fcfed877f28 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:49.586968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8337d-11c2-4704-a1bf-6fcfed877f28 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:49.586968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 804/1616] 10.222.0.93 () {54 vars in 961 bytes} [Thu Jun 16 18:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:56:49.586968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8337d-11c2-4704-a1bf-6fcfed877f28 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:49.616133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 813/1617] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:49 2022] POST /identity/v3/projects => generated 403 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:49.616133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb2e6c-4f0e-42fe-878d-93c3c3a61fa0 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:49.616133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb2e6c-4f0e-42fe-878d-93c3c3a61fa0 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:49.616133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb2e6c-4f0e-42fe-878d-93c3c3a61fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:49.631952 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:49.636141 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-a0eb2e6c-4f0e-42fe-878d-93c3c3a61fa0 None None] MFA Rules not processed for user `3503ec98bea14693a17a84e686586bad`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:49.637779 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-a0eb2e6c-4f0e-42fe-878d-93c3c3a61fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:49.664413 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8337d-11c2-4704-a1bf-6fcfed877f28 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:49.745832 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683cc7f-f1ac-4bd7-8ff3-28790d8ccf0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:49.747889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683cc7f-f1ac-4bd7-8ff3-28790d8ccf0b service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:49.748179 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683cc7f-f1ac-4bd7-8ff3-28790d8ccf0b service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:49.749591 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683cc7f-f1ac-4bd7-8ff3-28790d8ccf0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:49.782965 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 814/1618] 10.222.0.93 () {58 vars in 1058 bytes} [Thu Jun 16 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:49.786181 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e40e2-d66b-4113-9113-de2425f48b53 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:49.786478 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e40e2-d66b-4113-9113-de2425f48b53 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:49.787967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e40e2-d66b-4113-9113-de2425f48b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:49.825752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-f36e40e2-d66b-4113-9113-de2425f48b53 None None] MFA Rules not processed for user `3503ec98bea14693a17a84e686586bad`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:49.827671 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f36e40e2-d66b-4113-9113-de2425f48b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:49.840780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 815/1619] 10.222.0.93 () {58 vars in 1058 bytes} [Thu Jun 16 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:49.843107 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e40e2-d66b-4113-9113-de2425f48b53 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:49.857420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683cc7f-f1ac-4bd7-8ff3-28790d8ccf0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:49.860372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683cc7f-f1ac-4bd7-8ff3-28790d8ccf0b service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:49.871863 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 805/1620] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:49 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:49.872996 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683cc7f-f1ac-4bd7-8ff3-28790d8ccf0b service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:49.887392 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:49.928525 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e40e2-d66b-4113-9113-de2425f48b53 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:49.933344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c13b8d-ca65-465d-9913-239f4695e1f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:49.934074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13b8d-ca65-465d-9913-239f4695e1f5 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:49.934365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13b8d-ca65-465d-9913-239f4695e1f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:49.934712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13b8d-ca65-465d-9913-239f4695e1f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:49.964705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683cc7f-f1ac-4bd7-8ff3-28790d8ccf0b service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:49.970996 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ed190-6ca7-4c4f-b809-2e04c5740449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:49.971820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ed190-6ca7-4c4f-b809-2e04c5740449 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:49.972216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ed190-6ca7-4c4f-b809-2e04c5740449 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:49.972628 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ed190-6ca7-4c4f-b809-2e04c5740449 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:49.973439 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ed190-6ca7-4c4f-b809-2e04c5740449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:49.976651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ed190-6ca7-4c4f-b809-2e04c5740449 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:50.039470 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c13b8d-ca65-465d-9913-239f4695e1f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:50.041214 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c13b8d-ca65-465d-9913-239f4695e1f5 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:50.060548 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 816/1621] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:50.061796 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c13b8d-ca65-465d-9913-239f4695e1f5 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:50.080937 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 806/1622] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:49 2022] POST /identity/v3/users => generated 308 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:50.083890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ed190-6ca7-4c4f-b809-2e04c5740449 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:50.105507 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c13b8d-ca65-465d-9913-239f4695e1f5 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:50.124301 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53c8d9-e875-4030-a65a-a601c9ba3090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:50.125012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53c8d9-e875-4030-a65a-a601c9ba3090 service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:50.125301 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53c8d9-e875-4030-a65a-a601c9ba3090 service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:50.125730 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53c8d9-e875-4030-a65a-a601c9ba3090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:50.129429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ed190-6ca7-4c4f-b809-2e04c5740449 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:50.149319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a957e-de98-4d2e-a4a7-304a8b3178fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:50.150154 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a957e-de98-4d2e-a4a7-304a8b3178fc service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:50.150458 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a957e-de98-4d2e-a4a7-304a8b3178fc service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:50.150743 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a957e-de98-4d2e-a4a7-304a8b3178fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:50.222427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:50.261028 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53c8d9-e875-4030-a65a-a601c9ba3090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:50.261028 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53c8d9-e875-4030-a65a-a601c9ba3090 service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:50.298864 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 817/1623] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:50.298864 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53c8d9-e875-4030-a65a-a601c9ba3090 service nova] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:50.299146 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a957e-de98-4d2e-a4a7-304a8b3178fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:50.299888 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a957e-de98-4d2e-a4a7-304a8b3178fc service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:50.320139 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53c8d9-e875-4030-a65a-a601c9ba3090 service nova] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:50.321899 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 807/1624] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:50.332206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67755674-c34a-4bc9-a03c-f81791665dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:50.333014 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67755674-c34a-4bc9-a03c-f81791665dce admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:50.333304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67755674-c34a-4bc9-a03c-f81791665dce admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:50.333628 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67755674-c34a-4bc9-a03c-f81791665dce admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:50.334415 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67755674-c34a-4bc9-a03c-f81791665dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:50.338356 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67755674-c34a-4bc9-a03c-f81791665dce admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:50.356498 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 818/1625] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:50.356628 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a957e-de98-4d2e-a4a7-304a8b3178fc service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:50.370193 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a957e-de98-4d2e-a4a7-304a8b3178fc service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:50.385295 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6746a-af8c-47c2-88d0-6704670bc236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:50.390751 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6746a-af8c-47c2-88d0-6704670bc236 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:50.390751 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6746a-af8c-47c2-88d0-6704670bc236 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:50.390751 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6746a-af8c-47c2-88d0-6704670bc236 admin admin] PATH_INFO: `/v3/projects/fadd37d1134740019e54d47a810dc3ef/users/d7f2307e75594e31ac9acb7e6b3429e3/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:50.427171 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6746a-af8c-47c2-88d0-6704670bc236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fadd37d1134740019e54d47a810dc3ef, user_id=d7f2307e75594e31ac9acb7e6b3429e3, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:50.435947 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6746a-af8c-47c2-88d0-6704670bc236 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:50.549158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 808/1626] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:50 2022] PUT /identity/v3/projects/fadd37d1134740019e54d47a810dc3ef/users/d7f2307e75594e31ac9acb7e6b3429e3/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:50.553355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67755674-c34a-4bc9-a03c-f81791665dce admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:50.567298 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67755674-c34a-4bc9-a03c-f81791665dce admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:50.648420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d12e36-10c3-425f-bd96-77d29c2aba79 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:50.648747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d12e36-10c3-425f-bd96-77d29c2aba79 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:50.649033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d12e36-10c3-425f-bd96-77d29c2aba79 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:50.650468 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 809/1627] 10.222.0.93 () {54 vars in 912 bytes} [Thu Jun 16 18:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:56:50.659810 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1a4a3-583f-4b8d-8c3a-a79866c52a97 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:50.660109 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1a4a3-583f-4b8d-8c3a-a79866c52a97 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:50.664208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1a4a3-583f-4b8d-8c3a-a79866c52a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:50.700300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32ea93-45a0-40e2-bf53-53073cb951c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:50.701124 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32ea93-45a0-40e2-bf53-53073cb951c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:50.701349 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32ea93-45a0-40e2-bf53-53073cb951c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:50.701560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32ea93-45a0-40e2-bf53-53073cb951c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:50.702323 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32ea93-45a0-40e2-bf53-53073cb951c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:50.703921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32ea93-45a0-40e2-bf53-53073cb951c0 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:50.711619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-dca1a4a3-583f-4b8d-8c3a-a79866c52a97 None None] MFA Rules not processed for user `3503ec98bea14693a17a84e686586bad`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:50.712958 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-dca1a4a3-583f-4b8d-8c3a-a79866c52a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:50.734070 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 819/1628] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:50.741355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32ea93-45a0-40e2-bf53-53073cb951c0 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:50.758262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32ea93-45a0-40e2-bf53-53073cb951c0 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:50.766362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127dfb4-d3fe-492e-9859-46d2bb843434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:50.768841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127dfb4-d3fe-492e-9859-46d2bb843434 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:50.773038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127dfb4-d3fe-492e-9859-46d2bb843434 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:50.773038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127dfb4-d3fe-492e-9859-46d2bb843434 admin admin] PATH_INFO: `/v3/projects/fadd37d1134740019e54d47a810dc3ef/users/d7f2307e75594e31ac9acb7e6b3429e3/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:50.786341 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127dfb4-d3fe-492e-9859-46d2bb843434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fadd37d1134740019e54d47a810dc3ef, user_id=d7f2307e75594e31ac9acb7e6b3429e3, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:50.789516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127dfb4-d3fe-492e-9859-46d2bb843434 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:50.833930 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 820/1629] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:50 2022] PUT /identity/v3/projects/fadd37d1134740019e54d47a810dc3ef/users/d7f2307e75594e31ac9acb7e6b3429e3/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:50.838957 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacfa29-6e04-437b-a9f1-d1e33c311bbd None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:50.839397 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacfa29-6e04-437b-a9f1-d1e33c311bbd None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:50.839759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacfa29-6e04-437b-a9f1-d1e33c311bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:50.874133 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 810/1630] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Jun 16 18:56:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:50.888788 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1a4a3-583f-4b8d-8c3a-a79866c52a97 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:50.899604 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-daacfa29-6e04-437b-a9f1-d1e33c311bbd None None] MFA Rules not processed for user `d7f2307e75594e31ac9acb7e6b3429e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:50.901753 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-daacfa29-6e04-437b-a9f1-d1e33c311bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:51.013347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1a4a3-583f-4b8d-8c3a-a79866c52a97 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:51.066953 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 821/1631] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:51.066953 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce1e6b-0903-46b6-b692-7d3e2cea2ca9 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:51.066953 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce1e6b-0903-46b6-b692-7d3e2cea2ca9 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:51.066953 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce1e6b-0903-46b6-b692-7d3e2cea2ca9 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:51.069653 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 822/1632] 10.222.0.93 () {54 vars in 912 bytes} [Thu Jun 16 18:56:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:56:51.075516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:51.080717 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668ba08-5690-4760-ac7b-805c914ab623 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:51.081010 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668ba08-5690-4760-ac7b-805c914ab623 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:51.083262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668ba08-5690-4760-ac7b-805c914ab623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:51.107329 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23992812-03c7-4aee-bef2-906a0a2d93a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:51.110277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-6668ba08-5690-4760-ac7b-805c914ab623 None None] MFA Rules not processed for user `3503ec98bea14693a17a84e686586bad`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:51.111174 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6668ba08-5690-4760-ac7b-805c914ab623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:51.114050 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992812-03c7-4aee-bef2-906a0a2d93a7 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:51.114928 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992812-03c7-4aee-bef2-906a0a2d93a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:51.116096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992812-03c7-4aee-bef2-906a0a2d93a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:51.274320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23992812-03c7-4aee-bef2-906a0a2d93a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:51.275987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23992812-03c7-4aee-bef2-906a0a2d93a7 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:51.289317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 811/1633] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:56:51.290251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23992812-03c7-4aee-bef2-906a0a2d93a7 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:51.291029 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 823/1634] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Jun 16 18:56:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:51.493552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23992812-03c7-4aee-bef2-906a0a2d93a7 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:51.493552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b4a35-fd9e-49a3-b675-a56daef77e71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:51.493552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b4a35-fd9e-49a3-b675-a56daef77e71 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:51.493552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b4a35-fd9e-49a3-b675-a56daef77e71 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:51.497894 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b4a35-fd9e-49a3-b675-a56daef77e71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:51.497894 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b4a35-fd9e-49a3-b675-a56daef77e71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:51.497894 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b4a35-fd9e-49a3-b675-a56daef77e71 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:51.497894 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 812/1635] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:51 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:51.614058 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668ba08-5690-4760-ac7b-805c914ab623 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:51.623108 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:51.639644 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668ba08-5690-4760-ac7b-805c914ab623 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:51.643549 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337fd38-a0d6-46a6-b904-b671ed55c141 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:51.644323 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337fd38-a0d6-46a6-b904-b671ed55c141 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:51.644726 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337fd38-a0d6-46a6-b904-b671ed55c141 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:51.645095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337fd38-a0d6-46a6-b904-b671ed55c141 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:51.671559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337fd38-a0d6-46a6-b904-b671ed55c141 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:51.673201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337fd38-a0d6-46a6-b904-b671ed55c141 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:51.699803 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 824/1636] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:52.408701 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b4a35-fd9e-49a3-b675-a56daef77e71 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:52.416975 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337fd38-a0d6-46a6-b904-b671ed55c141 service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:52.416975 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:52.416975 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337fd38-a0d6-46a6-b904-b671ed55c141 service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:52.424569 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b4a35-fd9e-49a3-b675-a56daef77e71 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:52.425435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d614541-02a6-4021-9e76-8a2a1dc8cd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:52.425435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d614541-02a6-4021-9e76-8a2a1dc8cd7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:52.425435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d614541-02a6-4021-9e76-8a2a1dc8cd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:52.425435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d614541-02a6-4021-9e76-8a2a1dc8cd7f admin admin] PATH_INFO: `/v3/users/3bd15f813aee45088e158603b2120ae0` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:52.425994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d614541-02a6-4021-9e76-8a2a1dc8cd7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bd15f813aee45088e158603b2120ae0)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:52.425994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: WARNING py.warnings [None req-0d614541-02a6-4021-9e76-8a2a1dc8cd7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:56:52.425994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: warnings.warn(msg) Jun 16 18:56:52.425994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: Jun 16 18:56:52.425994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d614541-02a6-4021-9e76-8a2a1dc8cd7f admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:52.426555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904990a8-5e6b-4d31-bdb9-5c9c22cd3e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:52.426555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904990a8-5e6b-4d31-bdb9-5c9c22cd3e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:52.426555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904990a8-5e6b-4d31-bdb9-5c9c22cd3e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:52.426555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904990a8-5e6b-4d31-bdb9-5c9c22cd3e28 admin admin] PATH_INFO: `/v3/users/33b0645434304437965de631a774c52d` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:52.426932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904990a8-5e6b-4d31-bdb9-5c9c22cd3e28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b0645434304437965de631a774c52d)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:52.426932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904990a8-5e6b-4d31-bdb9-5c9c22cd3e28 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:52.745241 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-904990a8-5e6b-4d31-bdb9-5c9c22cd3e28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b0645434304437965de631a774c52d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:52.745926 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-904990a8-5e6b-4d31-bdb9-5c9c22cd3e28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b0645434304437965de631a774c52d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:52.759261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-0d614541-02a6-4021-9e76-8a2a1dc8cd7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bd15f813aee45088e158603b2120ae0'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:52.759955 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-0d614541-02a6-4021-9e76-8a2a1dc8cd7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bd15f813aee45088e158603b2120ae0'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:52.854288 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-904990a8-5e6b-4d31-bdb9-5c9c22cd3e28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b0645434304437965de631a774c52d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:52.864479 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-904990a8-5e6b-4d31-bdb9-5c9c22cd3e28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b0645434304437965de631a774c52d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:52.892040 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-904990a8-5e6b-4d31-bdb9-5c9c22cd3e28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b0645434304437965de631a774c52d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:52.912872 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 813/1637] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:56:52 2022] DELETE /identity/v3/users/33b0645434304437965de631a774c52d => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:52.915553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b1f0e-45ca-48ca-aaf0-bbc0529b509c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:52.915795 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b1f0e-45ca-48ca-aaf0-bbc0529b509c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:52.920371 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b1f0e-45ca-48ca-aaf0-bbc0529b509c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:52.940035 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-0d614541-02a6-4021-9e76-8a2a1dc8cd7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bd15f813aee45088e158603b2120ae0'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:52.964236 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-0d614541-02a6-4021-9e76-8a2a1dc8cd7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bd15f813aee45088e158603b2120ae0'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:52.965941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-0d614541-02a6-4021-9e76-8a2a1dc8cd7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bd15f813aee45088e158603b2120ae0'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:52.995141 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f38b1f0e-45ca-48ca-aaf0-bbc0529b509c None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:52.996892 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f38b1f0e-45ca-48ca-aaf0-bbc0529b509c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:53.054772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 825/1638] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:56:52 2022] DELETE /identity/v3/users/3bd15f813aee45088e158603b2120ae0 => generated 0 bytes in 905 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:53.062573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bdf74-0c12-4b42-bdf0-eda93d1aa71e None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:53.063530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bdf74-0c12-4b42-bdf0-eda93d1aa71e None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:53.064626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bdf74-0c12-4b42-bdf0-eda93d1aa71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:53.140485 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-b18bdf74-0c12-4b42-bdf0-eda93d1aa71e None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:53.143526 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b18bdf74-0c12-4b42-bdf0-eda93d1aa71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:53.216112 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 814/1639] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:53.262811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b1f0e-45ca-48ca-aaf0-bbc0529b509c None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:53.264756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 826/1640] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:53.276754 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f38b1f0e-45ca-48ca-aaf0-bbc0529b509c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:53.277082 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bdf74-0c12-4b42-bdf0-eda93d1aa71e None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:53.286383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b18bdf74-0c12-4b42-bdf0-eda93d1aa71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:53.401856 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b1f0e-45ca-48ca-aaf0-bbc0529b509c None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:53.435567 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:53.464916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bdf74-0c12-4b42-bdf0-eda93d1aa71e None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:53.477291 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a78d22-efd3-4eca-b552-c8318d7a1431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:53.479235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a78d22-efd3-4eca-b552-c8318d7a1431 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:53.482151 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a78d22-efd3-4eca-b552-c8318d7a1431 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:53.482460 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a78d22-efd3-4eca-b552-c8318d7a1431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:53.508307 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a78d22-efd3-4eca-b552-c8318d7a1431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:53.512904 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a78d22-efd3-4eca-b552-c8318d7a1431 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:53.551348 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95b35e-977d-4068-82a9-d08bd8393d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:53.552961 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95b35e-977d-4068-82a9-d08bd8393d7d service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:53.553247 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95b35e-977d-4068-82a9-d08bd8393d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:53.553532 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95b35e-977d-4068-82a9-d08bd8393d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:53.559013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 827/1641] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:53.570730 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95b35e-977d-4068-82a9-d08bd8393d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:53.573004 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95b35e-977d-4068-82a9-d08bd8393d7d service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:53.596875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 815/1642] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:56:55.084620 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a78d22-efd3-4eca-b552-c8318d7a1431 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:55.088250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c1a78d22-efd3-4eca-b552-c8318d7a1431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:55.146209 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a78d22-efd3-4eca-b552-c8318d7a1431 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:55.161830 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fac5b-b79c-4a5f-82f1-b3dfa3a9f30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:55.162811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fac5b-b79c-4a5f-82f1-b3dfa3a9f30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:55.163387 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fac5b-b79c-4a5f-82f1-b3dfa3a9f30a admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:55.164376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fac5b-b79c-4a5f-82f1-b3dfa3a9f30a admin admin] PATH_INFO: `/v3/projects/67a251ff7e1c41d19a839e1a8ed60a0a` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:55.166575 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fac5b-b79c-4a5f-82f1-b3dfa3a9f30a admin admin] RBAC: Authorizing `identity:delete_project(project_id=67a251ff7e1c41d19a839e1a8ed60a0a)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:55.174457 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fac5b-b79c-4a5f-82f1-b3dfa3a9f30a admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:55.198472 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:55.333732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-c01fac5b-b79c-4a5f-82f1-b3dfa3a9f30a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67a251ff7e1c41d19a839e1a8ed60a0a', 'request_id': 'req-c01fac5b-b79c-4a5f-82f1-b3dfa3a9f30a'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:55.422818 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-c01fac5b-b79c-4a5f-82f1-b3dfa3a9f30a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67a251ff7e1c41d19a839e1a8ed60a0a', 'request_id': 'req-c01fac5b-b79c-4a5f-82f1-b3dfa3a9f30a'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:55.434365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-c01fac5b-b79c-4a5f-82f1-b3dfa3a9f30a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67a251ff7e1c41d19a839e1a8ed60a0a', 'request_id': 'req-c01fac5b-b79c-4a5f-82f1-b3dfa3a9f30a'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:55.458576 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-c01fac5b-b79c-4a5f-82f1-b3dfa3a9f30a admin admin] The token cache is being invalidate because project 67a251ff7e1c41d19a839e1a8ed60a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:55.465168 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-c01fac5b-b79c-4a5f-82f1-b3dfa3a9f30a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:55.467987 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-c01fac5b-b79c-4a5f-82f1-b3dfa3a9f30a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:55.471727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 828/1643] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:55 2022] DELETE /identity/v3/projects/67a251ff7e1c41d19a839e1a8ed60a0a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:55.476511 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06ad14-a5fb-4dc9-812d-4012fb821fc1 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:55.477032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06ad14-a5fb-4dc9-812d-4012fb821fc1 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:55.477141 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06ad14-a5fb-4dc9-812d-4012fb821fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:55.521424 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6d06ad14-a5fb-4dc9-812d-4012fb821fc1 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:55.522805 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6d06ad14-a5fb-4dc9-812d-4012fb821fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:55.607349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 816/1644] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:56:55.616330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364896c-d1dc-4152-af32-800c714125a2 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:55.616831 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364896c-d1dc-4152-af32-800c714125a2 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:55.617124 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364896c-d1dc-4152-af32-800c714125a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:55.631566 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06ad14-a5fb-4dc9-812d-4012fb821fc1 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:55.633363 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6d06ad14-a5fb-4dc9-812d-4012fb821fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:55.642006 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-2364896c-d1dc-4152-af32-800c714125a2 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:55.643695 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2364896c-d1dc-4152-af32-800c714125a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:55.658352 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 829/1645] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:55.666025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364896c-d1dc-4152-af32-800c714125a2 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:55.669104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06ad14-a5fb-4dc9-812d-4012fb821fc1 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:55.682253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362ac09-d25f-4217-985e-d37af4380b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:55.685869 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362ac09-d25f-4217-985e-d37af4380b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:55.686608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362ac09-d25f-4217-985e-d37af4380b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:55.693071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362ac09-d25f-4217-985e-d37af4380b86 admin admin] PATH_INFO: `/v3/projects/40b84d887dfc46f785f07375cd469d89` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:55.693071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362ac09-d25f-4217-985e-d37af4380b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b84d887dfc46f785f07375cd469d89)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:55.693274 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364896c-d1dc-4152-af32-800c714125a2 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:55.693347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: WARNING py.warnings [None req-3362ac09-d25f-4217-985e-d37af4380b86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:56:55.693347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: warnings.warn(msg) Jun 16 18:56:55.693347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: Jun 16 18:56:55.696937 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362ac09-d25f-4217-985e-d37af4380b86 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:55.715898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee2ae2-a102-46d2-b3f1-4e9e9716cb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:55.718722 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee2ae2-a102-46d2-b3f1-4e9e9716cb64 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:55.722138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee2ae2-a102-46d2-b3f1-4e9e9716cb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:55.728548 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee2ae2-a102-46d2-b3f1-4e9e9716cb64 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:55.728548 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee2ae2-a102-46d2-b3f1-4e9e9716cb64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:55.728548 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee2ae2-a102-46d2-b3f1-4e9e9716cb64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:55.728548 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee2ae2-a102-46d2-b3f1-4e9e9716cb64 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:55.745471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 830/1646] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:56:55.750879 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee2ae2-a102-46d2-b3f1-4e9e9716cb64 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:55.766748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee2ae2-a102-46d2-b3f1-4e9e9716cb64 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:55.776748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601ab5b-9798-47a2-b33e-ed42dbb40d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:55.778075 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601ab5b-9798-47a2-b33e-ed42dbb40d07 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:55.778075 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601ab5b-9798-47a2-b33e-ed42dbb40d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:55.778676 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601ab5b-9798-47a2-b33e-ed42dbb40d07 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:55.779462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601ab5b-9798-47a2-b33e-ed42dbb40d07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:55.782013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601ab5b-9798-47a2-b33e-ed42dbb40d07 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:55.930911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:55.937390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 831/1647] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:55 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:55.939457 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601ab5b-9798-47a2-b33e-ed42dbb40d07 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:55.959539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3362ac09-d25f-4217-985e-d37af4380b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b84d887dfc46f785f07375cd469d89', 'request_id': 'req-3362ac09-d25f-4217-985e-d37af4380b86'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:55.992866 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3362ac09-d25f-4217-985e-d37af4380b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b84d887dfc46f785f07375cd469d89', 'request_id': 'req-3362ac09-d25f-4217-985e-d37af4380b86'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:56.009781 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3362ac09-d25f-4217-985e-d37af4380b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b84d887dfc46f785f07375cd469d89', 'request_id': 'req-3362ac09-d25f-4217-985e-d37af4380b86'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:56.095312 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3362ac09-d25f-4217-985e-d37af4380b86 admin admin] The token cache is being invalidate because project 40b84d887dfc46f785f07375cd469d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:56.101357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3362ac09-d25f-4217-985e-d37af4380b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:56.102326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3362ac09-d25f-4217-985e-d37af4380b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:56.107988 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 817/1648] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:55 2022] DELETE /identity/v3/projects/40b84d887dfc46f785f07375cd469d89 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:56:56.112194 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362ac09-d25f-4217-985e-d37af4380b86 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:56.113962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3362ac09-d25f-4217-985e-d37af4380b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:56.196115 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601ab5b-9798-47a2-b33e-ed42dbb40d07 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:56.218744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61f77b-7385-4e24-9c02-fb87045778b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:56.219469 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61f77b-7385-4e24-9c02-fb87045778b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:56.219764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61f77b-7385-4e24-9c02-fb87045778b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:56.220048 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61f77b-7385-4e24-9c02-fb87045778b6 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:56.224930 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61f77b-7385-4e24-9c02-fb87045778b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:56.227052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61f77b-7385-4e24-9c02-fb87045778b6 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:56.335322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362ac09-d25f-4217-985e-d37af4380b86 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:56.340486 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69fe30-a3a8-4fcf-902d-ed5f75eca400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:56.342551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69fe30-a3a8-4fcf-902d-ed5f75eca400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:56.342551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69fe30-a3a8-4fcf-902d-ed5f75eca400 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:56.342722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69fe30-a3a8-4fcf-902d-ed5f75eca400 admin admin] PATH_INFO: `/v3/users/d7f2307e75594e31ac9acb7e6b3429e3` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:56.345724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69fe30-a3a8-4fcf-902d-ed5f75eca400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f2307e75594e31ac9acb7e6b3429e3)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:56.347889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69fe30-a3a8-4fcf-902d-ed5f75eca400 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:56.417484 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 832/1649] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:55 2022] POST /identity/v3/users => generated 287 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:56.438320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61f77b-7385-4e24-9c02-fb87045778b6 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:56.458433 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-de61f77b-7385-4e24-9c02-fb87045778b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:56.496245 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61f77b-7385-4e24-9c02-fb87045778b6 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:56.503815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c3249-dc72-423f-b7af-4eeba569f1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:56.504568 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c3249-dc72-423f-b7af-4eeba569f1fd admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:56.504863 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c3249-dc72-423f-b7af-4eeba569f1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:56.505202 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c3249-dc72-423f-b7af-4eeba569f1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:56.507040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c3249-dc72-423f-b7af-4eeba569f1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:56.509676 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c3249-dc72-423f-b7af-4eeba569f1fd admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:56.544178 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 833/1650] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:56:56.551880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c3249-dc72-423f-b7af-4eeba569f1fd admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:56.667672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c3249-dc72-423f-b7af-4eeba569f1fd admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:56.669694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bd69fe30-a3a8-4fcf-902d-ed5f75eca400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f2307e75594e31ac9acb7e6b3429e3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:56.673061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bd69fe30-a3a8-4fcf-902d-ed5f75eca400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f2307e75594e31ac9acb7e6b3429e3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:56.693422 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19815474-6ee9-45e1-b05c-6afa0335d8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:56.694388 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19815474-6ee9-45e1-b05c-6afa0335d8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:56.699067 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19815474-6ee9-45e1-b05c-6afa0335d8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:56.701371 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19815474-6ee9-45e1-b05c-6afa0335d8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:56.711969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19815474-6ee9-45e1-b05c-6afa0335d8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:56.714063 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19815474-6ee9-45e1-b05c-6afa0335d8b0 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:56.749044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 834/1651] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:56.749044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60b1d1-794f-488e-9a13-dd0cb3b9536d None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:56.754016 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60b1d1-794f-488e-9a13-dd0cb3b9536d None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:56.762819 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60b1d1-794f-488e-9a13-dd0cb3b9536d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:56.783375 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bd69fe30-a3a8-4fcf-902d-ed5f75eca400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f2307e75594e31ac9acb7e6b3429e3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:56.806402 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bd69fe30-a3a8-4fcf-902d-ed5f75eca400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f2307e75594e31ac9acb7e6b3429e3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:56.814972 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-8a60b1d1-794f-488e-9a13-dd0cb3b9536d None None] MFA Rules not processed for user `33a3f9ebb97c48c8886666f6be5202a3`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:56.819426 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-8a60b1d1-794f-488e-9a13-dd0cb3b9536d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:56.904371 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bd69fe30-a3a8-4fcf-902d-ed5f75eca400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f2307e75594e31ac9acb7e6b3429e3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:56.915741 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:56.938097 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 818/1652] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:56:56 2022] DELETE /identity/v3/users/d7f2307e75594e31ac9acb7e6b3429e3 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:56.939527 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69fe30-a3a8-4fcf-902d-ed5f75eca400 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:56.948693 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bd69fe30-a3a8-4fcf-902d-ed5f75eca400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:57.067445 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 835/1653] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:57.079893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7577c9-a454-4edf-a054-685c1c42d346 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:57.080232 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7577c9-a454-4edf-a054-685c1c42d346 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:57.080624 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7577c9-a454-4edf-a054-685c1c42d346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:57.167870 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69fe30-a3a8-4fcf-902d-ed5f75eca400 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:57.179275 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-1f7577c9-a454-4edf-a054-685c1c42d346 None None] MFA Rules not processed for user `33a3f9ebb97c48c8886666f6be5202a3`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:57.185602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-1f7577c9-a454-4edf-a054-685c1c42d346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:57.190387 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c137569-c289-4d6b-a00d-e745d07fe545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:57.196176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c137569-c289-4d6b-a00d-e745d07fe545 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:57.198685 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c137569-c289-4d6b-a00d-e745d07fe545 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:57.198889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c137569-c289-4d6b-a00d-e745d07fe545 admin admin] PATH_INFO: `/v3/projects/ee110545b7504bb4b7de293eab35656d/users/6b4cd38810104b238960be1f0eb8daa7/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:57.262929 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c137569-c289-4d6b-a00d-e745d07fe545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee110545b7504bb4b7de293eab35656d, user_id=6b4cd38810104b238960be1f0eb8daa7, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:57.277165 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c137569-c289-4d6b-a00d-e745d07fe545 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:57.388925 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 836/1654] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:57.399173 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7577c9-a454-4edf-a054-685c1c42d346 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:57.403094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-1f7577c9-a454-4edf-a054-685c1c42d346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:57.436375 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 819/1655] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:56 2022] PUT /identity/v3/projects/ee110545b7504bb4b7de293eab35656d/users/6b4cd38810104b238960be1f0eb8daa7/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:57.446883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc3bbc-0f11-4be0-9e11-3dd42c3f2375 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:57.447951 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc3bbc-0f11-4be0-9e11-3dd42c3f2375 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:57.448465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc3bbc-0f11-4be0-9e11-3dd42c3f2375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:57.546241 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-80bc3bbc-0f11-4be0-9e11-3dd42c3f2375 None None] MFA Rules not processed for user `6b4cd38810104b238960be1f0eb8daa7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:57.547589 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-80bc3bbc-0f11-4be0-9e11-3dd42c3f2375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:57.573163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:57.652208 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7577c9-a454-4edf-a054-685c1c42d346 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:57.736068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 820/1656] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:56:57.742475 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc3bbc-0f11-4be0-9e11-3dd42c3f2375 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:57.896563 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cf69f-9270-4461-89b5-e2196865d38e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:57.897839 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cf69f-9270-4461-89b5-e2196865d38e service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:57.900412 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cf69f-9270-4461-89b5-e2196865d38e service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:57.900991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cf69f-9270-4461-89b5-e2196865d38e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:57.963499 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc3bbc-0f11-4be0-9e11-3dd42c3f2375 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:57.976965 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cd01f-d3b7-4aec-ab9d-496b3dc4756e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:57.977378 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cd01f-d3b7-4aec-ab9d-496b3dc4756e admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:57.977669 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cd01f-d3b7-4aec-ab9d-496b3dc4756e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:57.978547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cd01f-d3b7-4aec-ab9d-496b3dc4756e admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:57.980772 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cd01f-d3b7-4aec-ab9d-496b3dc4756e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:57.983335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cd01f-d3b7-4aec-ab9d-496b3dc4756e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:58.073105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cf69f-9270-4461-89b5-e2196865d38e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:58.075564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cf69f-9270-4461-89b5-e2196865d38e service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:58.108336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 837/1657] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 709 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:56:58.109400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cf69f-9270-4461-89b5-e2196865d38e service nova] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:58.111284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-8a3cf69f-9270-4461-89b5-e2196865d38e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:58.148469 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cf69f-9270-4461-89b5-e2196865d38e service nova] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:58.152942 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1ee9b-4016-416b-8850-575601b24bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:58.153625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1ee9b-4016-416b-8850-575601b24bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:58.153904 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1ee9b-4016-416b-8850-575601b24bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:58.154177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1ee9b-4016-416b-8850-575601b24bf4 admin admin] PATH_INFO: `/v3/projects/fadd37d1134740019e54d47a810dc3ef` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:58.164884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1ee9b-4016-416b-8850-575601b24bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fadd37d1134740019e54d47a810dc3ef)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:58.164884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1ee9b-4016-416b-8850-575601b24bf4 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:58.174373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 821/1658] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:57 2022] POST /identity/v3/projects => generated 373 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:58.178245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cd01f-d3b7-4aec-ab9d-496b3dc4756e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:58.309341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:58.361100 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f8a1ee9b-4016-416b-8850-575601b24bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fadd37d1134740019e54d47a810dc3ef', 'request_id': 'req-f8a1ee9b-4016-416b-8850-575601b24bf4'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:58.399392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cd01f-d3b7-4aec-ab9d-496b3dc4756e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:58.479860 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f8a1ee9b-4016-416b-8850-575601b24bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fadd37d1134740019e54d47a810dc3ef', 'request_id': 'req-f8a1ee9b-4016-416b-8850-575601b24bf4'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:58.483254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b4d43-f077-41bb-8de9-502fe2d54bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:58.484425 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b4d43-f077-41bb-8de9-502fe2d54bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:58.484938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b4d43-f077-41bb-8de9-502fe2d54bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:58.485448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b4d43-f077-41bb-8de9-502fe2d54bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:58.491513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b4d43-f077-41bb-8de9-502fe2d54bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:58.491748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f8a1ee9b-4016-416b-8850-575601b24bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fadd37d1134740019e54d47a810dc3ef', 'request_id': 'req-f8a1ee9b-4016-416b-8850-575601b24bf4'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:58.491841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b4d43-f077-41bb-8de9-502fe2d54bd9 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:58.533193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f8a1ee9b-4016-416b-8850-575601b24bf4 admin admin] The token cache is being invalidate because project fadd37d1134740019e54d47a810dc3ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:58.533193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f8a1ee9b-4016-416b-8850-575601b24bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:58.535368 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f8a1ee9b-4016-416b-8850-575601b24bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:58.537577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 838/1659] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:58 2022] DELETE /identity/v3/projects/fadd37d1134740019e54d47a810dc3ef => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:58.542521 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a6d40-a245-4751-baad-0593b387980a None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:58.542753 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a6d40-a245-4751-baad-0593b387980a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:58.543034 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a6d40-a245-4751-baad-0593b387980a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:58.597881 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-d93a6d40-a245-4751-baad-0593b387980a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:58.607772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-d93a6d40-a245-4751-baad-0593b387980a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:58.609514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 822/1660] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:58 2022] POST /identity/v3/users => generated 293 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:58.613833 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b4d43-f077-41bb-8de9-502fe2d54bd9 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:58.616511 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ba0b4d43-f077-41bb-8de9-502fe2d54bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:58.631087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 839/1661] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:58.639655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992735f-e670-4bee-a468-18704047dad4 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:58.639950 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992735f-e670-4bee-a468-18704047dad4 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:58.640220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992735f-e670-4bee-a468-18704047dad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:58.648451 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b4d43-f077-41bb-8de9-502fe2d54bd9 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:58.661621 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36b154-56bd-44a4-9016-52b6c5911257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:58.665832 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36b154-56bd-44a4-9016-52b6c5911257 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:58.665832 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36b154-56bd-44a4-9016-52b6c5911257 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:58.665832 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36b154-56bd-44a4-9016-52b6c5911257 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:58.665832 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36b154-56bd-44a4-9016-52b6c5911257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:58.671197 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36b154-56bd-44a4-9016-52b6c5911257 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:58.708747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 823/1662] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:56:58.709823 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36b154-56bd-44a4-9016-52b6c5911257 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:58.711276 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-7992735f-e670-4bee-a468-18704047dad4 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:58.714113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-7992735f-e670-4bee-a468-18704047dad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:58.731983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36b154-56bd-44a4-9016-52b6c5911257 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:58.735374 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 840/1663] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:58.740402 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992735f-e670-4bee-a468-18704047dad4 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:58.752884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da3883-82b2-4973-8275-a07d9b897828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:58.753730 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da3883-82b2-4973-8275-a07d9b897828 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:58.753962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da3883-82b2-4973-8275-a07d9b897828 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:58.754237 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da3883-82b2-4973-8275-a07d9b897828 admin admin] PATH_INFO: `/v3/projects/cf2d4c693839456fb5ea1fece6182c83/users/0184a34db5f946538b7dc5125b9859e8/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:58.770015 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992735f-e670-4bee-a468-18704047dad4 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:58.784323 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a474c-b62c-4c10-80e9-cc425d5e747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:58.785067 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a474c-b62c-4c10-80e9-cc425d5e747d admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:58.785358 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a474c-b62c-4c10-80e9-cc425d5e747d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:58.788048 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a474c-b62c-4c10-80e9-cc425d5e747d admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:58.794214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da3883-82b2-4973-8275-a07d9b897828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2d4c693839456fb5ea1fece6182c83, user_id=0184a34db5f946538b7dc5125b9859e8, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:58.795943 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a474c-b62c-4c10-80e9-cc425d5e747d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:58.796324 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a474c-b62c-4c10-80e9-cc425d5e747d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:58.798048 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a474c-b62c-4c10-80e9-cc425d5e747d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:58.808530 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da3883-82b2-4973-8275-a07d9b897828 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:58.818545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 841/1664] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:56:58.825814 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a474c-b62c-4c10-80e9-cc425d5e747d admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:58.842399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a474c-b62c-4c10-80e9-cc425d5e747d admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:58.853350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974ca9c-c562-4d57-ae11-d2a1ed65e749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:58.854044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974ca9c-c562-4d57-ae11-d2a1ed65e749 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:58.854331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974ca9c-c562-4d57-ae11-d2a1ed65e749 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:58.854669 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974ca9c-c562-4d57-ae11-d2a1ed65e749 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:58.856476 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974ca9c-c562-4d57-ae11-d2a1ed65e749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:58.860269 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974ca9c-c562-4d57-ae11-d2a1ed65e749 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:58.931312 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 824/1665] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:58 2022] PUT /identity/v3/projects/cf2d4c693839456fb5ea1fece6182c83/users/0184a34db5f946538b7dc5125b9859e8/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:58.934856 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da3883-82b2-4973-8275-a07d9b897828 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:58.951442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:59.000176 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 842/1666] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:58 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:59.005902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974ca9c-c562-4d57-ae11-d2a1ed65e749 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:59.120303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da3883-82b2-4973-8275-a07d9b897828 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:59.149407 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974ca9c-c562-4d57-ae11-d2a1ed65e749 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:59.156468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281615e-65da-4835-98d3-5c95c7194643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:59.157982 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281615e-65da-4835-98d3-5c95c7194643 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:59.158487 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281615e-65da-4835-98d3-5c95c7194643 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:59.166634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281615e-65da-4835-98d3-5c95c7194643 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:59.167572 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281615e-65da-4835-98d3-5c95c7194643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:59.169898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281615e-65da-4835-98d3-5c95c7194643 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:59.274973 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b9cdb-7672-4127-99b8-28fbb0283834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:59.275682 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b9cdb-7672-4127-99b8-28fbb0283834 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:59.276138 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b9cdb-7672-4127-99b8-28fbb0283834 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:59.276476 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b9cdb-7672-4127-99b8-28fbb0283834 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:59.277200 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b9cdb-7672-4127-99b8-28fbb0283834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:59.282654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 843/1667] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:59 2022] POST /identity/v3/users => generated 287 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:59.284087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35e2bf-942e-406d-99ce-24b31745c19d None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:59.284388 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35e2bf-942e-406d-99ce-24b31745c19d None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:59.284744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35e2bf-942e-406d-99ce-24b31745c19d None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:59.286120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b9cdb-7672-4127-99b8-28fbb0283834 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:59.286582 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 844/1668] 10.222.0.93 () {54 vars in 912 bytes} [Thu Jun 16 18:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:56:59.287319 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35e2bf-942e-406d-99ce-24b31745c19d None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:59.304505 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35e2bf-942e-406d-99ce-24b31745c19d None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:59.313057 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02cb27-1712-40c9-9f71-1f2120e314d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:59.315104 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02cb27-1712-40c9-9f71-1f2120e314d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:59.315402 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02cb27-1712-40c9-9f71-1f2120e314d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:59.315685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02cb27-1712-40c9-9f71-1f2120e314d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:59.316123 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 825/1669] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:56:59.316853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02cb27-1712-40c9-9f71-1f2120e314d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:59.317687 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa345c93-c286-405a-8b2f-fbfa5adcdfea None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:59.319460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa345c93-c286-405a-8b2f-fbfa5adcdfea None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:59.319832 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa345c93-c286-405a-8b2f-fbfa5adcdfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:59.323489 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02cb27-1712-40c9-9f71-1f2120e314d5 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:59.362293 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 845/1670] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:59.363156 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02cb27-1712-40c9-9f71-1f2120e314d5 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:59.393718 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-aa345c93-c286-405a-8b2f-fbfa5adcdfea None None] MFA Rules not processed for user `753728a82bdb406892015f8373932ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:59.395009 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-aa345c93-c286-405a-8b2f-fbfa5adcdfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:59.396767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02cb27-1712-40c9-9f71-1f2120e314d5 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:59.408512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b1183-6f93-4877-b3ea-ad53f9df12ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:59.415889 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b1183-6f93-4877-b3ea-ad53f9df12ef admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:59.415889 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b1183-6f93-4877-b3ea-ad53f9df12ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:59.415889 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b1183-6f93-4877-b3ea-ad53f9df12ef admin admin] PATH_INFO: `/v3/projects/cf2d4c693839456fb5ea1fece6182c83/users/0184a34db5f946538b7dc5125b9859e8/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:59.418796 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b1183-6f93-4877-b3ea-ad53f9df12ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2d4c693839456fb5ea1fece6182c83, user_id=0184a34db5f946538b7dc5125b9859e8, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:59.422817 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b1183-6f93-4877-b3ea-ad53f9df12ef admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:59.447609 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 846/1671] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:59 2022] PUT /identity/v3/projects/cf2d4c693839456fb5ea1fece6182c83/users/0184a34db5f946538b7dc5125b9859e8/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:59.448854 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b1183-6f93-4877-b3ea-ad53f9df12ef admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:59.515023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 826/1672] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Jun 16 18:56:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:59.517990 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489e711-53f6-4500-8f2a-354c7c7a50f5 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:59.518399 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489e711-53f6-4500-8f2a-354c7c7a50f5 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:59.518857 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489e711-53f6-4500-8f2a-354c7c7a50f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:59.547797 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:59.575403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:59.580881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4489e711-53f6-4500-8f2a-354c7c7a50f5 None None] MFA Rules not processed for user `0184a34db5f946538b7dc5125b9859e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:59.581977 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b1183-6f93-4877-b3ea-ad53f9df12ef admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:59.582642 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4489e711-53f6-4500-8f2a-354c7c7a50f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:59.587597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d607196-e754-4c0e-b356-8dda8397e24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:59.588556 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d607196-e754-4c0e-b356-8dda8397e24c admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:59.589031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d607196-e754-4c0e-b356-8dda8397e24c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:59.589508 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d607196-e754-4c0e-b356-8dda8397e24c admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:59.590761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d607196-e754-4c0e-b356-8dda8397e24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:59.593169 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d607196-e754-4c0e-b356-8dda8397e24c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:59.605162 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 847/1673] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:59.606746 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d607196-e754-4c0e-b356-8dda8397e24c admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:59.610799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-1d607196-e754-4c0e-b356-8dda8397e24c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:59.742686 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d607196-e754-4c0e-b356-8dda8397e24c admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:59.752530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b0e1c-4c52-4cfa-a499-4b8acbaa41bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:59.753214 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b0e1c-4c52-4cfa-a499-4b8acbaa41bb service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:59.753505 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b0e1c-4c52-4cfa-a499-4b8acbaa41bb service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:59.753788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b0e1c-4c52-4cfa-a499-4b8acbaa41bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:59.755549 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 827/1674] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:59.756506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489e711-53f6-4500-8f2a-354c7c7a50f5 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:59.772335 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b0e1c-4c52-4cfa-a499-4b8acbaa41bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:59.774409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b0e1c-4c52-4cfa-a499-4b8acbaa41bb service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:59.783646 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489e711-53f6-4500-8f2a-354c7c7a50f5 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:59.791531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 848/1675] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:59.792476 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b0e1c-4c52-4cfa-a499-4b8acbaa41bb service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:59.794303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3eb680-f5e9-408a-a9bb-cc8fe86938b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:59.795897 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3eb680-f5e9-408a-a9bb-cc8fe86938b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:59.796203 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3eb680-f5e9-408a-a9bb-cc8fe86938b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:59.796854 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3eb680-f5e9-408a-a9bb-cc8fe86938b5 admin admin] PATH_INFO: `/v3/projects/d831a1f2416843fe84261912d788e89d/users/8e194bc4f01b4bff973dbc631409c5e1/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:59.801623 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-9c8b0e1c-4c52-4cfa-a499-4b8acbaa41bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:59.847633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3eb680-f5e9-408a-a9bb-cc8fe86938b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d831a1f2416843fe84261912d788e89d, user_id=8e194bc4f01b4bff973dbc631409c5e1, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:59.851604 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3eb680-f5e9-408a-a9bb-cc8fe86938b5 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:59.913684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b0e1c-4c52-4cfa-a499-4b8acbaa41bb service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:59.918888 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fceeba-3378-445b-a285-c95ef73cb12d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:59.919799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fceeba-3378-445b-a285-c95ef73cb12d service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:59.921171 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fceeba-3378-445b-a285-c95ef73cb12d service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:59.921645 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fceeba-3378-445b-a285-c95ef73cb12d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:59.936817 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fceeba-3378-445b-a285-c95ef73cb12d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:59.956196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 828/1676] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:59 2022] PUT /identity/v3/projects/d831a1f2416843fe84261912d788e89d/users/8e194bc4f01b4bff973dbc631409c5e1/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:59.956395 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fceeba-3378-445b-a285-c95ef73cb12d service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:59.958846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f3e36-6d05-4648-a745-f90636a6a67f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:59.959309 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f3e36-6d05-4648-a745-f90636a6a67f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:59.959790 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f3e36-6d05-4648-a745-f90636a6a67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:59.984316 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 849/1677] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:00.017248 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-567f3e36-6d05-4648-a745-f90636a6a67f None None] MFA Rules not processed for user `8e194bc4f01b4bff973dbc631409c5e1`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:00.018686 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-567f3e36-6d05-4648-a745-f90636a6a67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:00.119300 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 829/1678] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:56:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:00.119973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fceeba-3378-445b-a285-c95ef73cb12d service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:00.137137 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fceeba-3378-445b-a285-c95ef73cb12d service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:00.243236 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c0e18-3ee3-4319-ac9d-6959afc7bdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:00.243926 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c0e18-3ee3-4319-ac9d-6959afc7bdb7 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:00.244212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c0e18-3ee3-4319-ac9d-6959afc7bdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:00.244523 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c0e18-3ee3-4319-ac9d-6959afc7bdb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:00.251364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c0e18-3ee3-4319-ac9d-6959afc7bdb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:00.256890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c0e18-3ee3-4319-ac9d-6959afc7bdb7 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:00.348846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f3e36-6d05-4648-a745-f90636a6a67f None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:00.351399 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-567f3e36-6d05-4648-a745-f90636a6a67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:00.425015 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 850/1679] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:00 2022] POST /identity/v3/projects => generated 373 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:00.429032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c0e18-3ee3-4319-ac9d-6959afc7bdb7 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:00.517364 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f3e36-6d05-4648-a745-f90636a6a67f None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:00.599254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c0e18-3ee3-4319-ac9d-6959afc7bdb7 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:00.609687 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:00.618259 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53133634-daa5-4e89-bf30-a7ad2f44b568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:00.618967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53133634-daa5-4e89-bf30-a7ad2f44b568 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:00.619255 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53133634-daa5-4e89-bf30-a7ad2f44b568 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:00.619533 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53133634-daa5-4e89-bf30-a7ad2f44b568 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:00.620246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53133634-daa5-4e89-bf30-a7ad2f44b568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:00.622260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53133634-daa5-4e89-bf30-a7ad2f44b568 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:00.685551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782beb4-bb99-4063-a395-31345abd2dbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:00.697970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782beb4-bb99-4063-a395-31345abd2dbe service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:00.697970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782beb4-bb99-4063-a395-31345abd2dbe service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:00.697970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782beb4-bb99-4063-a395-31345abd2dbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:00.697970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9782beb4-bb99-4063-a395-31345abd2dbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:00.801622 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 851/1680] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:00 2022] POST /identity/v3/users => generated 293 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:00.802792 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53133634-daa5-4e89-bf30-a7ad2f44b568 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:00.806749 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-53133634-daa5-4e89-bf30-a7ad2f44b568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:00.844908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782beb4-bb99-4063-a395-31345abd2dbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:00.846438 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782beb4-bb99-4063-a395-31345abd2dbe service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:00.855476 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53133634-daa5-4e89-bf30-a7ad2f44b568 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:00.870861 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf45ba-ef69-4165-a20b-f7a5dbd919e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:00.872320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf45ba-ef69-4165-a20b-f7a5dbd919e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:00.873066 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf45ba-ef69-4165-a20b-f7a5dbd919e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:00.875785 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf45ba-ef69-4165-a20b-f7a5dbd919e0 admin admin] PATH_INFO: `/v3/users/1cc1b9c147f14b4ea3c8c6449277d9ce` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:00.877324 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf45ba-ef69-4165-a20b-f7a5dbd919e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cc1b9c147f14b4ea3c8c6449277d9ce)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:00.881260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf45ba-ef69-4165-a20b-f7a5dbd919e0 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:00.885761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 830/1681] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:57:00.887088 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782beb4-bb99-4063-a395-31345abd2dbe service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:00.916678 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782beb4-bb99-4063-a395-31345abd2dbe service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:00.925092 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccbb39-84a1-47e9-be89-db08bd47632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:00.928124 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccbb39-84a1-47e9-be89-db08bd47632e admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:00.928124 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccbb39-84a1-47e9-be89-db08bd47632e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:00.928124 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccbb39-84a1-47e9-be89-db08bd47632e admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:00.928591 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ccbb39-84a1-47e9-be89-db08bd47632e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:00.930853 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ccbb39-84a1-47e9-be89-db08bd47632e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:00.962897 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 831/1682] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:00.974012 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840fe6d-ff5b-4062-a4c2-e52abfe84e3b None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:00.974012 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840fe6d-ff5b-4062-a4c2-e52abfe84e3b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:00.974012 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840fe6d-ff5b-4062-a4c2-e52abfe84e3b None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:00.974012 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 832/1683] 10.222.0.93 () {54 vars in 960 bytes} [Thu Jun 16 18:57:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:57:00.974253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840fe6d-ff5b-4062-a4c2-e52abfe84e3b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:01.008395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840fe6d-ff5b-4062-a4c2-e52abfe84e3b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:01.021239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0725bef-73a4-469d-9152-3d836fcb80e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:01.022161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0725bef-73a4-469d-9152-3d836fcb80e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:01.023817 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0725bef-73a4-469d-9152-3d836fcb80e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:01.024907 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0725bef-73a4-469d-9152-3d836fcb80e4 admin admin] PATH_INFO: `/v3/projects/38cb543a0ee64ce39a2b951a60b11cde/users/14b4430c783c41009526545001e58064/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:01.050739 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0725bef-73a4-469d-9152-3d836fcb80e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38cb543a0ee64ce39a2b951a60b11cde, user_id=14b4430c783c41009526545001e58064, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:01.054004 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0725bef-73a4-469d-9152-3d836fcb80e4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:01.187415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 833/1684] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:00 2022] PUT /identity/v3/projects/38cb543a0ee64ce39a2b951a60b11cde/users/14b4430c783c41009526545001e58064/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:01.199497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-3ccf45ba-ef69-4165-a20b-f7a5dbd919e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cc1b9c147f14b4ea3c8c6449277d9ce'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:01.200225 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-3ccf45ba-ef69-4165-a20b-f7a5dbd919e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cc1b9c147f14b4ea3c8c6449277d9ce'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:01.200756 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d8db5-1182-4662-8dfa-fa18ae499f27 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:01.202388 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d8db5-1182-4662-8dfa-fa18ae499f27 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:01.202911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d8db5-1182-4662-8dfa-fa18ae499f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:01.235665 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-909d8db5-1182-4662-8dfa-fa18ae499f27 None None] MFA Rules not processed for user `3abe1d47a1164776bf3a82fe4b129d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:01.237193 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-909d8db5-1182-4662-8dfa-fa18ae499f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:01.334022 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-3ccf45ba-ef69-4165-a20b-f7a5dbd919e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cc1b9c147f14b4ea3c8c6449277d9ce'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:01.337774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:01.347239 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-3ccf45ba-ef69-4165-a20b-f7a5dbd919e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cc1b9c147f14b4ea3c8c6449277d9ce'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:01.348277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-3ccf45ba-ef69-4165-a20b-f7a5dbd919e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cc1b9c147f14b4ea3c8c6449277d9ce'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:01.393888 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 834/1685] 10.222.0.93 () {58 vars in 1057 bytes} [Thu Jun 16 18:57:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:01.398907 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d8db5-1182-4662-8dfa-fa18ae499f27 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:01.406322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-909d8db5-1182-4662-8dfa-fa18ae499f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:01.427856 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 852/1686] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:00 2022] DELETE /identity/v3/users/1cc1b9c147f14b4ea3c8c6449277d9ce => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:01.431756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf45ba-ef69-4165-a20b-f7a5dbd919e0 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:01.603491 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d8db5-1182-4662-8dfa-fa18ae499f27 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:01.609461 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf45ba-ef69-4165-a20b-f7a5dbd919e0 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:01.615825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9712fab-2c47-48cf-9cbc-b5fe82a0c671 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3abe1d47a1164776bf3a82fe4b129d9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:01.616545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9712fab-2c47-48cf-9cbc-b5fe82a0c671 service placement] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:01.616835 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9712fab-2c47-48cf-9cbc-b5fe82a0c671 service placement] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:01.617613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9712fab-2c47-48cf-9cbc-b5fe82a0c671 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:01.619125 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f9712fab-2c47-48cf-9cbc-b5fe82a0c671 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:01.659696 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9712fab-2c47-48cf-9cbc-b5fe82a0c671 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:01.662143 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9712fab-2c47-48cf-9cbc-b5fe82a0c671 service placement] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:01.704710 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 853/1687] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:01.711355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e241e-a265-4668-b0d6-c6124706511a None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:01.711355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e241e-a265-4668-b0d6-c6124706511a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:01.711355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e241e-a265-4668-b0d6-c6124706511a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:01.745254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2465d4b-17b8-4f0f-a853-e81609e6ad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:01.748200 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2465d4b-17b8-4f0f-a853-e81609e6ad58 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:01.748688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2465d4b-17b8-4f0f-a853-e81609e6ad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:01.749914 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2465d4b-17b8-4f0f-a853-e81609e6ad58 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:01.750785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2465d4b-17b8-4f0f-a853-e81609e6ad58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:01.752595 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-d82e241e-a265-4668-b0d6-c6124706511a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:01.754625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-d82e241e-a265-4668-b0d6-c6124706511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:01.757117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2465d4b-17b8-4f0f-a853-e81609e6ad58 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:01.780357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 854/1688] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:01.790000 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 835/1689] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:01.790168 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e241e-a265-4668-b0d6-c6124706511a None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:01.791166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-d82e241e-a265-4668-b0d6-c6124706511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:01.791482 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2465d4b-17b8-4f0f-a853-e81609e6ad58 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:01.817938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2465d4b-17b8-4f0f-a853-e81609e6ad58 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:01.833181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4f63d-c5e2-403f-bd16-c3aba746e71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:01.834267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4f63d-c5e2-403f-bd16-c3aba746e71c admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:01.834617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4f63d-c5e2-403f-bd16-c3aba746e71c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:01.834962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4f63d-c5e2-403f-bd16-c3aba746e71c admin admin] PATH_INFO: `/v3/projects/38cb543a0ee64ce39a2b951a60b11cde/users/14b4430c783c41009526545001e58064/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:01.838654 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4f63d-c5e2-403f-bd16-c3aba746e71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=38cb543a0ee64ce39a2b951a60b11cde, user_id=14b4430c783c41009526545001e58064, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:01.845551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4f63d-c5e2-403f-bd16-c3aba746e71c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:01.876341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 836/1690] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:01 2022] PUT /identity/v3/projects/38cb543a0ee64ce39a2b951a60b11cde/users/14b4430c783c41009526545001e58064/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:01.888024 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5abaa-0f1d-4c5e-a7e5-a5050d3ee775 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:01.888313 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5abaa-0f1d-4c5e-a7e5-a5050d3ee775 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:01.892498 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5abaa-0f1d-4c5e-a7e5-a5050d3ee775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:01.898881 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e241e-a265-4668-b0d6-c6124706511a None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:01.927880 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-efe5abaa-0f1d-4c5e-a7e5-a5050d3ee775 None None] MFA Rules not processed for user `14b4430c783c41009526545001e58064`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:01.930875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-efe5abaa-0f1d-4c5e-a7e5-a5050d3ee775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:02.028323 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8c7f1-3e9e-4b97-be70-0f82a9d899f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:02.031324 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8c7f1-3e9e-4b97-be70-0f82a9d899f2 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:02.034241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8c7f1-3e9e-4b97-be70-0f82a9d899f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:02.051767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8c7f1-3e9e-4b97-be70-0f82a9d899f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:02.193990 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 837/1691] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:02.203534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5abaa-0f1d-4c5e-a7e5-a5050d3ee775 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:02.207017 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-efe5abaa-0f1d-4c5e-a7e5-a5050d3ee775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:02.302946 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8c7f1-3e9e-4b97-be70-0f82a9d899f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:02.304419 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8c7f1-3e9e-4b97-be70-0f82a9d899f2 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:02.349755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 855/1692] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:57:02.402988 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5abaa-0f1d-4c5e-a7e5-a5050d3ee775 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:02.413614 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f18032-4efa-4e34-854b-6fec7e81ed91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:02.414304 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f18032-4efa-4e34-854b-6fec7e81ed91 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:02.415725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f18032-4efa-4e34-854b-6fec7e81ed91 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:02.415725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f18032-4efa-4e34-854b-6fec7e81ed91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:02.438082 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f18032-4efa-4e34-854b-6fec7e81ed91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:02.439666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f18032-4efa-4e34-854b-6fec7e81ed91 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:02.471283 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 838/1693] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:02.672624 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:03.483560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8c7f1-3e9e-4b97-be70-0f82a9d899f2 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:03.485334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c3d8c7f1-3e9e-4b97-be70-0f82a9d899f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:03.510503 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8c7f1-3e9e-4b97-be70-0f82a9d899f2 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:03.544836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15946da7-e9ce-4725-9af3-7f81e126e173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:03.546356 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15946da7-e9ce-4725-9af3-7f81e126e173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:03.546612 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15946da7-e9ce-4725-9af3-7f81e126e173 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:03.547060 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15946da7-e9ce-4725-9af3-7f81e126e173 admin admin] PATH_INFO: `/v3/projects/34a0db0f796c4cd1bcfde3dc1f89bc58` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:03.549754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15946da7-e9ce-4725-9af3-7f81e126e173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a0db0f796c4cd1bcfde3dc1f89bc58)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:03.551901 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15946da7-e9ce-4725-9af3-7f81e126e173 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:03.799336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:03.800803 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-15946da7-e9ce-4725-9af3-7f81e126e173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a0db0f796c4cd1bcfde3dc1f89bc58', 'request_id': 'req-15946da7-e9ce-4725-9af3-7f81e126e173'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:03.908719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-15946da7-e9ce-4725-9af3-7f81e126e173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a0db0f796c4cd1bcfde3dc1f89bc58', 'request_id': 'req-15946da7-e9ce-4725-9af3-7f81e126e173'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:03.927078 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-15946da7-e9ce-4725-9af3-7f81e126e173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a0db0f796c4cd1bcfde3dc1f89bc58', 'request_id': 'req-15946da7-e9ce-4725-9af3-7f81e126e173'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:03.968206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-15946da7-e9ce-4725-9af3-7f81e126e173 admin admin] The token cache is being invalidate because project 34a0db0f796c4cd1bcfde3dc1f89bc58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:03.971257 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-15946da7-e9ce-4725-9af3-7f81e126e173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:03.973639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-15946da7-e9ce-4725-9af3-7f81e126e173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:03.977935 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 856/1694] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:03 2022] DELETE /identity/v3/projects/34a0db0f796c4cd1bcfde3dc1f89bc58 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:03.984932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a856f-7077-47ea-820f-11dc8cb48791 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:03.984932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a856f-7077-47ea-820f-11dc8cb48791 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:03.984932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a856f-7077-47ea-820f-11dc8cb48791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:03.988610 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:04.027013 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b16a856f-7077-47ea-820f-11dc8cb48791 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:04.028919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b16a856f-7077-47ea-820f-11dc8cb48791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:04.217726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 839/1695] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:04.225685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5ebe5-d1d6-4e7e-be7f-6d2693ee9185 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:04.225954 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5ebe5-d1d6-4e7e-be7f-6d2693ee9185 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:04.226240 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5ebe5-d1d6-4e7e-be7f-6d2693ee9185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:04.265013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-c1b5ebe5-d1d6-4e7e-be7f-6d2693ee9185 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:04.271114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c1b5ebe5-d1d6-4e7e-be7f-6d2693ee9185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:04.292135 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 857/1696] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:57:04.297202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a856f-7077-47ea-820f-11dc8cb48791 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:04.312770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a856f-7077-47ea-820f-11dc8cb48791 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:04.332489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad6778-a71f-46f2-bdb0-5389f354db82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:04.339844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad6778-a71f-46f2-bdb0-5389f354db82 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:04.339998 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad6778-a71f-46f2-bdb0-5389f354db82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:04.342563 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad6778-a71f-46f2-bdb0-5389f354db82 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:04.343412 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad6778-a71f-46f2-bdb0-5389f354db82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:57:04.344780 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad6778-a71f-46f2-bdb0-5389f354db82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:04.351007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad6778-a71f-46f2-bdb0-5389f354db82 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:04.378573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 840/1697] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:57:04.383175 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5ebe5-d1d6-4e7e-be7f-6d2693ee9185 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:04.397922 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5ebe5-d1d6-4e7e-be7f-6d2693ee9185 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:04.412775 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05083f01-04f1-455e-b445-d06689b76c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:04.413865 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05083f01-04f1-455e-b445-d06689b76c90 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:04.414156 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05083f01-04f1-455e-b445-d06689b76c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:04.414565 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05083f01-04f1-455e-b445-d06689b76c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:04.419518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05083f01-04f1-455e-b445-d06689b76c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:04.422057 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05083f01-04f1-455e-b445-d06689b76c90 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:04.530306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad6778-a71f-46f2-bdb0-5389f354db82 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:04.532687 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c5ad6778-a71f-46f2-bdb0-5389f354db82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:04.547356 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 858/1698] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:04 2022] POST /identity/v3/projects => generated 363 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:04.551896 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05083f01-04f1-455e-b445-d06689b76c90 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:04.583844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad6778-a71f-46f2-bdb0-5389f354db82 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:04.742595 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05083f01-04f1-455e-b445-d06689b76c90 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:04.756282 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80433a-7f14-4650-aa9c-323b13d01abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:04.757226 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80433a-7f14-4650-aa9c-323b13d01abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:04.760196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80433a-7f14-4650-aa9c-323b13d01abd admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:04.760419 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80433a-7f14-4650-aa9c-323b13d01abd admin admin] PATH_INFO: `/v3/users/f042c8ef572b4812a605854cda98a035` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:04.760539 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e3aff-6269-4d08-8c29-b1c5fb6f0717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:04.761115 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e3aff-6269-4d08-8c29-b1c5fb6f0717 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:04.761415 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e3aff-6269-4d08-8c29-b1c5fb6f0717 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:04.761684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e3aff-6269-4d08-8c29-b1c5fb6f0717 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:04.762401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e3aff-6269-4d08-8c29-b1c5fb6f0717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:04.768185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80433a-7f14-4650-aa9c-323b13d01abd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f042c8ef572b4812a605854cda98a035)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:04.774427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e3aff-6269-4d08-8c29-b1c5fb6f0717 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:04.778824 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80433a-7f14-4650-aa9c-323b13d01abd admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:04.915363 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 859/1699] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:04 2022] POST /identity/v3/users => generated 282 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:04.918175 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e3aff-6269-4d08-8c29-b1c5fb6f0717 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:04.922945 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f22e3aff-6269-4d08-8c29-b1c5fb6f0717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:04.990120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e3aff-6269-4d08-8c29-b1c5fb6f0717 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:05.006445 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162218e-762a-420f-9989-24b5c159ea06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:05.007830 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162218e-762a-420f-9989-24b5c159ea06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:05.010810 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162218e-762a-420f-9989-24b5c159ea06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:05.011858 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162218e-762a-420f-9989-24b5c159ea06 admin admin] PATH_INFO: `/v3/users/8e194bc4f01b4bff973dbc631409c5e1` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:05.019253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162218e-762a-420f-9989-24b5c159ea06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e194bc4f01b4bff973dbc631409c5e1)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:05.023340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162218e-762a-420f-9989-24b5c159ea06 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:05.096277 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0d80433a-7f14-4650-aa9c-323b13d01abd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f042c8ef572b4812a605854cda98a035'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:05.099523 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0d80433a-7f14-4650-aa9c-323b13d01abd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f042c8ef572b4812a605854cda98a035'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:05.187935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0d80433a-7f14-4650-aa9c-323b13d01abd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f042c8ef572b4812a605854cda98a035'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:05.202373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0d80433a-7f14-4650-aa9c-323b13d01abd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f042c8ef572b4812a605854cda98a035'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:05.242039 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0d80433a-7f14-4650-aa9c-323b13d01abd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f042c8ef572b4812a605854cda98a035'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:05.268929 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-a162218e-762a-420f-9989-24b5c159ea06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e194bc4f01b4bff973dbc631409c5e1'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:05.269877 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-a162218e-762a-420f-9989-24b5c159ea06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e194bc4f01b4bff973dbc631409c5e1'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:05.281170 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 841/1700] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:04 2022] DELETE /identity/v3/users/f042c8ef572b4812a605854cda98a035 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:57:05.283181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80433a-7f14-4650-aa9c-323b13d01abd admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:05.288403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0d80433a-7f14-4650-aa9c-323b13d01abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:05.378526 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-a162218e-762a-420f-9989-24b5c159ea06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e194bc4f01b4bff973dbc631409c5e1'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:05.409815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-a162218e-762a-420f-9989-24b5c159ea06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e194bc4f01b4bff973dbc631409c5e1'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:05.412587 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-a162218e-762a-420f-9989-24b5c159ea06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e194bc4f01b4bff973dbc631409c5e1'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:05.457346 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80433a-7f14-4650-aa9c-323b13d01abd admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:05.469467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f45a9f-8246-4f10-a111-468c97dc6b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:05.470175 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f45a9f-8246-4f10-a111-468c97dc6b70 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:05.472191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f45a9f-8246-4f10-a111-468c97dc6b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:05.472502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f45a9f-8246-4f10-a111-468c97dc6b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:05.473270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f45a9f-8246-4f10-a111-468c97dc6b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:05.475805 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f45a9f-8246-4f10-a111-468c97dc6b70 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:05.507610 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 842/1701] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:05.509507 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d6bbb-d920-4f53-b167-c45bdd70d035 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:05.509752 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d6bbb-d920-4f53-b167-c45bdd70d035 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:05.510036 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d6bbb-d920-4f53-b167-c45bdd70d035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:05.523546 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 860/1702] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:04 2022] DELETE /identity/v3/users/8e194bc4f01b4bff973dbc631409c5e1 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:05.525319 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162218e-762a-420f-9989-24b5c159ea06 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:05.535701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-a162218e-762a-420f-9989-24b5c159ea06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:05.551839 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-673d6bbb-d920-4f53-b167-c45bdd70d035 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:05.554072 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-673d6bbb-d920-4f53-b167-c45bdd70d035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:05.763232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 843/1703] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:05.765727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a103bd1-0326-41c0-ad72-0b369f59a190 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:05.765727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a103bd1-0326-41c0-ad72-0b369f59a190 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:05.765908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a103bd1-0326-41c0-ad72-0b369f59a190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:05.789046 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162218e-762a-420f-9989-24b5c159ea06 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:05.816222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a02c7-665e-4ffa-a4ed-43648a298234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:05.817881 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a02c7-665e-4ffa-a4ed-43648a298234 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:05.820821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a02c7-665e-4ffa-a4ed-43648a298234 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:05.821156 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a02c7-665e-4ffa-a4ed-43648a298234 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:05.821947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a02c7-665e-4ffa-a4ed-43648a298234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:05.826923 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-0a103bd1-0326-41c0-ad72-0b369f59a190 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:05.833428 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a02c7-665e-4ffa-a4ed-43648a298234 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:05.834116 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0a103bd1-0326-41c0-ad72-0b369f59a190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:05.850363 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 844/1704] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:05.851698 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a103bd1-0326-41c0-ad72-0b369f59a190 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:05.852179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 861/1705] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:05.857578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a02c7-665e-4ffa-a4ed-43648a298234 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:05.858798 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0a103bd1-0326-41c0-ad72-0b369f59a190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:05.892003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a02c7-665e-4ffa-a4ed-43648a298234 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:05.915844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b4afd-5d2a-45fe-8cce-28e43373232d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:05.916926 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b4afd-5d2a-45fe-8cce-28e43373232d admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:05.917426 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b4afd-5d2a-45fe-8cce-28e43373232d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:05.917781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b4afd-5d2a-45fe-8cce-28e43373232d admin admin] PATH_INFO: `/v3/projects/3678e24d53f845fa916500fe3b301468/users/e2534aee11c049ffb7f474aecad09e5a/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:05.989774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b4afd-5d2a-45fe-8cce-28e43373232d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3678e24d53f845fa916500fe3b301468, user_id=e2534aee11c049ffb7f474aecad09e5a, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:06.001100 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b4afd-5d2a-45fe-8cce-28e43373232d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:06.028984 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a103bd1-0326-41c0-ad72-0b369f59a190 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:06.042112 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e47d7-ac47-45bc-a151-3c199a3c3d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:06.046675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e47d7-ac47-45bc-a151-3c199a3c3d2e service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:06.049604 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e47d7-ac47-45bc-a151-3c199a3c3d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:06.052427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e47d7-ac47-45bc-a151-3c199a3c3d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:06.091701 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e47d7-ac47-45bc-a151-3c199a3c3d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:06.099514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e47d7-ac47-45bc-a151-3c199a3c3d2e service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:06.124254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 845/1706] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:06.127601 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 862/1707] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:05 2022] PUT /identity/v3/projects/3678e24d53f845fa916500fe3b301468/users/e2534aee11c049ffb7f474aecad09e5a/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:06.128278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e47d7-ac47-45bc-a151-3c199a3c3d2e service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:06.139854 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac5353-8de2-40e4-a2f1-feba3c0ebf93 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:06.140145 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac5353-8de2-40e4-a2f1-feba3c0ebf93 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:06.140426 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac5353-8de2-40e4-a2f1-feba3c0ebf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:06.161342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e47d7-ac47-45bc-a151-3c199a3c3d2e service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:06.245141 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-daac5353-8de2-40e4-a2f1-feba3c0ebf93 None None] MFA Rules not processed for user `e2534aee11c049ffb7f474aecad09e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:06.246548 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-daac5353-8de2-40e4-a2f1-feba3c0ebf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:06.297274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d00a1-13f2-481f-b6cd-a775c011d803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:06.298350 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d00a1-13f2-481f-b6cd-a775c011d803 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:06.298650 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d00a1-13f2-481f-b6cd-a775c011d803 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:06.298935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d00a1-13f2-481f-b6cd-a775c011d803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:06.410153 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 863/1708] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:06 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:57:06.416943 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac5353-8de2-40e4-a2f1-feba3c0ebf93 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:06.486773 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d00a1-13f2-481f-b6cd-a775c011d803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:06.488243 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d00a1-13f2-481f-b6cd-a775c011d803 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:06.509108 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:06.545881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 846/1709] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:06.616214 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac5353-8de2-40e4-a2f1-feba3c0ebf93 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:06.641754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070637e2-ab65-4719-9234-f1e52021459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:06.642763 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070637e2-ab65-4719-9234-f1e52021459b admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:06.649138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070637e2-ab65-4719-9234-f1e52021459b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:06.649734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070637e2-ab65-4719-9234-f1e52021459b admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:06.659313 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070637e2-ab65-4719-9234-f1e52021459b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:06.663362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070637e2-ab65-4719-9234-f1e52021459b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:06.855436 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 864/1710] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:06 2022] POST /identity/v3/projects => generated 365 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:06.857887 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d00a1-13f2-481f-b6cd-a775c011d803 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:06.873967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d00a1-13f2-481f-b6cd-a775c011d803 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:07.016108 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4566b-8bc6-4847-9180-aa86922dd8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:07.017267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4566b-8bc6-4847-9180-aa86922dd8d6 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:07.019067 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4566b-8bc6-4847-9180-aa86922dd8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:07.019067 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4566b-8bc6-4847-9180-aa86922dd8d6 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:07.019067 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4566b-8bc6-4847-9180-aa86922dd8d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:07.020782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4566b-8bc6-4847-9180-aa86922dd8d6 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:07.139088 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d8b3c-7e4f-4bc7-acce-6ddc78369d17 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:07.139410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d8b3c-7e4f-4bc7-acce-6ddc78369d17 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:07.139689 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d8b3c-7e4f-4bc7-acce-6ddc78369d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:07.163504 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 847/1711] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:06 2022] POST /identity/v3/users => generated 289 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:07.167156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4566b-8bc6-4847-9180-aa86922dd8d6 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:07.201491 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-da6d8b3c-7e4f-4bc7-acce-6ddc78369d17 None None] MFA Rules not processed for user `1eefe0d721484433b72afca03a2c1bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:07.204861 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4566b-8bc6-4847-9180-aa86922dd8d6 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:07.207237 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-da6d8b3c-7e4f-4bc7-acce-6ddc78369d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:07.219708 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5791e-2559-4429-86f7-fdde76bbd262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:07.220649 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5791e-2559-4429-86f7-fdde76bbd262 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:07.228059 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5791e-2559-4429-86f7-fdde76bbd262 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:07.228059 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5791e-2559-4429-86f7-fdde76bbd262 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:07.228059 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5791e-2559-4429-86f7-fdde76bbd262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:07.228059 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5791e-2559-4429-86f7-fdde76bbd262 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:07.250516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:07.281379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 848/1712] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:57:07.282405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5791e-2559-4429-86f7-fdde76bbd262 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:07.321556 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5791e-2559-4429-86f7-fdde76bbd262 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:07.339931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b19411-e22c-4db8-a735-dd37fc78e83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:07.342692 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b19411-e22c-4db8-a735-dd37fc78e83b admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:07.342961 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b19411-e22c-4db8-a735-dd37fc78e83b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:07.343383 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b19411-e22c-4db8-a735-dd37fc78e83b admin admin] PATH_INFO: `/v3/projects/59b338fab0b044bbbf301b55b60f7ac8/users/bd553511d96e4988acb7dad78cdda296/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:07.393001 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b19411-e22c-4db8-a735-dd37fc78e83b admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b338fab0b044bbbf301b55b60f7ac8, user_id=bd553511d96e4988acb7dad78cdda296, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:07.395613 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b19411-e22c-4db8-a735-dd37fc78e83b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:07.417915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 865/1713] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Jun 16 18:57:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:57:07.424316 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade19d-71d6-45e8-9840-93911b7a6238 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:07.424316 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade19d-71d6-45e8-9840-93911b7a6238 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:07.424316 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade19d-71d6-45e8-9840-93911b7a6238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:07.485157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-08ade19d-71d6-45e8-9840-93911b7a6238 None None] MFA Rules not processed for user `2b29439f50a842da8d9a5ee9575a912d`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:07.486516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-08ade19d-71d6-45e8-9840-93911b7a6238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:07.509156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 849/1714] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:07 2022] PUT /identity/v3/projects/59b338fab0b044bbbf301b55b60f7ac8/users/bd553511d96e4988acb7dad78cdda296/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:07.512795 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b19411-e22c-4db8-a735-dd37fc78e83b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:07.675792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b19411-e22c-4db8-a735-dd37fc78e83b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:07.689930 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c536d42-8435-4341-aa75-d1745b5265b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:07.690736 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c536d42-8435-4341-aa75-d1745b5265b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:07.691081 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c536d42-8435-4341-aa75-d1745b5265b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:07.691437 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c536d42-8435-4341-aa75-d1745b5265b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:07.692299 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c536d42-8435-4341-aa75-d1745b5265b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:07.694201 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c536d42-8435-4341-aa75-d1745b5265b2 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:07.708019 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 850/1715] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:07.711803 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c536d42-8435-4341-aa75-d1745b5265b2 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:07.721864 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 866/1716] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:07.725075 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c536d42-8435-4341-aa75-d1745b5265b2 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:07.736971 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ade19d-71d6-45e8-9840-93911b7a6238 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:07.741561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-08ade19d-71d6-45e8-9840-93911b7a6238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:07.755762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cccbe-e050-4c62-a928-f77571cefa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:07.761678 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cccbe-e050-4c62-a928-f77571cefa86 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:07.761678 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cccbe-e050-4c62-a928-f77571cefa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:07.761678 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cccbe-e050-4c62-a928-f77571cefa86 admin admin] PATH_INFO: `/v3/projects/59b338fab0b044bbbf301b55b60f7ac8/users/bd553511d96e4988acb7dad78cdda296/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:07.763571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cccbe-e050-4c62-a928-f77571cefa86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b338fab0b044bbbf301b55b60f7ac8, user_id=bd553511d96e4988acb7dad78cdda296, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:07.766889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cccbe-e050-4c62-a928-f77571cefa86 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:07.815660 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 851/1717] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:07 2022] PUT /identity/v3/projects/59b338fab0b044bbbf301b55b60f7ac8/users/bd553511d96e4988acb7dad78cdda296/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:07.818052 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f2318-37e7-4295-9b60-dcd54078ac18 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:07.818352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f2318-37e7-4295-9b60-dcd54078ac18 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:07.818638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f2318-37e7-4295-9b60-dcd54078ac18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:07.911049 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-951f2318-37e7-4295-9b60-dcd54078ac18 None None] MFA Rules not processed for user `bd553511d96e4988acb7dad78cdda296`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:07.912330 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-951f2318-37e7-4295-9b60-dcd54078ac18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:08.052267 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ade19d-71d6-45e8-9840-93911b7a6238 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:08.055289 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:08.110188 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 852/1718] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:08.111525 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f2318-37e7-4295-9b60-dcd54078ac18 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:08.114577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-951f2318-37e7-4295-9b60-dcd54078ac18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:08.172965 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17bcb9-d9e6-4f40-9c4e-48c691b3c172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:08.173722 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17bcb9-d9e6-4f40-9c4e-48c691b3c172 service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:08.174011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17bcb9-d9e6-4f40-9c4e-48c691b3c172 service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:08.174452 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17bcb9-d9e6-4f40-9c4e-48c691b3c172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:08.267276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f2318-37e7-4295-9b60-dcd54078ac18 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:08.282329 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd67e65-0c2b-4c6a-8cb5-78306dcecb0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b45db002889846eda5b2a3e6917fcbe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:08.283027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd67e65-0c2b-4c6a-8cb5-78306dcecb0e service swift] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:08.283319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd67e65-0c2b-4c6a-8cb5-78306dcecb0e service swift] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:08.284555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd67e65-0c2b-4c6a-8cb5-78306dcecb0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:08.299990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17bcb9-d9e6-4f40-9c4e-48c691b3c172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:08.301864 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17bcb9-d9e6-4f40-9c4e-48c691b3c172 service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:08.319700 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 867/1719] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:57:08.319700 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17bcb9-d9e6-4f40-9c4e-48c691b3c172 service nova] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:08.323707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-cc17bcb9-d9e6-4f40-9c4e-48c691b3c172 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:08.441426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd67e65-0c2b-4c6a-8cb5-78306dcecb0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:08.444234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd67e65-0c2b-4c6a-8cb5-78306dcecb0e service swift] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:08.475191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 853/1720] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Jun 16 18:57:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:57:08.481426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aff160-1438-4bf5-817a-ce2eed521359 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:08.497595 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aff160-1438-4bf5-817a-ce2eed521359 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:08.498190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aff160-1438-4bf5-817a-ce2eed521359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:08.512236 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17bcb9-d9e6-4f40-9c4e-48c691b3c172 service nova] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:08.535937 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd58fa6-ea5d-4d5d-ac1f-820ed49c9b46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:08.542152 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd58fa6-ea5d-4d5d-ac1f-820ed49c9b46 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:08.542152 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd58fa6-ea5d-4d5d-ac1f-820ed49c9b46 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:08.542152 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd58fa6-ea5d-4d5d-ac1f-820ed49c9b46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:08.562581 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd58fa6-ea5d-4d5d-ac1f-820ed49c9b46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:08.564299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd58fa6-ea5d-4d5d-ac1f-820ed49c9b46 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:08.570154 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f2aff160-1438-4bf5-817a-ce2eed521359 None None] MFA Rules not processed for user `3c407a688b8948ed9c26aa2995678107`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:08.571301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f2aff160-1438-4bf5-817a-ce2eed521359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:08.601539 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 868/1721] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:08.808292 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd58fa6-ea5d-4d5d-ac1f-820ed49c9b46 service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:08.810601 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2dd58fa6-ea5d-4d5d-ac1f-820ed49c9b46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:08.843700 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 854/1722] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:08.856028 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b6373-7a24-45fb-804f-a0b83aa1c14f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:08.856705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b6373-7a24-45fb-804f-a0b83aa1c14f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:08.857412 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b6373-7a24-45fb-804f-a0b83aa1c14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:08.920121 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-dd4b6373-7a24-45fb-804f-a0b83aa1c14f None None] MFA Rules not processed for user `3c407a688b8948ed9c26aa2995678107`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:08.921517 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-dd4b6373-7a24-45fb-804f-a0b83aa1c14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:08.961800 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 855/1723] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:09.046807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b6373-7a24-45fb-804f-a0b83aa1c14f None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:09.046807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-dd4b6373-7a24-45fb-804f-a0b83aa1c14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:09.046807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b6373-7a24-45fb-804f-a0b83aa1c14f None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:09.047156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fd311-e28f-45f9-8246-ebd14750f88f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:09.047156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fd311-e28f-45f9-8246-ebd14750f88f service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:09.047156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fd311-e28f-45f9-8246-ebd14750f88f service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:09.047156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fd311-e28f-45f9-8246-ebd14750f88f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:09.047431 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd58fa6-ea5d-4d5d-ac1f-820ed49c9b46 service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:09.047431 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d84a8-d7af-497d-a322-6d87c88f504e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:09.047431 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d84a8-d7af-497d-a322-6d87c88f504e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:09.047431 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d84a8-d7af-497d-a322-6d87c88f504e admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:09.049863 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d84a8-d7af-497d-a322-6d87c88f504e admin admin] PATH_INFO: `/v3/projects/d831a1f2416843fe84261912d788e89d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:09.053024 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d84a8-d7af-497d-a322-6d87c88f504e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d831a1f2416843fe84261912d788e89d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:09.062782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d84a8-d7af-497d-a322-6d87c88f504e admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:09.065712 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fd311-e28f-45f9-8246-ebd14750f88f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:09.069630 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fd311-e28f-45f9-8246-ebd14750f88f service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:09.207091 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 856/1724] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:09.467446 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-932d84a8-d7af-497d-a322-6d87c88f504e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd831a1f2416843fe84261912d788e89d', 'request_id': 'req-932d84a8-d7af-497d-a322-6d87c88f504e'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:09.505933 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:09.547438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-932d84a8-d7af-497d-a322-6d87c88f504e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd831a1f2416843fe84261912d788e89d', 'request_id': 'req-932d84a8-d7af-497d-a322-6d87c88f504e'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:09.555043 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-932d84a8-d7af-497d-a322-6d87c88f504e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd831a1f2416843fe84261912d788e89d', 'request_id': 'req-932d84a8-d7af-497d-a322-6d87c88f504e'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:09.585951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-932d84a8-d7af-497d-a322-6d87c88f504e admin admin] The token cache is being invalidate because project d831a1f2416843fe84261912d788e89d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:09.587197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-932d84a8-d7af-497d-a322-6d87c88f504e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:09.601031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-932d84a8-d7af-497d-a322-6d87c88f504e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:09.619267 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 869/1725] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:08 2022] DELETE /identity/v3/projects/d831a1f2416843fe84261912d788e89d => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:09.622542 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fd311-e28f-45f9-8246-ebd14750f88f service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:09.631822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d84a8-d7af-497d-a322-6d87c88f504e admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:09.632740 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-357fd311-e28f-45f9-8246-ebd14750f88f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:09.639491 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-932d84a8-d7af-497d-a322-6d87c88f504e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:09.706139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fd311-e28f-45f9-8246-ebd14750f88f service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:09.915117 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d84a8-d7af-497d-a322-6d87c88f504e admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:09.945403 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7635789-2b9a-40c2-9303-f20241a9c18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:09.946688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7635789-2b9a-40c2-9303-f20241a9c18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:09.946981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7635789-2b9a-40c2-9303-f20241a9c18f admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:09.947381 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7635789-2b9a-40c2-9303-f20241a9c18f admin admin] PATH_INFO: `/v3/users/14b4430c783c41009526545001e58064` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:09.948981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7635789-2b9a-40c2-9303-f20241a9c18f admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b4430c783c41009526545001e58064)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:09.953748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7635789-2b9a-40c2-9303-f20241a9c18f admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:09.970478 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b6ed2-a75d-4c36-8c8d-22aba05809ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:09.971386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b6ed2-a75d-4c36-8c8d-22aba05809ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:09.971671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b6ed2-a75d-4c36-8c8d-22aba05809ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:09.971955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b6ed2-a75d-4c36-8c8d-22aba05809ed admin admin] PATH_INFO: `/v3/projects/30b438039b374ea189c8d7cceda8a055` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:09.985034 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b6ed2-a75d-4c36-8c8d-22aba05809ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b438039b374ea189c8d7cceda8a055)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:09.985034 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b6ed2-a75d-4c36-8c8d-22aba05809ed admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:10.221730 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b7635789-2b9a-40c2-9303-f20241a9c18f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b4430c783c41009526545001e58064'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:10.227501 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b7635789-2b9a-40c2-9303-f20241a9c18f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b4430c783c41009526545001e58064'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:10.244195 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-732b6ed2-a75d-4c36-8c8d-22aba05809ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b438039b374ea189c8d7cceda8a055', 'request_id': 'req-732b6ed2-a75d-4c36-8c8d-22aba05809ed'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:10.258904 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-732b6ed2-a75d-4c36-8c8d-22aba05809ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b438039b374ea189c8d7cceda8a055', 'request_id': 'req-732b6ed2-a75d-4c36-8c8d-22aba05809ed'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:10.288713 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-732b6ed2-a75d-4c36-8c8d-22aba05809ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b438039b374ea189c8d7cceda8a055', 'request_id': 'req-732b6ed2-a75d-4c36-8c8d-22aba05809ed'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:10.313130 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b7635789-2b9a-40c2-9303-f20241a9c18f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b4430c783c41009526545001e58064'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:10.343258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b7635789-2b9a-40c2-9303-f20241a9c18f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b4430c783c41009526545001e58064'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:10.344177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b7635789-2b9a-40c2-9303-f20241a9c18f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b4430c783c41009526545001e58064'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:10.431711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 870/1726] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:09 2022] DELETE /identity/v3/users/14b4430c783c41009526545001e58064 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:10.431711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa08b34-d8f3-4f4b-8c19-b4e21b54a645 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:10.431711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa08b34-d8f3-4f4b-8c19-b4e21b54a645 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:10.431711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa08b34-d8f3-4f4b-8c19-b4e21b54a645 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:10.441947 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-732b6ed2-a75d-4c36-8c8d-22aba05809ed admin admin] The token cache is being invalidate because project 30b438039b374ea189c8d7cceda8a055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:10.443107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-732b6ed2-a75d-4c36-8c8d-22aba05809ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:10.446885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-732b6ed2-a75d-4c36-8c8d-22aba05809ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:10.459408 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 871/1728] 10.222.0.93 () {54 vars in 912 bytes} [Thu Jun 16 18:57:10 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:57:10.459499 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 857/1728] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:09 2022] DELETE /identity/v3/projects/30b438039b374ea189c8d7cceda8a055 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:10.461004 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02807b5a-3b37-4c09-97cd-23399637ab2e None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:10.461390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02807b5a-3b37-4c09-97cd-23399637ab2e None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:10.461666 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02807b5a-3b37-4c09-97cd-23399637ab2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:10.463259 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb29a72-442a-4a39-b333-f535fb46df4e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:10.467386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb29a72-442a-4a39-b333-f535fb46df4e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:10.467857 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb29a72-442a-4a39-b333-f535fb46df4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:10.526441 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:10.549822 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-cfb29a72-442a-4a39-b333-f535fb46df4e None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:10.560193 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cfb29a72-442a-4a39-b333-f535fb46df4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:10.564111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-02807b5a-3b37-4c09-97cd-23399637ab2e None None] MFA Rules not processed for user `753728a82bdb406892015f8373932ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:10.565086 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-02807b5a-3b37-4c09-97cd-23399637ab2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:10.729911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 872/1729] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Jun 16 18:57:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:10.737282 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02807b5a-3b37-4c09-97cd-23399637ab2e None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:10.744862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-02807b5a-3b37-4c09-97cd-23399637ab2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:10.800736 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 858/1730] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:10.804464 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb29a72-442a-4a39-b333-f535fb46df4e None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:10.807980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cfb29a72-442a-4a39-b333-f535fb46df4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:10.873670 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb29a72-442a-4a39-b333-f535fb46df4e None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:10.873670 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b12b9-ce6a-41ff-9d9e-6c368d2512dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:10.882722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b12b9-ce6a-41ff-9d9e-6c368d2512dd service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:10.884028 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b12b9-ce6a-41ff-9d9e-6c368d2512dd service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:10.884470 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b12b9-ce6a-41ff-9d9e-6c368d2512dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:10.886479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02807b5a-3b37-4c09-97cd-23399637ab2e None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:10.899729 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8c64e-4616-4db2-bcfe-eec1ecfb37a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:10.900954 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8c64e-4616-4db2-bcfe-eec1ecfb37a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:10.901233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8c64e-4616-4db2-bcfe-eec1ecfb37a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:10.901517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8c64e-4616-4db2-bcfe-eec1ecfb37a0 admin admin] PATH_INFO: `/v3/users/e2534aee11c049ffb7f474aecad09e5a` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:10.920381 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8c64e-4616-4db2-bcfe-eec1ecfb37a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2534aee11c049ffb7f474aecad09e5a)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:10.922406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8c64e-4616-4db2-bcfe-eec1ecfb37a0 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:10.931435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b12b9-ce6a-41ff-9d9e-6c368d2512dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:10.935777 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b12b9-ce6a-41ff-9d9e-6c368d2512dd service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:10.994400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 859/1731] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:11.002334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0808188-8618-49f8-8aea-437ee7ca8eb2 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:11.002984 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0808188-8618-49f8-8aea-437ee7ca8eb2 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:11.005650 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0808188-8618-49f8-8aea-437ee7ca8eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:11.121246 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a0808188-8618-49f8-8aea-437ee7ca8eb2 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:11.122760 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a0808188-8618-49f8-8aea-437ee7ca8eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:11.176583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 860/1732] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:11.185901 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0808188-8618-49f8-8aea-437ee7ca8eb2 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:11.225174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0808188-8618-49f8-8aea-437ee7ca8eb2 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:11.228669 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-29f8c64e-4616-4db2-bcfe-eec1ecfb37a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2534aee11c049ffb7f474aecad09e5a'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:11.230072 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-29f8c64e-4616-4db2-bcfe-eec1ecfb37a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2534aee11c049ffb7f474aecad09e5a'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:11.233897 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:11.256809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22112f9-dea9-421f-b0f8-d1919915f9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:11.267029 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22112f9-dea9-421f-b0f8-d1919915f9ca admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:11.267375 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22112f9-dea9-421f-b0f8-d1919915f9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:11.268979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22112f9-dea9-421f-b0f8-d1919915f9ca admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:11.272711 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22112f9-dea9-421f-b0f8-d1919915f9ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:57:11.274169 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22112f9-dea9-421f-b0f8-d1919915f9ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:11.281949 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22112f9-dea9-421f-b0f8-d1919915f9ca admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:11.331542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-29f8c64e-4616-4db2-bcfe-eec1ecfb37a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2534aee11c049ffb7f474aecad09e5a'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:11.339957 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 861/1733] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:57:11.345548 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-29f8c64e-4616-4db2-bcfe-eec1ecfb37a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2534aee11c049ffb7f474aecad09e5a'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:11.345548 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-29f8c64e-4616-4db2-bcfe-eec1ecfb37a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2534aee11c049ffb7f474aecad09e5a'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:11.345759 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22112f9-dea9-421f-b0f8-d1919915f9ca admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:11.362630 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c22112f9-dea9-421f-b0f8-d1919915f9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:11.428814 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22112f9-dea9-421f-b0f8-d1919915f9ca admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:11.443761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768cf88-9809-446a-992c-53d0da406d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:11.444623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768cf88-9809-446a-992c-53d0da406d8e admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:11.445016 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768cf88-9809-446a-992c-53d0da406d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:11.445417 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768cf88-9809-446a-992c-53d0da406d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:11.446240 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768cf88-9809-446a-992c-53d0da406d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:11.448491 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768cf88-9809-446a-992c-53d0da406d8e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:11.450935 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 873/1734] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:10 2022] DELETE /identity/v3/users/e2534aee11c049ffb7f474aecad09e5a => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:11.458804 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331a895-9607-4e03-b38e-abdc3e128f9c None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:11.459621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331a895-9607-4e03-b38e-abdc3e128f9c None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:11.460310 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331a895-9607-4e03-b38e-abdc3e128f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:11.522332 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:11.539154 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-0331a895-9607-4e03-b38e-abdc3e128f9c None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:11.541466 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-0331a895-9607-4e03-b38e-abdc3e128f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:11.604857 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 862/1735] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:11 2022] POST /identity/v3/projects => generated 403 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:11.609415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768cf88-9809-446a-992c-53d0da406d8e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:11.652156 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 874/1736] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:11.687523 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331a895-9607-4e03-b38e-abdc3e128f9c None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:11.691482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-0331a895-9607-4e03-b38e-abdc3e128f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:11.820997 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768cf88-9809-446a-992c-53d0da406d8e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:11.839019 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958e5f2-1950-409a-9eef-9b2f4f9acfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:11.839934 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958e5f2-1950-409a-9eef-9b2f4f9acfe1 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:11.840405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958e5f2-1950-409a-9eef-9b2f4f9acfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:11.840895 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958e5f2-1950-409a-9eef-9b2f4f9acfe1 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:11.842377 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958e5f2-1950-409a-9eef-9b2f4f9acfe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:11.844617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958e5f2-1950-409a-9eef-9b2f4f9acfe1 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:11.950361 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 863/1737] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:11 2022] POST /identity/v3/users => generated 302 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:57:11.958648 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958e5f2-1950-409a-9eef-9b2f4f9acfe1 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:11.981593 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958e5f2-1950-409a-9eef-9b2f4f9acfe1 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:12.001031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331a895-9607-4e03-b38e-abdc3e128f9c None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:12.009054 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744c02b-35b9-4d67-9338-d542fcc1d4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:12.010114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744c02b-35b9-4d67-9338-d542fcc1d4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:12.010701 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744c02b-35b9-4d67-9338-d542fcc1d4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:12.011332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744c02b-35b9-4d67-9338-d542fcc1d4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:12.012295 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744c02b-35b9-4d67-9338-d542fcc1d4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:12.016299 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744c02b-35b9-4d67-9338-d542fcc1d4b1 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:12.067216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 864/1738] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:12.070030 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744c02b-35b9-4d67-9338-d542fcc1d4b1 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:12.107065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744c02b-35b9-4d67-9338-d542fcc1d4b1 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:12.134736 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf911d-4510-455e-af8d-6193ef5fc062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:12.136117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf911d-4510-455e-af8d-6193ef5fc062 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:12.137243 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf911d-4510-455e-af8d-6193ef5fc062 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:12.137783 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf911d-4510-455e-af8d-6193ef5fc062 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:12.140240 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf911d-4510-455e-af8d-6193ef5fc062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:12.154509 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf911d-4510-455e-af8d-6193ef5fc062 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:12.190796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 865/1739] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:12.195306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf911d-4510-455e-af8d-6193ef5fc062 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:12.248483 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1d76b-ecf7-4b3f-b65c-f76d1964f9cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:12.255564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf911d-4510-455e-af8d-6193ef5fc062 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:12.258766 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1d76b-ecf7-4b3f-b65c-f76d1964f9cf service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:12.259072 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1d76b-ecf7-4b3f-b65c-f76d1964f9cf service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:12.259354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1d76b-ecf7-4b3f-b65c-f76d1964f9cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:12.263310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213922f-aebe-4c3d-9960-00e31498d15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:12.266736 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213922f-aebe-4c3d-9960-00e31498d15c admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:12.268954 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213922f-aebe-4c3d-9960-00e31498d15c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:12.280329 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213922f-aebe-4c3d-9960-00e31498d15c admin admin] PATH_INFO: `/v3/projects/b86b54c37812442a802ab2d04306d37a/users/0d1b022533b5491bbf3f14a3bfdb7749/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:12.307142 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:12.316252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1d76b-ecf7-4b3f-b65c-f76d1964f9cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:12.317404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213922f-aebe-4c3d-9960-00e31498d15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86b54c37812442a802ab2d04306d37a, user_id=0d1b022533b5491bbf3f14a3bfdb7749, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:12.317781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1d76b-ecf7-4b3f-b65c-f76d1964f9cf service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:12.321684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213922f-aebe-4c3d-9960-00e31498d15c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:12.388946 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 875/1740] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:57:12.390394 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1d76b-ecf7-4b3f-b65c-f76d1964f9cf service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:12.398690 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-94e1d76b-ecf7-4b3f-b65c-f76d1964f9cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:12.413332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 866/1741] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:12 2022] PUT /identity/v3/projects/b86b54c37812442a802ab2d04306d37a/users/0d1b022533b5491bbf3f14a3bfdb7749/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:12.417514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06a7ff-b027-4638-8e13-5f48e3e8f853 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:12.422722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06a7ff-b027-4638-8e13-5f48e3e8f853 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:12.434554 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06a7ff-b027-4638-8e13-5f48e3e8f853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:12.447115 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1d76b-ecf7-4b3f-b65c-f76d1964f9cf service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:12.518291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-7b06a7ff-b027-4638-8e13-5f48e3e8f853 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:12.523598 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7b06a7ff-b027-4638-8e13-5f48e3e8f853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:12.663437 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 867/1742] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:12.666317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f28922-bc8c-4b74-8b33-8ab8a6a0e676 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:12.667278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f28922-bc8c-4b74-8b33-8ab8a6a0e676 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:12.669809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f28922-bc8c-4b74-8b33-8ab8a6a0e676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:12.675438 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:12.725717 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d30a1-c345-4ee7-aef8-c762079d0dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:12.726768 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d30a1-c345-4ee7-aef8-c762079d0dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:12.727058 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d30a1-c345-4ee7-aef8-c762079d0dae admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:12.727340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d30a1-c345-4ee7-aef8-c762079d0dae admin admin] PATH_INFO: `/v3/projects/38cb543a0ee64ce39a2b951a60b11cde` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:12.730020 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d30a1-c345-4ee7-aef8-c762079d0dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=38cb543a0ee64ce39a2b951a60b11cde)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:12.740104 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d30a1-c345-4ee7-aef8-c762079d0dae admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:12.759247 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b4f28922-bc8c-4b74-8b33-8ab8a6a0e676 None None] MFA Rules not processed for user `3c407a688b8948ed9c26aa2995678107`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:12.761765 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b4f28922-bc8c-4b74-8b33-8ab8a6a0e676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:12.880554 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:12.936967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-8b9d30a1-c345-4ee7-aef8-c762079d0dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38cb543a0ee64ce39a2b951a60b11cde', 'request_id': 'req-8b9d30a1-c345-4ee7-aef8-c762079d0dae'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:12.991646 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 868/1743] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:12.996892 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f28922-bc8c-4b74-8b33-8ab8a6a0e676 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:13.032288 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-8b9d30a1-c345-4ee7-aef8-c762079d0dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38cb543a0ee64ce39a2b951a60b11cde', 'request_id': 'req-8b9d30a1-c345-4ee7-aef8-c762079d0dae'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:13.051714 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-8b9d30a1-c345-4ee7-aef8-c762079d0dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38cb543a0ee64ce39a2b951a60b11cde', 'request_id': 'req-8b9d30a1-c345-4ee7-aef8-c762079d0dae'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:13.085966 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-8b9d30a1-c345-4ee7-aef8-c762079d0dae admin admin] The token cache is being invalidate because project 38cb543a0ee64ce39a2b951a60b11cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:13.099838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-8b9d30a1-c345-4ee7-aef8-c762079d0dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:13.101329 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-8b9d30a1-c345-4ee7-aef8-c762079d0dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:13.105801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 876/1744] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:12 2022] DELETE /identity/v3/projects/38cb543a0ee64ce39a2b951a60b11cde => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:13.109607 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e80b75-4376-4f2a-a408-a745d069fa12 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:13.111144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e80b75-4376-4f2a-a408-a745d069fa12 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:13.113875 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e80b75-4376-4f2a-a408-a745d069fa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:13.277886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-94e80b75-4376-4f2a-a408-a745d069fa12 None None] MFA Rules not processed for user `9813c801a8274c1abe49a0ff7457f119`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:13.281368 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-94e80b75-4376-4f2a-a408-a745d069fa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:13.301273 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f28922-bc8c-4b74-8b33-8ab8a6a0e676 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:13.528929 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f8a75-9df1-466b-ad36-8751605a3d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:13.534428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f8a75-9df1-466b-ad36-8751605a3d14 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:13.535019 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f8a75-9df1-466b-ad36-8751605a3d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:13.535308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f8a75-9df1-466b-ad36-8751605a3d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:13.543181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-df1f8a75-9df1-466b-ad36-8751605a3d14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:13.549144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 877/1745] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:13.565168 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd359cd5-f9ad-44e7-a224-3e4334322650 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:13.577244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd359cd5-f9ad-44e7-a224-3e4334322650 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:13.577244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd359cd5-f9ad-44e7-a224-3e4334322650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:13.629597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-fd359cd5-f9ad-44e7-a224-3e4334322650 None None] MFA Rules not processed for user `753728a82bdb406892015f8373932ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:13.631566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-fd359cd5-f9ad-44e7-a224-3e4334322650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:13.659850 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 878/1746] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Jun 16 18:57:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:13.661789 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3ea34-ca50-4590-a1d3-af57a3ee0d18 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:13.663691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3ea34-ca50-4590-a1d3-af57a3ee0d18 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:13.665191 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3ea34-ca50-4590-a1d3-af57a3ee0d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:13.703854 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f8a75-9df1-466b-ad36-8751605a3d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:13.705565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f8a75-9df1-466b-ad36-8751605a3d14 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:13.740855 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 869/1747] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 748 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:13.742374 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f8a75-9df1-466b-ad36-8751605a3d14 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:13.746599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-df1f8a75-9df1-466b-ad36-8751605a3d14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:13.759508 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-bca3ea34-ca50-4590-a1d3-af57a3ee0d18 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:13.764690 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-bca3ea34-ca50-4590-a1d3-af57a3ee0d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:13.772105 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f8a75-9df1-466b-ad36-8751605a3d14 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:13.786693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 879/1748] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:13.788704 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e621ef9-4cbc-408f-989c-3f8a94348c11 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:13.789340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e621ef9-4cbc-408f-989c-3f8a94348c11 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:13.789887 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e621ef9-4cbc-408f-989c-3f8a94348c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:13.792188 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6face-97d0-4528-bbef-214525d1dd77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:13.817913 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6face-97d0-4528-bbef-214525d1dd77 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:13.820048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6face-97d0-4528-bbef-214525d1dd77 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:13.824345 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6face-97d0-4528-bbef-214525d1dd77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:13.855366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6face-97d0-4528-bbef-214525d1dd77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:13.861557 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6face-97d0-4528-bbef-214525d1dd77 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:13.900245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 870/1749] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:13.904670 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6face-97d0-4528-bbef-214525d1dd77 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:13.907884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c1c6face-97d0-4528-bbef-214525d1dd77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:13.908046 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-3e621ef9-4cbc-408f-989c-3f8a94348c11 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:13.922300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-3e621ef9-4cbc-408f-989c-3f8a94348c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:13.946037 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6face-97d0-4528-bbef-214525d1dd77 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:13.955386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 880/1750] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:13.963474 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e621ef9-4cbc-408f-989c-3f8a94348c11 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:13.972693 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b8687-5544-4053-a24a-b1b793b20a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:13.972693 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b8687-5544-4053-a24a-b1b793b20a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:13.972693 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b8687-5544-4053-a24a-b1b793b20a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:13.972693 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b8687-5544-4053-a24a-b1b793b20a8c admin admin] PATH_INFO: `/v3/projects/3678e24d53f845fa916500fe3b301468` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:13.973228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-3e621ef9-4cbc-408f-989c-3f8a94348c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:13.973304 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b8687-5544-4053-a24a-b1b793b20a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3678e24d53f845fa916500fe3b301468)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:13.977853 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b8687-5544-4053-a24a-b1b793b20a8c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:13.988495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:14.182324 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e621ef9-4cbc-408f-989c-3f8a94348c11 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:14.183520 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-480b8687-5544-4053-a24a-b1b793b20a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3678e24d53f845fa916500fe3b301468', 'request_id': 'req-480b8687-5544-4053-a24a-b1b793b20a8c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:14.208243 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-480b8687-5544-4053-a24a-b1b793b20a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3678e24d53f845fa916500fe3b301468', 'request_id': 'req-480b8687-5544-4053-a24a-b1b793b20a8c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:14.251534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-480b8687-5544-4053-a24a-b1b793b20a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3678e24d53f845fa916500fe3b301468', 'request_id': 'req-480b8687-5544-4053-a24a-b1b793b20a8c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:14.342616 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-480b8687-5544-4053-a24a-b1b793b20a8c admin admin] The token cache is being invalidate because project 3678e24d53f845fa916500fe3b301468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:14.346357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-480b8687-5544-4053-a24a-b1b793b20a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:14.346357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-480b8687-5544-4053-a24a-b1b793b20a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:14.346357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 871/1751] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:13 2022] DELETE /identity/v3/projects/3678e24d53f845fa916500fe3b301468 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:14.346723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b8687-5544-4053-a24a-b1b793b20a8c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:14.351294 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-480b8687-5544-4053-a24a-b1b793b20a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:14.408302 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbc4af-a7bf-4283-bc30-852a3954b15f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:14.409718 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbc4af-a7bf-4283-bc30-852a3954b15f service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:14.410271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbc4af-a7bf-4283-bc30-852a3954b15f service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:14.410688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbc4af-a7bf-4283-bc30-852a3954b15f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:14.416461 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-73cbc4af-a7bf-4283-bc30-852a3954b15f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:14.526315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b8687-5544-4053-a24a-b1b793b20a8c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:14.545035 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c86b5-3363-4e97-8cc0-61e4657a45b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:14.546402 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c86b5-3363-4e97-8cc0-61e4657a45b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:14.548918 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:14.549472 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c86b5-3363-4e97-8cc0-61e4657a45b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:14.554096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c86b5-3363-4e97-8cc0-61e4657a45b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:14.554096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c86b5-3363-4e97-8cc0-61e4657a45b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:57:14.554096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c86b5-3363-4e97-8cc0-61e4657a45b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:14.559404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c86b5-3363-4e97-8cc0-61e4657a45b7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:14.599829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 872/1752] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:57:14.600696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c86b5-3363-4e97-8cc0-61e4657a45b7 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:14.608710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cd6c86b5-3363-4e97-8cc0-61e4657a45b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:14.626523 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbc4af-a7bf-4283-bc30-852a3954b15f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:14.628097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbc4af-a7bf-4283-bc30-852a3954b15f service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:14.637038 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c86b5-3363-4e97-8cc0-61e4657a45b7 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:14.664904 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21342981-ba20-468a-9687-59f6a1a6fcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:14.670617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21342981-ba20-468a-9687-59f6a1a6fcce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:14.670617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21342981-ba20-468a-9687-59f6a1a6fcce admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:14.670617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21342981-ba20-468a-9687-59f6a1a6fcce admin admin] PATH_INFO: `/v3/users/bd553511d96e4988acb7dad78cdda296` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:14.670617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21342981-ba20-468a-9687-59f6a1a6fcce admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd553511d96e4988acb7dad78cdda296)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:14.675104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21342981-ba20-468a-9687-59f6a1a6fcce admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:14.676527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 881/1753] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:14.677470 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbc4af-a7bf-4283-bc30-852a3954b15f service nova] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:14.696209 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:14.719887 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbc4af-a7bf-4283-bc30-852a3954b15f service nova] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:14.765272 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac7f4f-88f4-4918-82cf-9b0ceed96de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:14.765989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac7f4f-88f4-4918-82cf-9b0ceed96de8 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:14.766283 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac7f4f-88f4-4918-82cf-9b0ceed96de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:14.766569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac7f4f-88f4-4918-82cf-9b0ceed96de8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:14.767287 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac7f4f-88f4-4918-82cf-9b0ceed96de8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:14.769390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac7f4f-88f4-4918-82cf-9b0ceed96de8 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:14.974045 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 882/1754] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:14 2022] POST /identity/v3/projects => generated 365 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:14.978002 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac7f4f-88f4-4918-82cf-9b0ceed96de8 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:14.981182 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-21342981-ba20-468a-9687-59f6a1a6fcce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd553511d96e4988acb7dad78cdda296'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:14.985150 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-21342981-ba20-468a-9687-59f6a1a6fcce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd553511d96e4988acb7dad78cdda296'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:15.075850 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-21342981-ba20-468a-9687-59f6a1a6fcce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd553511d96e4988acb7dad78cdda296'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:15.086836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-21342981-ba20-468a-9687-59f6a1a6fcce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd553511d96e4988acb7dad78cdda296'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:15.121672 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-21342981-ba20-468a-9687-59f6a1a6fcce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd553511d96e4988acb7dad78cdda296'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:15.145868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 873/1755] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:14 2022] DELETE /identity/v3/users/bd553511d96e4988acb7dad78cdda296 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:15.258912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac7f4f-88f4-4918-82cf-9b0ceed96de8 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:15.461006 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d5715-f43f-43a1-ad11-3409e17bc46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:15.461947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d5715-f43f-43a1-ad11-3409e17bc46c admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:15.462244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d5715-f43f-43a1-ad11-3409e17bc46c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:15.462716 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d5715-f43f-43a1-ad11-3409e17bc46c admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:15.463540 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d5715-f43f-43a1-ad11-3409e17bc46c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:15.465541 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d5715-f43f-43a1-ad11-3409e17bc46c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:15.727136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21342981-ba20-468a-9687-59f6a1a6fcce admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:15.731391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 883/1756] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:14 2022] POST /identity/v3/users => generated 283 bytes in 749 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:57:15.731530 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-21342981-ba20-468a-9687-59f6a1a6fcce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:15.785349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21342981-ba20-468a-9687-59f6a1a6fcce admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:15.822087 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a1c93-f975-454f-8a13-730cbbeb02fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:15.831317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a1c93-f975-454f-8a13-730cbbeb02fa admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:15.831317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a1c93-f975-454f-8a13-730cbbeb02fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:15.831317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a1c93-f975-454f-8a13-730cbbeb02fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:15.831317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a1c93-f975-454f-8a13-730cbbeb02fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:15.838640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a1c93-f975-454f-8a13-730cbbeb02fa admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:15.892724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 874/1757] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:57:15.896816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d5715-f43f-43a1-ad11-3409e17bc46c admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:15.920878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d5715-f43f-43a1-ad11-3409e17bc46c admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:15.926169 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aeb86b-db7d-4e11-a96c-7d0fce9c7f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:15.927261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeb86b-db7d-4e11-a96c-7d0fce9c7f52 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:15.927815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeb86b-db7d-4e11-a96c-7d0fce9c7f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:15.928279 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeb86b-db7d-4e11-a96c-7d0fce9c7f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:15.929413 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aeb86b-db7d-4e11-a96c-7d0fce9c7f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:15.942902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aeb86b-db7d-4e11-a96c-7d0fce9c7f52 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:15.949010 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a1c93-f975-454f-8a13-730cbbeb02fa admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:15.952391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 884/1758] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:15.962862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a1c93-f975-454f-8a13-730cbbeb02fa admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:15.977076 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f09442-dad4-4722-ae2d-0e7e640870c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:15.978219 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f09442-dad4-4722-ae2d-0e7e640870c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:15.978711 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f09442-dad4-4722-ae2d-0e7e640870c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:15.979191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f09442-dad4-4722-ae2d-0e7e640870c6 admin admin] PATH_INFO: `/v3/projects/5614678875d145fea1d26f6fe54bb4a2/users/fd7bf1dedac2456e8d66d33f24559382/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:16.041988 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f09442-dad4-4722-ae2d-0e7e640870c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5614678875d145fea1d26f6fe54bb4a2, user_id=fd7bf1dedac2456e8d66d33f24559382, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:16.044739 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f09442-dad4-4722-ae2d-0e7e640870c6 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:16.171796 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb83793-e610-4dc5-b6b8-1d3334be5a30 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:16.172111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb83793-e610-4dc5-b6b8-1d3334be5a30 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:16.172375 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb83793-e610-4dc5-b6b8-1d3334be5a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:16.174129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 875/1759] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:15 2022] PUT /identity/v3/projects/5614678875d145fea1d26f6fe54bb4a2/users/fd7bf1dedac2456e8d66d33f24559382/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:16.259634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-fdb83793-e610-4dc5-b6b8-1d3334be5a30 None None] MFA Rules not processed for user `fd7bf1dedac2456e8d66d33f24559382`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:16.262059 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-fdb83793-e610-4dc5-b6b8-1d3334be5a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:16.440298 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:16.492275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f09442-dad4-4722-ae2d-0e7e640870c6 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:16.500658 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 885/1760] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:57:16.685180 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f09442-dad4-4722-ae2d-0e7e640870c6 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:16.725283 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f11bf3-cbe2-477b-a840-bd013b22d636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:16.726242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f11bf3-cbe2-477b-a840-bd013b22d636 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:16.726712 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f11bf3-cbe2-477b-a840-bd013b22d636 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:16.727136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f11bf3-cbe2-477b-a840-bd013b22d636 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:16.727987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f11bf3-cbe2-477b-a840-bd013b22d636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:16.730723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f11bf3-cbe2-477b-a840-bd013b22d636 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:16.923222 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 876/1761] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:16 2022] POST /identity/v3/projects => generated 363 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:57:16.927786 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb83793-e610-4dc5-b6b8-1d3334be5a30 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:16.951718 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb83793-e610-4dc5-b6b8-1d3334be5a30 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:17.056690 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d7e3c-a5f6-489d-9a19-0d2a3699e484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:17.057740 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d7e3c-a5f6-489d-9a19-0d2a3699e484 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:17.058197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d7e3c-a5f6-489d-9a19-0d2a3699e484 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:17.058635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d7e3c-a5f6-489d-9a19-0d2a3699e484 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:17.059497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d7e3c-a5f6-489d-9a19-0d2a3699e484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:17.061642 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d7e3c-a5f6-489d-9a19-0d2a3699e484 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:17.195591 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f11bf3-cbe2-477b-a840-bd013b22d636 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:17.196885 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 886/1762] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:16 2022] POST /identity/v3/users => generated 288 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:17.213060 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f11bf3-cbe2-477b-a840-bd013b22d636 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:17.242141 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9c013-6811-463c-a268-cd118c11e919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:17.243234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9c013-6811-463c-a268-cd118c11e919 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:17.243750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9c013-6811-463c-a268-cd118c11e919 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:17.244240 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9c013-6811-463c-a268-cd118c11e919 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:17.245256 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9c013-6811-463c-a268-cd118c11e919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:17.247117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9c013-6811-463c-a268-cd118c11e919 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:17.279767 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 877/1763] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:17.284992 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d7e3c-a5f6-489d-9a19-0d2a3699e484 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:17.315966 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d7e3c-a5f6-489d-9a19-0d2a3699e484 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:17.339117 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650981d9-9de3-453d-ada8-7fcc5a6fbef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:17.347345 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650981d9-9de3-453d-ada8-7fcc5a6fbef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:17.347729 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650981d9-9de3-453d-ada8-7fcc5a6fbef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:17.348021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650981d9-9de3-453d-ada8-7fcc5a6fbef9 admin admin] PATH_INFO: `/v3/projects/441b706d366b48d38f6e1669c9270259/users/c4d63a477e084a139df2986339d55d8b/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:17.403942 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650981d9-9de3-453d-ada8-7fcc5a6fbef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=441b706d366b48d38f6e1669c9270259, user_id=c4d63a477e084a139df2986339d55d8b, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:17.412717 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650981d9-9de3-453d-ada8-7fcc5a6fbef9 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:17.479787 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62cf33-7541-4e77-b75c-80c6e92caab7 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:17.480185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62cf33-7541-4e77-b75c-80c6e92caab7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:17.480680 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62cf33-7541-4e77-b75c-80c6e92caab7 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:17.482296 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 878/1764] 10.222.0.93 () {54 vars in 921 bytes} [Thu Jun 16 18:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:57:17.545222 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848c74b-6d85-453e-ba75-599c16a91c33 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:17.548792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848c74b-6d85-453e-ba75-599c16a91c33 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:17.549346 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848c74b-6d85-453e-ba75-599c16a91c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:17.569055 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 887/1765] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:17 2022] PUT /identity/v3/projects/441b706d366b48d38f6e1669c9270259/users/c4d63a477e084a139df2986339d55d8b/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:17.576245 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650981d9-9de3-453d-ada8-7fcc5a6fbef9 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:17.589265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-1848c74b-6d85-453e-ba75-599c16a91c33 None None] MFA Rules not processed for user `3503ec98bea14693a17a84e686586bad`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:17.589265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1848c74b-6d85-453e-ba75-599c16a91c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:17.692625 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:17.813515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 879/1766] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Jun 16 18:57:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:57:17.826240 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650981d9-9de3-453d-ada8-7fcc5a6fbef9 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:17.862489 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dff160-ed5b-4a8d-b24c-5b958aa1519b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:17.863746 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dff160-ed5b-4a8d-b24c-5b958aa1519b admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:17.875379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dff160-ed5b-4a8d-b24c-5b958aa1519b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:17.875904 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dff160-ed5b-4a8d-b24c-5b958aa1519b admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:17.876362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848c74b-6d85-453e-ba75-599c16a91c33 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:17.877304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dff160-ed5b-4a8d-b24c-5b958aa1519b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:17.877808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1848c74b-6d85-453e-ba75-599c16a91c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:17.881312 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dff160-ed5b-4a8d-b24c-5b958aa1519b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:17.913567 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848c74b-6d85-453e-ba75-599c16a91c33 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:17.927556 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:17.927556 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 888/1767] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:17.928355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8da528-3160-4926-a873-16adbfb2d836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:17.930736 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8da528-3160-4926-a873-16adbfb2d836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:17.934189 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8da528-3160-4926-a873-16adbfb2d836 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:17.934797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8da528-3160-4926-a873-16adbfb2d836 admin admin] PATH_INFO: `/v3/projects/59b338fab0b044bbbf301b55b60f7ac8` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:17.935417 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dff160-ed5b-4a8d-b24c-5b958aa1519b admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:17.937943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8da528-3160-4926-a873-16adbfb2d836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b338fab0b044bbbf301b55b60f7ac8)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:17.940275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8da528-3160-4926-a873-16adbfb2d836 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:17.962842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dff160-ed5b-4a8d-b24c-5b958aa1519b admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:17.990825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f68892-4bc5-4563-9620-9ec92b659b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:17.990825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f68892-4bc5-4563-9620-9ec92b659b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:17.990825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f68892-4bc5-4563-9620-9ec92b659b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:17.996013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f68892-4bc5-4563-9620-9ec92b659b30 admin admin] PATH_INFO: `/v3/projects/441b706d366b48d38f6e1669c9270259/users/c4d63a477e084a139df2986339d55d8b/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:18.003209 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f68892-4bc5-4563-9620-9ec92b659b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=441b706d366b48d38f6e1669c9270259, user_id=c4d63a477e084a139df2986339d55d8b, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:18.006342 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f68892-4bc5-4563-9620-9ec92b659b30 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:18.053237 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 889/1768] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:17 2022] PUT /identity/v3/projects/441b706d366b48d38f6e1669c9270259/users/c4d63a477e084a139df2986339d55d8b/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:18.054396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f68892-4bc5-4563-9620-9ec92b659b30 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:18.059244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b7f68892-4bc5-4563-9620-9ec92b659b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:18.137911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-df8da528-3160-4926-a873-16adbfb2d836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b338fab0b044bbbf301b55b60f7ac8', 'request_id': 'req-df8da528-3160-4926-a873-16adbfb2d836'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:18.156832 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-df8da528-3160-4926-a873-16adbfb2d836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b338fab0b044bbbf301b55b60f7ac8', 'request_id': 'req-df8da528-3160-4926-a873-16adbfb2d836'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:18.175139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-df8da528-3160-4926-a873-16adbfb2d836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b338fab0b044bbbf301b55b60f7ac8', 'request_id': 'req-df8da528-3160-4926-a873-16adbfb2d836'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:18.272963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f68892-4bc5-4563-9620-9ec92b659b30 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:18.319180 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-df8da528-3160-4926-a873-16adbfb2d836 admin admin] The token cache is being invalidate because project 59b338fab0b044bbbf301b55b60f7ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:18.319493 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-df8da528-3160-4926-a873-16adbfb2d836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:18.320581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-df8da528-3160-4926-a873-16adbfb2d836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:18.322259 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 880/1769] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:17 2022] DELETE /identity/v3/projects/59b338fab0b044bbbf301b55b60f7ac8 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:18.324231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c64a74-9725-4689-a1eb-9b2765b8cdd7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:18.324546 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c64a74-9725-4689-a1eb-9b2765b8cdd7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:18.324833 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c64a74-9725-4689-a1eb-9b2765b8cdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:18.428795 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-84c64a74-9725-4689-a1eb-9b2765b8cdd7 None None] MFA Rules not processed for user `c4d63a477e084a139df2986339d55d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:18.436951 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-84c64a74-9725-4689-a1eb-9b2765b8cdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:18.478249 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72940833-275a-406f-96f4-8e9656bfde4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:18.478980 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72940833-275a-406f-96f4-8e9656bfde4f service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:18.479343 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72940833-275a-406f-96f4-8e9656bfde4f service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:18.479631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72940833-275a-406f-96f4-8e9656bfde4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:18.486497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-72940833-275a-406f-96f4-8e9656bfde4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:18.535401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72940833-275a-406f-96f4-8e9656bfde4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:18.537181 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72940833-275a-406f-96f4-8e9656bfde4f service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:18.586030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 890/1770] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:18.587445 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28099f-eb95-4843-9e58-1b4aac78f227 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:18.587702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28099f-eb95-4843-9e58-1b4aac78f227 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:18.587998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28099f-eb95-4843-9e58-1b4aac78f227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:18.652528 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 881/1771] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:18 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:18.667962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c64a74-9725-4689-a1eb-9b2765b8cdd7 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:18.669673 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-84c64a74-9725-4689-a1eb-9b2765b8cdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:18.700033 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-0a28099f-eb95-4843-9e58-1b4aac78f227 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:18.701855 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-0a28099f-eb95-4843-9e58-1b4aac78f227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:18.840060 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 891/1772] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:18.842309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16745469-d6b1-432f-937a-af8a0b9721ee None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:18.851509 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16745469-d6b1-432f-937a-af8a0b9721ee None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:18.851509 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16745469-d6b1-432f-937a-af8a0b9721ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:18.859983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c64a74-9725-4689-a1eb-9b2765b8cdd7 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:18.864746 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-16745469-d6b1-432f-937a-af8a0b9721ee None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:18.865491 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181acd3-d026-42c3-be32-b8f24f666e49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:18.866334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181acd3-d026-42c3-be32-b8f24f666e49 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:18.866770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181acd3-d026-42c3-be32-b8f24f666e49 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:18.867024 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-16745469-d6b1-432f-937a-af8a0b9721ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:18.867361 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181acd3-d026-42c3-be32-b8f24f666e49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:18.896019 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 892/1773] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:18.901087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16745469-d6b1-432f-937a-af8a0b9721ee None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:18.916209 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16745469-d6b1-432f-937a-af8a0b9721ee None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:18.923894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2faa37-8db6-42b2-8525-ea235fb00bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:18.924631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2faa37-8db6-42b2-8525-ea235fb00bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:18.925205 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2faa37-8db6-42b2-8525-ea235fb00bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:18.925654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2faa37-8db6-42b2-8525-ea235fb00bb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:18.926575 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2faa37-8db6-42b2-8525-ea235fb00bb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:57:18.926899 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2faa37-8db6-42b2-8525-ea235fb00bb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:18.929030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2faa37-8db6-42b2-8525-ea235fb00bb0 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:18.937550 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181acd3-d026-42c3-be32-b8f24f666e49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:18.957415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181acd3-d026-42c3-be32-b8f24f666e49 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:18.961473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 893/1774] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:57:18.962939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2faa37-8db6-42b2-8525-ea235fb00bb0 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:18.986757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2faa37-8db6-42b2-8525-ea235fb00bb0 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:19.003266 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad1933-c2f9-4065-a5f0-62c7ff3fbf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:19.023831 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 882/1775] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:18 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:57:19.024103 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad1933-c2f9-4065-a5f0-62c7ff3fbf1c admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:19.028373 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad1933-c2f9-4065-a5f0-62c7ff3fbf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:19.044071 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad1933-c2f9-4065-a5f0-62c7ff3fbf1c admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:19.044951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad1933-c2f9-4065-a5f0-62c7ff3fbf1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:19.046919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad1933-c2f9-4065-a5f0-62c7ff3fbf1c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:19.253632 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 894/1776] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:18 2022] POST /identity/v3/projects => generated 357 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:19.257093 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181acd3-d026-42c3-be32-b8f24f666e49 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:19.281748 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181acd3-d026-42c3-be32-b8f24f666e49 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:19.401374 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad1933-c2f9-4065-a5f0-62c7ff3fbf1c admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:19.553327 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910f05d-b2c7-4f4d-8c3a-81892032c960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:19.554327 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910f05d-b2c7-4f4d-8c3a-81892032c960 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:19.554867 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910f05d-b2c7-4f4d-8c3a-81892032c960 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:19.555331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910f05d-b2c7-4f4d-8c3a-81892032c960 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:19.559464 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910f05d-b2c7-4f4d-8c3a-81892032c960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:19.582177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad1933-c2f9-4065-a5f0-62c7ff3fbf1c admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:19.586505 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910f05d-b2c7-4f4d-8c3a-81892032c960 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:19.587945 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd815b-0148-4855-b817-6f1c75a44189 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:19.589207 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd815b-0148-4855-b817-6f1c75a44189 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:19.589638 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd815b-0148-4855-b817-6f1c75a44189 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:19.590614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd815b-0148-4855-b817-6f1c75a44189 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:19.593797 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-90cd815b-0148-4855-b817-6f1c75a44189 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:19.749390 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 883/1777] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:19 2022] POST /identity/v3/users => generated 279 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:19.758089 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910f05d-b2c7-4f4d-8c3a-81892032c960 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:19.788303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd815b-0148-4855-b817-6f1c75a44189 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:19.790163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd815b-0148-4855-b817-6f1c75a44189 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:19.797361 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910f05d-b2c7-4f4d-8c3a-81892032c960 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:19.803274 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 895/1778] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:19.820027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8f65b-8512-4313-bc24-0e8316dbbf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:19.820765 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8f65b-8512-4313-bc24-0e8316dbbf7d admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:19.821063 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8f65b-8512-4313-bc24-0e8316dbbf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:19.823208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8f65b-8512-4313-bc24-0e8316dbbf7d admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:19.823208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8f65b-8512-4313-bc24-0e8316dbbf7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:19.823696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8f65b-8512-4313-bc24-0e8316dbbf7d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:19.854984 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 884/1779] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:19.859865 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd815b-0148-4855-b817-6f1c75a44189 service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:19.879108 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd815b-0148-4855-b817-6f1c75a44189 service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:19.901901 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429836bd-bca0-4253-a427-2f47a92c9543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:19.902617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429836bd-bca0-4253-a427-2f47a92c9543 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:19.902905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429836bd-bca0-4253-a427-2f47a92c9543 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:19.903187 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429836bd-bca0-4253-a427-2f47a92c9543 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:19.904799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429836bd-bca0-4253-a427-2f47a92c9543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:19.906601 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429836bd-bca0-4253-a427-2f47a92c9543 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:19.964041 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8f65b-8512-4313-bc24-0e8316dbbf7d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:19.968111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 896/1780] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:19.988869 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8f65b-8512-4313-bc24-0e8316dbbf7d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:19.998344 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afbd592-1212-4c4b-b019-62add00add72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:19.999766 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbd592-1212-4c4b-b019-62add00add72 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:20.000204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbd592-1212-4c4b-b019-62add00add72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:20.000789 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbd592-1212-4c4b-b019-62add00add72 admin admin] PATH_INFO: `/v3/projects/65f28abf9ca247cd813bcb0e7546be93/users/de5b386b1e9540e0bbb2060b7511a068/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:20.032842 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:20.134790 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afbd592-1212-4c4b-b019-62add00add72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f28abf9ca247cd813bcb0e7546be93, user_id=de5b386b1e9540e0bbb2060b7511a068, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:20.142442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afbd592-1212-4c4b-b019-62add00add72 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:20.233163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:20.289621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6059884-5741-4158-a084-f62f93c0bc55 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:20.290100 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6059884-5741-4158-a084-f62f93c0bc55 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:20.290442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6059884-5741-4158-a084-f62f93c0bc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:20.297475 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 885/1781] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:19 2022] PUT /identity/v3/projects/65f28abf9ca247cd813bcb0e7546be93/users/de5b386b1e9540e0bbb2060b7511a068/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:20.443396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-f6059884-5741-4158-a084-f62f93c0bc55 None None] MFA Rules not processed for user `de5b386b1e9540e0bbb2060b7511a068`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:20.444709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f6059884-5741-4158-a084-f62f93c0bc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:20.698398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 897/1782] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:20 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:20.701597 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afbd592-1212-4c4b-b019-62add00add72 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:20.854384 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afbd592-1212-4c4b-b019-62add00add72 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:20.859793 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a109b-8254-44e1-91b2-51129d67a45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:20.861324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a109b-8254-44e1-91b2-51129d67a45e admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:20.861324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a109b-8254-44e1-91b2-51129d67a45e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:20.861681 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a109b-8254-44e1-91b2-51129d67a45e admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:20.862844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a109b-8254-44e1-91b2-51129d67a45e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:20.865151 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a109b-8254-44e1-91b2-51129d67a45e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:20.999068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 886/1783] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:20 2022] POST /identity/v3/projects => generated 357 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:21.001201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6059884-5741-4158-a084-f62f93c0bc55 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:21.042236 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6059884-5741-4158-a084-f62f93c0bc55 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:21.209869 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97804cbc-f73b-46b1-918c-a8edffd8ac8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:21.211138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97804cbc-f73b-46b1-918c-a8edffd8ac8a admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:21.211557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97804cbc-f73b-46b1-918c-a8edffd8ac8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:21.212001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97804cbc-f73b-46b1-918c-a8edffd8ac8a admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:21.212924 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97804cbc-f73b-46b1-918c-a8edffd8ac8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:21.215184 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97804cbc-f73b-46b1-918c-a8edffd8ac8a admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:21.307702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a109b-8254-44e1-91b2-51129d67a45e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:21.310683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 898/1784] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:20 2022] POST /identity/v3/users => generated 285 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:21.322458 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a109b-8254-44e1-91b2-51129d67a45e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:21.336162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63044a16-70ad-4805-bdef-a3bc7e6334f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:21.341728 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63044a16-70ad-4805-bdef-a3bc7e6334f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:21.341728 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63044a16-70ad-4805-bdef-a3bc7e6334f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:21.341728 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63044a16-70ad-4805-bdef-a3bc7e6334f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:21.342215 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63044a16-70ad-4805-bdef-a3bc7e6334f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:21.367566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dd2b3-1add-43bd-b4ae-a6f4fe7e7d56 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:21.368000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dd2b3-1add-43bd-b4ae-a6f4fe7e7d56 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:21.368354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dd2b3-1add-43bd-b4ae-a6f4fe7e7d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:21.398580 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63044a16-70ad-4805-bdef-a3bc7e6334f9 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:21.421880 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 887/1785] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:21.428376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-0f1dd2b3-1add-43bd-b4ae-a6f4fe7e7d56 None None] MFA Rules not processed for user `2b29439f50a842da8d9a5ee9575a912d`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:21.430990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-0f1dd2b3-1add-43bd-b4ae-a6f4fe7e7d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:21.453138 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63044a16-70ad-4805-bdef-a3bc7e6334f9 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:21.500209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63044a16-70ad-4805-bdef-a3bc7e6334f9 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:21.517173 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32439544-40c1-49a0-b4a1-26c26435cb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:21.518596 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32439544-40c1-49a0-b4a1-26c26435cb76 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:21.519097 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32439544-40c1-49a0-b4a1-26c26435cb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:21.520235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32439544-40c1-49a0-b4a1-26c26435cb76 admin admin] PATH_INFO: `/v3/projects/70b52bfd32eb496cbb3b2b8d15202e62/users/3dca43a7d098494cb598b23f97abb97d/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:21.545979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32439544-40c1-49a0-b4a1-26c26435cb76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b52bfd32eb496cbb3b2b8d15202e62, user_id=3dca43a7d098494cb598b23f97abb97d, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:21.549948 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32439544-40c1-49a0-b4a1-26c26435cb76 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:21.602558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 899/1786] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:57:21.661309 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 888/1787] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:21 2022] PUT /identity/v3/projects/70b52bfd32eb496cbb3b2b8d15202e62/users/3dca43a7d098494cb598b23f97abb97d/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:21.663613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1dd2b3-1add-43bd-b4ae-a6f4fe7e7d56 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:21.678113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1dd2b3-1add-43bd-b4ae-a6f4fe7e7d56 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:21.827377 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d7124-4396-4330-9c72-a003e94b60c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:21.829691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d7124-4396-4330-9c72-a003e94b60c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:21.830113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d7124-4396-4330-9c72-a003e94b60c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:21.831168 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d7124-4396-4330-9c72-a003e94b60c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:21.833129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d7124-4396-4330-9c72-a003e94b60c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:21.836041 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d7124-4396-4330-9c72-a003e94b60c4 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:21.870528 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32439544-40c1-49a0-b4a1-26c26435cb76 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:21.872144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 900/1788] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:21.886138 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32439544-40c1-49a0-b4a1-26c26435cb76 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:21.906267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bd94c-ff9c-4da9-94f3-7601cfc41333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:21.907193 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bd94c-ff9c-4da9-94f3-7601cfc41333 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:21.907480 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bd94c-ff9c-4da9-94f3-7601cfc41333 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:21.907764 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bd94c-ff9c-4da9-94f3-7601cfc41333 admin admin] PATH_INFO: `/v3/projects/70b52bfd32eb496cbb3b2b8d15202e62/users/3dca43a7d098494cb598b23f97abb97d/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:21.909853 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bd94c-ff9c-4da9-94f3-7601cfc41333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b52bfd32eb496cbb3b2b8d15202e62, user_id=3dca43a7d098494cb598b23f97abb97d, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:21.912573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bd94c-ff9c-4da9-94f3-7601cfc41333 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:21.938156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 889/1789] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:21 2022] PUT /identity/v3/projects/70b52bfd32eb496cbb3b2b8d15202e62/users/3dca43a7d098494cb598b23f97abb97d/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:57:21.948742 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d4fef-3242-4744-8cc7-83a3f9d8a45e None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:21.949249 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d4fef-3242-4744-8cc7-83a3f9d8a45e None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:21.949700 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d4fef-3242-4744-8cc7-83a3f9d8a45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:21.995185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-2d6d4fef-3242-4744-8cc7-83a3f9d8a45e None None] MFA Rules not processed for user `3dca43a7d098494cb598b23f97abb97d`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:21.996476 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2d6d4fef-3242-4744-8cc7-83a3f9d8a45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:22.069311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:22.106212 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dd341-599b-4d24-8c37-e7a5a775e042 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:22.106508 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dd341-599b-4d24-8c37-e7a5a775e042 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:22.106830 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dd341-599b-4d24-8c37-e7a5a775e042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:22.154897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 901/1790] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:21 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:22.171857 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-414dd341-599b-4d24-8c37-e7a5a775e042 None None] MFA Rules not processed for user `0d1b022533b5491bbf3f14a3bfdb7749`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:22.173303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-414dd341-599b-4d24-8c37-e7a5a775e042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:22.357079 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 890/1791] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:57:22.357653 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d4fef-3242-4744-8cc7-83a3f9d8a45e None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:22.358754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2d6d4fef-3242-4744-8cc7-83a3f9d8a45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:22.482882 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dd341-599b-4d24-8c37-e7a5a775e042 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:22.619752 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dd341-599b-4d24-8c37-e7a5a775e042 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:22.625275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c71717-83b4-4db2-a65b-72a7f38c9ab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:22.625967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c71717-83b4-4db2-a65b-72a7f38c9ab8 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:22.626292 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c71717-83b4-4db2-a65b-72a7f38c9ab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:22.626704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c71717-83b4-4db2-a65b-72a7f38c9ab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:22.632416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d4fef-3242-4744-8cc7-83a3f9d8a45e None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:22.651516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c199bb5-99a1-4c78-9562-c2f96dd14f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:22.652276 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c199bb5-99a1-4c78-9562-c2f96dd14f2e admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:22.652864 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c199bb5-99a1-4c78-9562-c2f96dd14f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:22.653150 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c199bb5-99a1-4c78-9562-c2f96dd14f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:22.654188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c199bb5-99a1-4c78-9562-c2f96dd14f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:22.656753 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c71717-83b4-4db2-a65b-72a7f38c9ab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:22.656901 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c199bb5-99a1-4c78-9562-c2f96dd14f2e admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:22.658090 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c71717-83b4-4db2-a65b-72a7f38c9ab8 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:22.700072 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 891/1792] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:22 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:57:22.730335 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:22.885676 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 902/1793] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:22 2022] POST /identity/v3/projects => generated 403 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:57:22.886766 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c71717-83b4-4db2-a65b-72a7f38c9ab8 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:22.921854 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c71717-83b4-4db2-a65b-72a7f38c9ab8 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:23.151901 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb05f1-3613-4d49-8783-a891a77d005c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:23.153345 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb05f1-3613-4d49-8783-a891a77d005c admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:23.154426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb05f1-3613-4d49-8783-a891a77d005c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:23.155664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb05f1-3613-4d49-8783-a891a77d005c admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:23.157190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb05f1-3613-4d49-8783-a891a77d005c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:23.188176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb05f1-3613-4d49-8783-a891a77d005c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:23.512750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c199bb5-99a1-4c78-9562-c2f96dd14f2e admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:23.758707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c199bb5-99a1-4c78-9562-c2f96dd14f2e admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:23.758707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d7687-9a93-466d-826d-6ac18b6da84d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:23.758707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d7687-9a93-466d-826d-6ac18b6da84d service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:23.758707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d7687-9a93-466d-826d-6ac18b6da84d service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:23.759153 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d7687-9a93-466d-826d-6ac18b6da84d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:23.940889 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d7687-9a93-466d-826d-6ac18b6da84d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:23.942375 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d7687-9a93-466d-826d-6ac18b6da84d service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:23.957723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 892/1794] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:22 2022] POST /identity/v3/users => generated 308 bytes in 1071 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:23.958866 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb05f1-3613-4d49-8783-a891a77d005c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:23.975073 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 903/1795] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:23 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:57:23.994578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb05f1-3613-4d49-8783-a891a77d005c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:24.010842 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6b01e-ab53-4ca9-b32e-7536b85e94bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:24.012280 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6b01e-ab53-4ca9-b32e-7536b85e94bf admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:24.016156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6b01e-ab53-4ca9-b32e-7536b85e94bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:24.016821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6b01e-ab53-4ca9-b32e-7536b85e94bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:24.017953 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6b01e-ab53-4ca9-b32e-7536b85e94bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:24.020521 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6b01e-ab53-4ca9-b32e-7536b85e94bf admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:24.073601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 893/1796] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:24.079112 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d7687-9a93-466d-826d-6ac18b6da84d service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:24.098817 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d7687-9a93-466d-826d-6ac18b6da84d service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:24.135122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e8f3b-af9a-49cb-8f06-70db2a6f707e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:24.137167 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e8f3b-af9a-49cb-8f06-70db2a6f707e admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:24.138571 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e8f3b-af9a-49cb-8f06-70db2a6f707e admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:24.139774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e8f3b-af9a-49cb-8f06-70db2a6f707e admin admin] PATH_INFO: `/v3/projects/8e29025218bc4f57b2413582891c746f/users/b37a5fe09c4c4d40ba54c9545b1bc41f/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:24.198981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e8f3b-af9a-49cb-8f06-70db2a6f707e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e29025218bc4f57b2413582891c746f, user_id=b37a5fe09c4c4d40ba54c9545b1bc41f, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:24.214971 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e8f3b-af9a-49cb-8f06-70db2a6f707e admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:24.422192 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6b01e-ab53-4ca9-b32e-7536b85e94bf admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:24.423494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 904/1797] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:24 2022] PUT /identity/v3/projects/8e29025218bc4f57b2413582891c746f/users/b37a5fe09c4c4d40ba54c9545b1bc41f/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:24.439257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6b01e-ab53-4ca9-b32e-7536b85e94bf admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:24.584397 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef299d4b-d731-44bf-a74c-47e3763f33c3 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:24.585201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef299d4b-d731-44bf-a74c-47e3763f33c3 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:24.585767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef299d4b-d731-44bf-a74c-47e3763f33c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:24.658002 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-ef299d4b-d731-44bf-a74c-47e3763f33c3 None None] MFA Rules not processed for user `9813c801a8274c1abe49a0ff7457f119`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:24.664045 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-ef299d4b-d731-44bf-a74c-47e3763f33c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:24.692555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb6655-c611-467b-890e-cb0ae6ffc0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:24.693490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb6655-c611-467b-890e-cb0ae6ffc0ff admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:24.693603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb6655-c611-467b-890e-cb0ae6ffc0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:24.694418 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb6655-c611-467b-890e-cb0ae6ffc0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:24.694584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb6655-c611-467b-890e-cb0ae6ffc0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:24.696490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb6655-c611-467b-890e-cb0ae6ffc0ff admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:24.735615 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 894/1798] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:24.748696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb6655-c611-467b-890e-cb0ae6ffc0ff admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:24.771936 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb6655-c611-467b-890e-cb0ae6ffc0ff admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:24.791149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8973e1-4c9f-4379-9fc7-b568f5ae8499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:24.795849 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8973e1-4c9f-4379-9fc7-b568f5ae8499 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:24.796336 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8973e1-4c9f-4379-9fc7-b568f5ae8499 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:24.799832 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8973e1-4c9f-4379-9fc7-b568f5ae8499 admin admin] PATH_INFO: `/v3/projects/8e29025218bc4f57b2413582891c746f/users/b37a5fe09c4c4d40ba54c9545b1bc41f/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:24.812106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8973e1-4c9f-4379-9fc7-b568f5ae8499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e29025218bc4f57b2413582891c746f, user_id=b37a5fe09c4c4d40ba54c9545b1bc41f, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:24.819463 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8973e1-4c9f-4379-9fc7-b568f5ae8499 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:24.875582 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 895/1799] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:24 2022] PUT /identity/v3/projects/8e29025218bc4f57b2413582891c746f/users/b37a5fe09c4c4d40ba54c9545b1bc41f/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:24.943256 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 905/1800] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:26.530699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:26.693584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:27.486734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e11a7a-e9c2-476b-8d32-4dc7caf281ce None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:27.487603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e11a7a-e9c2-476b-8d32-4dc7caf281ce None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:27.495117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e11a7a-e9c2-476b-8d32-4dc7caf281ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:27.575181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-44e11a7a-e9c2-476b-8d32-4dc7caf281ce None None] MFA Rules not processed for user `b37a5fe09c4c4d40ba54c9545b1bc41f`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:27.577160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-44e11a7a-e9c2-476b-8d32-4dc7caf281ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:27.709107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 896/1801] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:28.757077 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfc972-5b9d-4796-a43f-48c14c560ae5 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:28.769341 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfc972-5b9d-4796-a43f-48c14c560ae5 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:28.769341 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfc972-5b9d-4796-a43f-48c14c560ae5 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:28.770259 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 906/1802] 10.222.0.93 () {54 vars in 921 bytes} [Thu Jun 16 18:57:28 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:57:28.777235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd95f0-484c-4f46-b43b-ceedcd73ff00 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:28.777764 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd95f0-484c-4f46-b43b-ceedcd73ff00 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:28.777864 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd95f0-484c-4f46-b43b-ceedcd73ff00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:28.782201 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:28.816292 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-41bd95f0-484c-4f46-b43b-ceedcd73ff00 None None] MFA Rules not processed for user `3abe1d47a1164776bf3a82fe4b129d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:28.818018 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-41bd95f0-484c-4f46-b43b-ceedcd73ff00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:28.886953 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 897/1803] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Jun 16 18:57:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:57:28.897817 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfc972-5b9d-4796-a43f-48c14c560ae5 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:28.899629 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-bdcfc972-5b9d-4796-a43f-48c14c560ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:28.916087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfc972-5b9d-4796-a43f-48c14c560ae5 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:28.921928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861fac9-75c1-4c27-b221-e7820fae7198 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3abe1d47a1164776bf3a82fe4b129d9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:28.922504 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861fac9-75c1-4c27-b221-e7820fae7198 service placement] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:28.925248 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861fac9-75c1-4c27-b221-e7820fae7198 service placement] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:28.926265 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861fac9-75c1-4c27-b221-e7820fae7198 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:28.942513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861fac9-75c1-4c27-b221-e7820fae7198 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:28.947479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861fac9-75c1-4c27-b221-e7820fae7198 service placement] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:28.961670 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 907/1804] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:29.047812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:30.449602 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332aae4-4fb9-48c3-ba43-42367e5fc9f0 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:30.450674 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332aae4-4fb9-48c3-ba43-42367e5fc9f0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:30.451183 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332aae4-4fb9-48c3-ba43-42367e5fc9f0 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:30.453195 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 898/1805] 10.222.0.93 () {54 vars in 921 bytes} [Thu Jun 16 18:57:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:57:30.461461 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ad939-c019-4694-9130-28c99dd7c78a None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:30.467492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ad939-c019-4694-9130-28c99dd7c78a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:30.467492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ad939-c019-4694-9130-28c99dd7c78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:30.499732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-cf2ad939-c019-4694-9130-28c99dd7c78a None None] MFA Rules not processed for user `3abe1d47a1164776bf3a82fe4b129d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:30.501111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-cf2ad939-c019-4694-9130-28c99dd7c78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:30.513283 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 908/1806] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Jun 16 18:57:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:30.565147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332aae4-4fb9-48c3-ba43-42367e5fc9f0 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:30.565147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4332aae4-4fb9-48c3-ba43-42367e5fc9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:30.565147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332aae4-4fb9-48c3-ba43-42367e5fc9f0 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:30.578349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b464e-bb0c-47b8-afdf-467ff3913096 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3abe1d47a1164776bf3a82fe4b129d9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:30.579021 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b464e-bb0c-47b8-afdf-467ff3913096 service placement] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:30.579305 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b464e-bb0c-47b8-afdf-467ff3913096 service placement] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:30.579738 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b464e-bb0c-47b8-afdf-467ff3913096 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:30.592461 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b464e-bb0c-47b8-afdf-467ff3913096 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:30.592461 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b464e-bb0c-47b8-afdf-467ff3913096 service placement] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:30.610514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 899/1807] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:30.610802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:30.615797 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ad939-c019-4694-9130-28c99dd7c78a None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:30.708360 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ad939-c019-4694-9130-28c99dd7c78a None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:30.714085 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6f65b-c3ff-429b-bb7f-a88c6ae4a193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:30.714971 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6f65b-c3ff-429b-bb7f-a88c6ae4a193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:30.717275 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6f65b-c3ff-429b-bb7f-a88c6ae4a193 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:30.717808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6f65b-c3ff-429b-bb7f-a88c6ae4a193 admin admin] PATH_INFO: `/v3/users/0d1b022533b5491bbf3f14a3bfdb7749` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:30.719404 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6f65b-c3ff-429b-bb7f-a88c6ae4a193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d1b022533b5491bbf3f14a3bfdb7749)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:30.721717 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6f65b-c3ff-429b-bb7f-a88c6ae4a193 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:30.982531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-24e6f65b-c3ff-429b-bb7f-a88c6ae4a193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d1b022533b5491bbf3f14a3bfdb7749'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:30.983248 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-24e6f65b-c3ff-429b-bb7f-a88c6ae4a193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d1b022533b5491bbf3f14a3bfdb7749'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:31.058206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-24e6f65b-c3ff-429b-bb7f-a88c6ae4a193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d1b022533b5491bbf3f14a3bfdb7749'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:31.066311 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-24e6f65b-c3ff-429b-bb7f-a88c6ae4a193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d1b022533b5491bbf3f14a3bfdb7749'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:31.067009 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-24e6f65b-c3ff-429b-bb7f-a88c6ae4a193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d1b022533b5491bbf3f14a3bfdb7749'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:31.085421 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 909/1808] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:30 2022] DELETE /identity/v3/users/0d1b022533b5491bbf3f14a3bfdb7749 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:32.023557 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b464e-bb0c-47b8-afdf-467ff3913096 service placement] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:32.037716 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b464e-bb0c-47b8-afdf-467ff3913096 service placement] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:32.064943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:32.087556 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:32.127883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcd0ae-6314-4739-8e23-2a0413855c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:32.129155 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcd0ae-6314-4739-8e23-2a0413855c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:32.129535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcd0ae-6314-4739-8e23-2a0413855c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:32.129890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcd0ae-6314-4739-8e23-2a0413855c10 admin admin] PATH_INFO: `/v3/projects/b86b54c37812442a802ab2d04306d37a` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:32.131180 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcd0ae-6314-4739-8e23-2a0413855c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b86b54c37812442a802ab2d04306d37a)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:32.133213 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcd0ae-6314-4739-8e23-2a0413855c10 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:32.283589 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7bbcd0ae-6314-4739-8e23-2a0413855c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b86b54c37812442a802ab2d04306d37a', 'request_id': 'req-7bbcd0ae-6314-4739-8e23-2a0413855c10'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:32.290104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7bbcd0ae-6314-4739-8e23-2a0413855c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b86b54c37812442a802ab2d04306d37a', 'request_id': 'req-7bbcd0ae-6314-4739-8e23-2a0413855c10'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:32.297782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7bbcd0ae-6314-4739-8e23-2a0413855c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b86b54c37812442a802ab2d04306d37a', 'request_id': 'req-7bbcd0ae-6314-4739-8e23-2a0413855c10'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:32.393302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7bbcd0ae-6314-4739-8e23-2a0413855c10 admin admin] The token cache is being invalidate because project b86b54c37812442a802ab2d04306d37a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:32.393521 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7bbcd0ae-6314-4739-8e23-2a0413855c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:32.394277 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7bbcd0ae-6314-4739-8e23-2a0413855c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:32.395951 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 900/1809] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:32 2022] DELETE /identity/v3/projects/b86b54c37812442a802ab2d04306d37a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:32.400064 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6f65b-c3ff-429b-bb7f-a88c6ae4a193 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:32.401642 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-24e6f65b-c3ff-429b-bb7f-a88c6ae4a193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:32.417879 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6f65b-c3ff-429b-bb7f-a88c6ae4a193 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:32.444490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02255d0-d483-4192-9cc1-c6897df7e933 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:32.445160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02255d0-d483-4192-9cc1-c6897df7e933 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:32.445656 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02255d0-d483-4192-9cc1-c6897df7e933 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:32.448330 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 901/1810] 10.222.0.93 () {54 vars in 921 bytes} [Thu Jun 16 18:57:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:57:32.467349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fb9b7-8eb9-454a-a33e-d678986efa1a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:32.467349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fb9b7-8eb9-454a-a33e-d678986efa1a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:32.467349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fb9b7-8eb9-454a-a33e-d678986efa1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:32.497194 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-af5fb9b7-8eb9-454a-a33e-d678986efa1a None None] MFA Rules not processed for user `3503ec98bea14693a17a84e686586bad`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:32.501851 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-af5fb9b7-8eb9-454a-a33e-d678986efa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:32.517865 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3a829-19be-48ac-9a18-8706b11ede02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:32.520148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3a829-19be-48ac-9a18-8706b11ede02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:32.520802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3a829-19be-48ac-9a18-8706b11ede02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:32.524242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3a829-19be-48ac-9a18-8706b11ede02 admin admin] PATH_INFO: `/v3/users/b37a5fe09c4c4d40ba54c9545b1bc41f` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:32.526557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3a829-19be-48ac-9a18-8706b11ede02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b37a5fe09c4c4d40ba54c9545b1bc41f)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:32.531773 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3a829-19be-48ac-9a18-8706b11ede02 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:32.604258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 902/1811] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Jun 16 18:57:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:32.634116 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fb9b7-8eb9-454a-a33e-d678986efa1a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:32.636910 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-af5fb9b7-8eb9-454a-a33e-d678986efa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:32.673566 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fb9b7-8eb9-454a-a33e-d678986efa1a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:32.681756 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e608fb-2356-4b08-9a41-ab8894bbf6ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:32.682700 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e608fb-2356-4b08-9a41-ab8894bbf6ad service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:32.683514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e608fb-2356-4b08-9a41-ab8894bbf6ad service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:32.683932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e608fb-2356-4b08-9a41-ab8894bbf6ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:32.695738 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e608fb-2356-4b08-9a41-ab8894bbf6ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:32.702233 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e608fb-2356-4b08-9a41-ab8894bbf6ad service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:32.718386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 903/1812] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:57:32.842412 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f8e3a829-19be-48ac-9a18-8706b11ede02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b37a5fe09c4c4d40ba54c9545b1bc41f'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:32.845967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f8e3a829-19be-48ac-9a18-8706b11ede02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b37a5fe09c4c4d40ba54c9545b1bc41f'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:32.961584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f8e3a829-19be-48ac-9a18-8706b11ede02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b37a5fe09c4c4d40ba54c9545b1bc41f'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:32.978232 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f8e3a829-19be-48ac-9a18-8706b11ede02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b37a5fe09c4c4d40ba54c9545b1bc41f'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:32.979404 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f8e3a829-19be-48ac-9a18-8706b11ede02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b37a5fe09c4c4d40ba54c9545b1bc41f'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:33.066834 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 910/1813] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:32 2022] DELETE /identity/v3/users/b37a5fe09c4c4d40ba54c9545b1bc41f => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:33.498083 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e608fb-2356-4b08-9a41-ab8894bbf6ad service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:33.502228 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e9e608fb-2356-4b08-9a41-ab8894bbf6ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:33.525992 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e608fb-2356-4b08-9a41-ab8894bbf6ad service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:33.597057 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6bd07-24cd-4661-a3be-0ca59519c13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:33.597970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6bd07-24cd-4661-a3be-0ca59519c13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:33.598308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6bd07-24cd-4661-a3be-0ca59519c13f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:33.598594 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6bd07-24cd-4661-a3be-0ca59519c13f admin admin] PATH_INFO: `/v3/users/fd7bf1dedac2456e8d66d33f24559382` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:33.599906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6bd07-24cd-4661-a3be-0ca59519c13f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd7bf1dedac2456e8d66d33f24559382)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:33.602147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6bd07-24cd-4661-a3be-0ca59519c13f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:33.632870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3a829-19be-48ac-9a18-8706b11ede02 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:33.635658 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f8e3a829-19be-48ac-9a18-8706b11ede02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:33.644684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:33.672717 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3a829-19be-48ac-9a18-8706b11ede02 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:33.693233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a740a77-95bd-46be-b082-4c3ab16e96dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:33.694179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a740a77-95bd-46be-b082-4c3ab16e96dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:33.694660 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a740a77-95bd-46be-b082-4c3ab16e96dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:33.695043 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a740a77-95bd-46be-b082-4c3ab16e96dc admin admin] PATH_INFO: `/v3/projects/8e29025218bc4f57b2413582891c746f` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:33.696865 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a740a77-95bd-46be-b082-4c3ab16e96dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e29025218bc4f57b2413582891c746f)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:33.699308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a740a77-95bd-46be-b082-4c3ab16e96dc admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:33.756089 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:33.905024 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-3a740a77-95bd-46be-b082-4c3ab16e96dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e29025218bc4f57b2413582891c746f', 'request_id': 'req-3a740a77-95bd-46be-b082-4c3ab16e96dc'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:33.907151 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6fb6bd07-24cd-4661-a3be-0ca59519c13f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd7bf1dedac2456e8d66d33f24559382'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:33.908955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6fb6bd07-24cd-4661-a3be-0ca59519c13f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd7bf1dedac2456e8d66d33f24559382'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:34.026427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-3a740a77-95bd-46be-b082-4c3ab16e96dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e29025218bc4f57b2413582891c746f', 'request_id': 'req-3a740a77-95bd-46be-b082-4c3ab16e96dc'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:34.034363 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-3a740a77-95bd-46be-b082-4c3ab16e96dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e29025218bc4f57b2413582891c746f', 'request_id': 'req-3a740a77-95bd-46be-b082-4c3ab16e96dc'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:34.046324 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-3a740a77-95bd-46be-b082-4c3ab16e96dc admin admin] The token cache is being invalidate because project 8e29025218bc4f57b2413582891c746f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:34.046616 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-3a740a77-95bd-46be-b082-4c3ab16e96dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:34.047459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-3a740a77-95bd-46be-b082-4c3ab16e96dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:34.049144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 911/1814] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:33 2022] DELETE /identity/v3/projects/8e29025218bc4f57b2413582891c746f => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:34.060117 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999d5f8-b104-4714-abd7-d0040a1564d3 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:34.060765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999d5f8-b104-4714-abd7-d0040a1564d3 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:34.061213 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999d5f8-b104-4714-abd7-d0040a1564d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:34.097345 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-4999d5f8-b104-4714-abd7-d0040a1564d3 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:34.098952 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-4999d5f8-b104-4714-abd7-d0040a1564d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:34.135480 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6fb6bd07-24cd-4661-a3be-0ca59519c13f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd7bf1dedac2456e8d66d33f24559382'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:34.146022 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6fb6bd07-24cd-4661-a3be-0ca59519c13f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd7bf1dedac2456e8d66d33f24559382'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:34.181862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6fb6bd07-24cd-4661-a3be-0ca59519c13f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd7bf1dedac2456e8d66d33f24559382'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:34.182267 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 912/1815] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:57:34.192561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8581d5-893c-43e3-a0c6-811b8b87f76f None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:34.192865 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8581d5-893c-43e3-a0c6-811b8b87f76f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:34.193217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8581d5-893c-43e3-a0c6-811b8b87f76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:34.197476 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 904/1816] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:33 2022] DELETE /identity/v3/users/fd7bf1dedac2456e8d66d33f24559382 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:34.204689 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9069e9f-22f8-4b38-bcde-dfc4cb41f2d0 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:34.205133 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9069e9f-22f8-4b38-bcde-dfc4cb41f2d0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:34.206747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9069e9f-22f8-4b38-bcde-dfc4cb41f2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:34.222606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-dd8581d5-893c-43e3-a0c6-811b8b87f76f None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:34.224365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-dd8581d5-893c-43e3-a0c6-811b8b87f76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:34.285300 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b9069e9f-22f8-4b38-bcde-dfc4cb41f2d0 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:34.289621 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b9069e9f-22f8-4b38-bcde-dfc4cb41f2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:34.312289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 913/1817] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:34.313644 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8581d5-893c-43e3-a0c6-811b8b87f76f None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:34.335675 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8581d5-893c-43e3-a0c6-811b8b87f76f None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:34.352573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb619f16-da03-4fd2-ae9e-e9b2107a6c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:34.359518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb619f16-da03-4fd2-ae9e-e9b2107a6c6e admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:34.359518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb619f16-da03-4fd2-ae9e-e9b2107a6c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:34.359518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb619f16-da03-4fd2-ae9e-e9b2107a6c6e admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:34.359518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb619f16-da03-4fd2-ae9e-e9b2107a6c6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:57:34.359518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb619f16-da03-4fd2-ae9e-e9b2107a6c6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:34.360734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb619f16-da03-4fd2-ae9e-e9b2107a6c6e admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:34.392821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 914/1818] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:57:34.393442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 905/1819] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:34.399831 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb619f16-da03-4fd2-ae9e-e9b2107a6c6e admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:34.410157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9069e9f-22f8-4b38-bcde-dfc4cb41f2d0 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:34.410797 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb619f16-da03-4fd2-ae9e-e9b2107a6c6e admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:34.417620 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b9069e9f-22f8-4b38-bcde-dfc4cb41f2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:34.418295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac0335-4a4d-4724-b926-e11e12a2a675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:34.419272 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac0335-4a4d-4724-b926-e11e12a2a675 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:34.419738 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac0335-4a4d-4724-b926-e11e12a2a675 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:34.420226 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac0335-4a4d-4724-b926-e11e12a2a675 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:34.421222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac0335-4a4d-4724-b926-e11e12a2a675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:34.423654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac0335-4a4d-4724-b926-e11e12a2a675 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:34.567057 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9069e9f-22f8-4b38-bcde-dfc4cb41f2d0 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:34.572609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee5829-f9d1-483b-9fb2-57ebc7dc4500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:34.573682 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5829-f9d1-483b-9fb2-57ebc7dc4500 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:34.574292 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5829-f9d1-483b-9fb2-57ebc7dc4500 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:34.574718 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5829-f9d1-483b-9fb2-57ebc7dc4500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:34.586796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee5829-f9d1-483b-9fb2-57ebc7dc4500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:34.588367 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 915/1820] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:34 2022] POST /identity/v3/projects => generated 369 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:34.589165 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee5829-f9d1-483b-9fb2-57ebc7dc4500 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:34.592540 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac0335-4a4d-4724-b926-e11e12a2a675 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:34.603262 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 906/1821] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:34.694421 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac0335-4a4d-4724-b926-e11e12a2a675 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:34.704770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a6271-1e87-4b64-bd5c-9bd967269b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:34.706498 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a6271-1e87-4b64-bd5c-9bd967269b12 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:34.707118 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a6271-1e87-4b64-bd5c-9bd967269b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:34.707118 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a6271-1e87-4b64-bd5c-9bd967269b12 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:34.707950 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a6271-1e87-4b64-bd5c-9bd967269b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:34.710339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a6271-1e87-4b64-bd5c-9bd967269b12 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:34.866165 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 916/1822] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:34 2022] POST /identity/v3/users => generated 285 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:57:34.870015 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee5829-f9d1-483b-9fb2-57ebc7dc4500 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:34.882070 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee5829-f9d1-483b-9fb2-57ebc7dc4500 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:34.889384 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c22a6-653a-4626-bb1c-cfb81e452780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:34.890279 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c22a6-653a-4626-bb1c-cfb81e452780 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:34.890691 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c22a6-653a-4626-bb1c-cfb81e452780 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:34.891791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c22a6-653a-4626-bb1c-cfb81e452780 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:34.908648 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c22a6-653a-4626-bb1c-cfb81e452780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:34.908648 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c22a6-653a-4626-bb1c-cfb81e452780 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:34.931218 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 907/1823] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:34.935806 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a6271-1e87-4b64-bd5c-9bd967269b12 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:34.948897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a6271-1e87-4b64-bd5c-9bd967269b12 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:34.955440 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cde31-1ef8-4fd2-8d08-51669729d68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:34.956506 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cde31-1ef8-4fd2-8d08-51669729d68b admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:34.957177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cde31-1ef8-4fd2-8d08-51669729d68b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:34.957601 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cde31-1ef8-4fd2-8d08-51669729d68b admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:34.960394 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cde31-1ef8-4fd2-8d08-51669729d68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:34.962912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cde31-1ef8-4fd2-8d08-51669729d68b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:34.985976 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 917/1824] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:34.986340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c22a6-653a-4626-bb1c-cfb81e452780 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:35.004867 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c22a6-653a-4626-bb1c-cfb81e452780 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:35.012322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39412e34-2e33-4c55-96df-9845fe5e8ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:35.013642 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39412e34-2e33-4c55-96df-9845fe5e8ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:35.014129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39412e34-2e33-4c55-96df-9845fe5e8ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:35.014510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39412e34-2e33-4c55-96df-9845fe5e8ffc admin admin] PATH_INFO: `/v3/projects/d6e1c24c8e7741138591481e4ce25835/users/3a3c62345d604cd7961e7bc5c7bd9a83/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:35.049116 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39412e34-2e33-4c55-96df-9845fe5e8ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e1c24c8e7741138591481e4ce25835, user_id=3a3c62345d604cd7961e7bc5c7bd9a83, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:35.054414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39412e34-2e33-4c55-96df-9845fe5e8ffc admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:35.204173 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 908/1825] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:34 2022] PUT /identity/v3/projects/d6e1c24c8e7741138591481e4ce25835/users/3a3c62345d604cd7961e7bc5c7bd9a83/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:57:35.223377 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7e48a-2f55-4b1b-ab60-414c674adcf1 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:35.223981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7e48a-2f55-4b1b-ab60-414c674adcf1 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:35.224594 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7e48a-2f55-4b1b-ab60-414c674adcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:35.267808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-b6e7e48a-2f55-4b1b-ab60-414c674adcf1 None None] MFA Rules not processed for user `3a3c62345d604cd7961e7bc5c7bd9a83`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:35.270762 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b6e7e48a-2f55-4b1b-ab60-414c674adcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:35.339581 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:35.340416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39412e34-2e33-4c55-96df-9845fe5e8ffc admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:35.343237 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-39412e34-2e33-4c55-96df-9845fe5e8ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:35.375695 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 918/1826] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:35.376223 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7e48a-2f55-4b1b-ab60-414c674adcf1 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:35.473966 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7e48a-2f55-4b1b-ab60-414c674adcf1 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:35.480416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f22414-b36d-4217-9032-17878ff41723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:35.482211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f22414-b36d-4217-9032-17878ff41723 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:35.482211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f22414-b36d-4217-9032-17878ff41723 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:35.483386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f22414-b36d-4217-9032-17878ff41723 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:35.485424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f22414-b36d-4217-9032-17878ff41723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:35.492131 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f22414-b36d-4217-9032-17878ff41723 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:35.516429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39412e34-2e33-4c55-96df-9845fe5e8ffc admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:35.522776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5678b3-084a-4567-b589-610227dbf2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:35.523855 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5678b3-084a-4567-b589-610227dbf2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:35.524210 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5678b3-084a-4567-b589-610227dbf2af admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:35.524694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5678b3-084a-4567-b589-610227dbf2af admin admin] PATH_INFO: `/v3/projects/5614678875d145fea1d26f6fe54bb4a2` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:35.526063 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5678b3-084a-4567-b589-610227dbf2af admin admin] RBAC: Authorizing `identity:delete_project(project_id=5614678875d145fea1d26f6fe54bb4a2)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:35.528134 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5678b3-084a-4567-b589-610227dbf2af admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:35.706451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 919/1827] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:35 2022] POST /identity/v3/projects => generated 369 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:35.711651 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f22414-b36d-4217-9032-17878ff41723 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:35.733813 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-1d5678b3-084a-4567-b589-610227dbf2af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5614678875d145fea1d26f6fe54bb4a2', 'request_id': 'req-1d5678b3-084a-4567-b589-610227dbf2af'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:35.739657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-1d5678b3-084a-4567-b589-610227dbf2af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5614678875d145fea1d26f6fe54bb4a2', 'request_id': 'req-1d5678b3-084a-4567-b589-610227dbf2af'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:35.751891 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-1d5678b3-084a-4567-b589-610227dbf2af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5614678875d145fea1d26f6fe54bb4a2', 'request_id': 'req-1d5678b3-084a-4567-b589-610227dbf2af'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:35.787144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f22414-b36d-4217-9032-17878ff41723 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:35.791850 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa929f-859c-4957-8a18-e89c4faa9f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:35.792559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa929f-859c-4957-8a18-e89c4faa9f06 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:35.792853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa929f-859c-4957-8a18-e89c4faa9f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:35.793137 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa929f-859c-4957-8a18-e89c4faa9f06 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:35.793893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa929f-859c-4957-8a18-e89c4faa9f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:35.795829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa929f-859c-4957-8a18-e89c4faa9f06 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:35.856167 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-1d5678b3-084a-4567-b589-610227dbf2af admin admin] The token cache is being invalidate because project 5614678875d145fea1d26f6fe54bb4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:35.856628 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-1d5678b3-084a-4567-b589-610227dbf2af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:35.857377 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-1d5678b3-084a-4567-b589-610227dbf2af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:35.859442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 909/1828] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:35 2022] DELETE /identity/v3/projects/5614678875d145fea1d26f6fe54bb4a2 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:35.863448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5678b3-084a-4567-b589-610227dbf2af admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:35.866326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1d5678b3-084a-4567-b589-610227dbf2af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:35.923602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 920/1829] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:35 2022] POST /identity/v3/users => generated 291 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:35.931329 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa929f-859c-4957-8a18-e89c4faa9f06 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:35.933157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-01aa929f-859c-4957-8a18-e89c4faa9f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:35.958303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa929f-859c-4957-8a18-e89c4faa9f06 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:35.970551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ad7f2-7951-47f9-aa50-731a73e5222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:35.971696 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ad7f2-7951-47f9-aa50-731a73e5222b admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:35.972344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ad7f2-7951-47f9-aa50-731a73e5222b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:35.972794 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ad7f2-7951-47f9-aa50-731a73e5222b admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:35.973742 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ad7f2-7951-47f9-aa50-731a73e5222b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:35.977943 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ad7f2-7951-47f9-aa50-731a73e5222b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:36.006664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 921/1830] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:36.007862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ad7f2-7951-47f9-aa50-731a73e5222b admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:36.023018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ad7f2-7951-47f9-aa50-731a73e5222b admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:36.030490 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ded0c-1c79-48e9-b7d4-eeb1a352c70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:36.031476 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ded0c-1c79-48e9-b7d4-eeb1a352c70e admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:36.031933 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ded0c-1c79-48e9-b7d4-eeb1a352c70e admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:36.032219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ded0c-1c79-48e9-b7d4-eeb1a352c70e admin admin] PATH_INFO: `/v3/projects/d7c060fa10c7403d9e168e4fad0c697e/users/fb0d431099ff4d9895f2825b00bace00/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:36.053138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ded0c-1c79-48e9-b7d4-eeb1a352c70e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c060fa10c7403d9e168e4fad0c697e, user_id=fb0d431099ff4d9895f2825b00bace00, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:36.055950 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ded0c-1c79-48e9-b7d4-eeb1a352c70e admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:36.168699 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 922/1831] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:36 2022] PUT /identity/v3/projects/d7c060fa10c7403d9e168e4fad0c697e/users/fb0d431099ff4d9895f2825b00bace00/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:36.173570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ded0c-1c79-48e9-b7d4-eeb1a352c70e admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:36.192412 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:36.206278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5678b3-084a-4567-b589-610227dbf2af admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:36.302157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:36.318344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ded0c-1c79-48e9-b7d4-eeb1a352c70e admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:36.322926 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e3c6d-c8dd-4fd4-a638-774924f2f6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:36.323227 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf043770-b101-4e71-80d3-fc39ebf03ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:36.323947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf043770-b101-4e71-80d3-fc39ebf03ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:36.324056 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e3c6d-c8dd-4fd4-a638-774924f2f6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:36.324233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf043770-b101-4e71-80d3-fc39ebf03ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:36.324328 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e3c6d-c8dd-4fd4-a638-774924f2f6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:36.324552 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf043770-b101-4e71-80d3-fc39ebf03ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:36.325424 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e3c6d-c8dd-4fd4-a638-774924f2f6d4 admin admin] PATH_INFO: `/v3/users/c4d63a477e084a139df2986339d55d8b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:36.325854 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf043770-b101-4e71-80d3-fc39ebf03ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:36.326430 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e3c6d-c8dd-4fd4-a638-774924f2f6d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d63a477e084a139df2986339d55d8b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:36.327486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf043770-b101-4e71-80d3-fc39ebf03ac1 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:36.336534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e3c6d-c8dd-4fd4-a638-774924f2f6d4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:36.344603 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 923/1832] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:36.345989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf043770-b101-4e71-80d3-fc39ebf03ac1 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:36.357624 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf043770-b101-4e71-80d3-fc39ebf03ac1 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:36.371229 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753068d-6d16-45e6-aedf-62f26659da8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:36.377298 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753068d-6d16-45e6-aedf-62f26659da8d admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:36.381022 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753068d-6d16-45e6-aedf-62f26659da8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:36.381539 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753068d-6d16-45e6-aedf-62f26659da8d admin admin] PATH_INFO: `/v3/projects/d7c060fa10c7403d9e168e4fad0c697e/users/fb0d431099ff4d9895f2825b00bace00/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:36.385034 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753068d-6d16-45e6-aedf-62f26659da8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c060fa10c7403d9e168e4fad0c697e, user_id=fb0d431099ff4d9895f2825b00bace00, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:36.389143 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753068d-6d16-45e6-aedf-62f26659da8d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:36.403915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 924/1833] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:36 2022] PUT /identity/v3/projects/d7c060fa10c7403d9e168e4fad0c697e/users/fb0d431099ff4d9895f2825b00bace00/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:57:36.414505 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c80f1-83bf-49c6-99b3-4bd3b9309681 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:36.414796 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c80f1-83bf-49c6-99b3-4bd3b9309681 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:36.415080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c80f1-83bf-49c6-99b3-4bd3b9309681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:36.450791 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-343c80f1-83bf-49c6-99b3-4bd3b9309681 None None] MFA Rules not processed for user `fb0d431099ff4d9895f2825b00bace00`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:36.452045 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-343c80f1-83bf-49c6-99b3-4bd3b9309681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:36.545813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 925/1834] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:36 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:57:36.565761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c80f1-83bf-49c6-99b3-4bd3b9309681 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:36.565761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-343c80f1-83bf-49c6-99b3-4bd3b9309681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:36.617434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c80f1-83bf-49c6-99b3-4bd3b9309681 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:36.620993 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab098d-88dc-48af-9c08-7e02c855c2a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:36.621651 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab098d-88dc-48af-9c08-7e02c855c2a6 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:36.621946 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab098d-88dc-48af-9c08-7e02c855c2a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:36.622212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab098d-88dc-48af-9c08-7e02c855c2a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:36.632038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab098d-88dc-48af-9c08-7e02c855c2a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:36.633878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab098d-88dc-48af-9c08-7e02c855c2a6 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:36.638597 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-867e3c6d-c8dd-4fd4-a638-774924f2f6d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d63a477e084a139df2986339d55d8b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:36.639260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-867e3c6d-c8dd-4fd4-a638-774924f2f6d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d63a477e084a139df2986339d55d8b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:36.644612 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 926/1835] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:36 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:57:36.723665 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-867e3c6d-c8dd-4fd4-a638-774924f2f6d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d63a477e084a139df2986339d55d8b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:36.731860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-867e3c6d-c8dd-4fd4-a638-774924f2f6d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d63a477e084a139df2986339d55d8b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:36.745136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-867e3c6d-c8dd-4fd4-a638-774924f2f6d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d63a477e084a139df2986339d55d8b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:36.752052 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 910/1836] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:35 2022] DELETE /identity/v3/users/c4d63a477e084a139df2986339d55d8b => generated 0 bytes in 889 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:37.419845 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab098d-88dc-48af-9c08-7e02c855c2a6 service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:37.485745 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab098d-88dc-48af-9c08-7e02c855c2a6 service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:37.576253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6b1c2-2b37-49f7-a40e-4caabee393b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:37.577963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6b1c2-2b37-49f7-a40e-4caabee393b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:37.578458 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6b1c2-2b37-49f7-a40e-4caabee393b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:37.578807 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6b1c2-2b37-49f7-a40e-4caabee393b8 admin admin] PATH_INFO: `/v3/projects/441b706d366b48d38f6e1669c9270259` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:37.580295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6b1c2-2b37-49f7-a40e-4caabee393b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=441b706d366b48d38f6e1669c9270259)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:37.582752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6b1c2-2b37-49f7-a40e-4caabee393b8 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:37.756202 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-8ed6b1c2-2b37-49f7-a40e-4caabee393b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '441b706d366b48d38f6e1669c9270259', 'request_id': 'req-8ed6b1c2-2b37-49f7-a40e-4caabee393b8'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:37.872630 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-8ed6b1c2-2b37-49f7-a40e-4caabee393b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '441b706d366b48d38f6e1669c9270259', 'request_id': 'req-8ed6b1c2-2b37-49f7-a40e-4caabee393b8'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:37.880330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-8ed6b1c2-2b37-49f7-a40e-4caabee393b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '441b706d366b48d38f6e1669c9270259', 'request_id': 'req-8ed6b1c2-2b37-49f7-a40e-4caabee393b8'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:37.892146 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-8ed6b1c2-2b37-49f7-a40e-4caabee393b8 admin admin] The token cache is being invalidate because project 441b706d366b48d38f6e1669c9270259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:37.892577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-8ed6b1c2-2b37-49f7-a40e-4caabee393b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:37.893369 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-8ed6b1c2-2b37-49f7-a40e-4caabee393b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:37.894992 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 927/1837] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:37 2022] DELETE /identity/v3/projects/441b706d366b48d38f6e1669c9270259 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:37.900062 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f71dc-b8da-4397-86f5-5a6165325163 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:37.901163 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f71dc-b8da-4397-86f5-5a6165325163 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:37.906062 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f71dc-b8da-4397-86f5-5a6165325163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:37.929583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b78f71dc-b8da-4397-86f5-5a6165325163 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:37.930967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b78f71dc-b8da-4397-86f5-5a6165325163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:38.056861 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 911/1838] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:38.069586 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5ec20-d800-496a-a0bd-7b981da3a549 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:38.070003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5ec20-d800-496a-a0bd-7b981da3a549 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:38.077414 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5ec20-d800-496a-a0bd-7b981da3a549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:38.117929 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-e8b5ec20-d800-496a-a0bd-7b981da3a549 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:38.117929 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-e8b5ec20-d800-496a-a0bd-7b981da3a549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:38.140873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 928/1839] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:38.143767 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f71dc-b8da-4397-86f5-5a6165325163 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:38.161103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f71dc-b8da-4397-86f5-5a6165325163 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:38.176151 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9ce05-5cad-42b8-8a20-3613bcd5f61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:38.177116 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9ce05-5cad-42b8-8a20-3613bcd5f61f admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:38.179255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9ce05-5cad-42b8-8a20-3613bcd5f61f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:38.179575 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9ce05-5cad-42b8-8a20-3613bcd5f61f admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:38.181494 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9ce05-5cad-42b8-8a20-3613bcd5f61f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:57:38.181815 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9ce05-5cad-42b8-8a20-3613bcd5f61f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:38.185595 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9ce05-5cad-42b8-8a20-3613bcd5f61f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:38.214808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 912/1840] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:57:38.219227 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5ec20-d800-496a-a0bd-7b981da3a549 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:38.229439 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5ec20-d800-496a-a0bd-7b981da3a549 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:38.235135 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3cef2-4a81-4ec1-b51a-43c47c914b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:38.236043 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3cef2-4a81-4ec1-b51a-43c47c914b43 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:38.236376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3cef2-4a81-4ec1-b51a-43c47c914b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:38.236691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3cef2-4a81-4ec1-b51a-43c47c914b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:38.237390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3cef2-4a81-4ec1-b51a-43c47c914b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:38.239291 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3cef2-4a81-4ec1-b51a-43c47c914b43 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:38.363901 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 929/1841] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:38 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:38.365126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9ce05-5cad-42b8-8a20-3613bcd5f61f admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:38.385529 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9ce05-5cad-42b8-8a20-3613bcd5f61f admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:38.502752 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c88e6c-f3d8-41d8-9f56-87140c0f466f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:38.503712 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c88e6c-f3d8-41d8-9f56-87140c0f466f admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:38.504145 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c88e6c-f3d8-41d8-9f56-87140c0f466f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:38.505159 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c88e6c-f3d8-41d8-9f56-87140c0f466f admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:38.506908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c88e6c-f3d8-41d8-9f56-87140c0f466f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:38.510098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c88e6c-f3d8-41d8-9f56-87140c0f466f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:38.625411 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 913/1842] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:38 2022] POST /identity/v3/users => generated 291 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:57:38.629869 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3cef2-4a81-4ec1-b51a-43c47c914b43 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:38.640652 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3cef2-4a81-4ec1-b51a-43c47c914b43 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:38.648100 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143a555-68eb-42d9-bf5f-02567d0278fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:38.648100 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143a555-68eb-42d9-bf5f-02567d0278fb admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:38.648405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143a555-68eb-42d9-bf5f-02567d0278fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:38.648727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143a555-68eb-42d9-bf5f-02567d0278fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:38.649515 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143a555-68eb-42d9-bf5f-02567d0278fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:38.651264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143a555-68eb-42d9-bf5f-02567d0278fb admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:38.665180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 930/1843] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:38.672929 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c88e6c-f3d8-41d8-9f56-87140c0f466f admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:38.685238 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c88e6c-f3d8-41d8-9f56-87140c0f466f admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:38.691818 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f01541-9b50-4a42-bc60-4cf31e736738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:38.693491 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f01541-9b50-4a42-bc60-4cf31e736738 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:38.693922 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f01541-9b50-4a42-bc60-4cf31e736738 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:38.704364 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f01541-9b50-4a42-bc60-4cf31e736738 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:38.704364 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f01541-9b50-4a42-bc60-4cf31e736738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:38.704364 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f01541-9b50-4a42-bc60-4cf31e736738 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:38.716856 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 914/1844] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:38.721004 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143a555-68eb-42d9-bf5f-02567d0278fb admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:38.734264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143a555-68eb-42d9-bf5f-02567d0278fb admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:38.752987 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e2ccb-037e-485f-950e-a07df0d8c181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:38.754052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e2ccb-037e-485f-950e-a07df0d8c181 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:38.754359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e2ccb-037e-485f-950e-a07df0d8c181 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:38.754641 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e2ccb-037e-485f-950e-a07df0d8c181 admin admin] PATH_INFO: `/v3/projects/30d8e17e23c645f7983484115351863c/users/36e2f5969aba44598ada648514c60523/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:38.773132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e2ccb-037e-485f-950e-a07df0d8c181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d8e17e23c645f7983484115351863c, user_id=36e2f5969aba44598ada648514c60523, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:38.775902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e2ccb-037e-485f-950e-a07df0d8c181 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:38.833475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:38.839734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 931/1845] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:38 2022] PUT /identity/v3/projects/30d8e17e23c645f7983484115351863c/users/36e2f5969aba44598ada648514c60523/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:38.851531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a9616-355e-491d-b8dd-1a0e5e73f720 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:38.851826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a9616-355e-491d-b8dd-1a0e5e73f720 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:38.852111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a9616-355e-491d-b8dd-1a0e5e73f720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:38.889358 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4d9a9616-355e-491d-b8dd-1a0e5e73f720 None None] MFA Rules not processed for user `36e2f5969aba44598ada648514c60523`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:38.890697 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4d9a9616-355e-491d-b8dd-1a0e5e73f720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:39.011605 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 915/1846] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:39.016192 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e2ccb-037e-485f-950e-a07df0d8c181 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:39.101875 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e2ccb-037e-485f-950e-a07df0d8c181 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:39.107541 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1f568-60ce-4938-af5e-cd0c336ff520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:39.108278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1f568-60ce-4938-af5e-cd0c336ff520 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:39.108654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1f568-60ce-4938-af5e-cd0c336ff520 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:39.109003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1f568-60ce-4938-af5e-cd0c336ff520 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:39.109805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1f568-60ce-4938-af5e-cd0c336ff520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:39.111800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1f568-60ce-4938-af5e-cd0c336ff520 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:39.241071 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 932/1847] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:39 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:57:39.242133 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a9616-355e-491d-b8dd-1a0e5e73f720 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:39.257118 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a9616-355e-491d-b8dd-1a0e5e73f720 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:39.328193 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c415c-556b-44b4-a304-809989a02a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:39.328856 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c415c-556b-44b4-a304-809989a02a0d admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:39.329144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c415c-556b-44b4-a304-809989a02a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:39.329426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c415c-556b-44b4-a304-809989a02a0d admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:39.330122 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c415c-556b-44b4-a304-809989a02a0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:39.332030 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c415c-556b-44b4-a304-809989a02a0d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:39.485152 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 916/1848] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:39 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:39.486800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1f568-60ce-4938-af5e-cd0c336ff520 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:39.513914 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1f568-60ce-4938-af5e-cd0c336ff520 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:39.519410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce404c1f-c89f-4912-aabd-9d46b9c9fa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:39.520094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce404c1f-c89f-4912-aabd-9d46b9c9fa75 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:39.520385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce404c1f-c89f-4912-aabd-9d46b9c9fa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:39.520733 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce404c1f-c89f-4912-aabd-9d46b9c9fa75 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:39.521737 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce404c1f-c89f-4912-aabd-9d46b9c9fa75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:39.523374 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce404c1f-c89f-4912-aabd-9d46b9c9fa75 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:39.546461 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 933/1849] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:39.548297 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c415c-556b-44b4-a304-809989a02a0d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:39.570070 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c415c-556b-44b4-a304-809989a02a0d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:39.595419 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3e14f-3ce7-49cb-ab0e-b2920ced5a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:39.597858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3e14f-3ce7-49cb-ab0e-b2920ced5a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:39.598547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3e14f-3ce7-49cb-ab0e-b2920ced5a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:39.599543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3e14f-3ce7-49cb-ab0e-b2920ced5a3c admin admin] PATH_INFO: `/v3/projects/56cc39ef500b456d9f7f8a3e6ab83eb3/users/d7c71b530e014b3890c62da51b34924f/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:39.625841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3e14f-3ce7-49cb-ab0e-b2920ced5a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cc39ef500b456d9f7f8a3e6ab83eb3, user_id=d7c71b530e014b3890c62da51b34924f, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:39.628908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3e14f-3ce7-49cb-ab0e-b2920ced5a3c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:39.761499 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 917/1850] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:39 2022] PUT /identity/v3/projects/56cc39ef500b456d9f7f8a3e6ab83eb3/users/d7c71b530e014b3890c62da51b34924f/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:39.766713 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce404c1f-c89f-4912-aabd-9d46b9c9fa75 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:39.777846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce404c1f-c89f-4912-aabd-9d46b9c9fa75 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:39.850715 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159599e-fa1a-4c8f-9ea7-8843528b16d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:39.851421 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159599e-fa1a-4c8f-9ea7-8843528b16d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:39.851915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159599e-fa1a-4c8f-9ea7-8843528b16d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:39.852201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159599e-fa1a-4c8f-9ea7-8843528b16d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:39.853154 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159599e-fa1a-4c8f-9ea7-8843528b16d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:39.854838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159599e-fa1a-4c8f-9ea7-8843528b16d4 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:39.869368 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 934/1851] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:39.870661 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3e14f-3ce7-49cb-ab0e-b2920ced5a3c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:39.882589 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3e14f-3ce7-49cb-ab0e-b2920ced5a3c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:39.888425 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca007e-586d-430c-b85f-08c3a198fdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:39.889347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca007e-586d-430c-b85f-08c3a198fdb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:39.889631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca007e-586d-430c-b85f-08c3a198fdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:39.889906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca007e-586d-430c-b85f-08c3a198fdb5 admin admin] PATH_INFO: `/v3/projects/56cc39ef500b456d9f7f8a3e6ab83eb3/users/d7c71b530e014b3890c62da51b34924f/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:39.891995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca007e-586d-430c-b85f-08c3a198fdb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cc39ef500b456d9f7f8a3e6ab83eb3, user_id=d7c71b530e014b3890c62da51b34924f, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:39.894801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca007e-586d-430c-b85f-08c3a198fdb5 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:39.909917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 918/1852] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:39 2022] PUT /identity/v3/projects/56cc39ef500b456d9f7f8a3e6ab83eb3/users/d7c71b530e014b3890c62da51b34924f/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:39.921368 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab7a1a-112b-4002-a06b-90864d0ae473 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:39.921651 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab7a1a-112b-4002-a06b-90864d0ae473 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:39.922112 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab7a1a-112b-4002-a06b-90864d0ae473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:39.955602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-3cab7a1a-112b-4002-a06b-90864d0ae473 None None] MFA Rules not processed for user `d7c71b530e014b3890c62da51b34924f`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:39.956877 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-3cab7a1a-112b-4002-a06b-90864d0ae473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:40.027670 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 935/1853] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:40.197543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:40.245149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca007e-586d-430c-b85f-08c3a198fdb5 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:40.247619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-84ca007e-586d-430c-b85f-08c3a198fdb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:40.353997 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca007e-586d-430c-b85f-08c3a198fdb5 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:40.365321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8988a2d-7fd5-4781-a793-3e11c34e65b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:40.366198 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8988a2d-7fd5-4781-a793-3e11c34e65b1 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:40.366560 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8988a2d-7fd5-4781-a793-3e11c34e65b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:40.366924 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8988a2d-7fd5-4781-a793-3e11c34e65b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:40.377617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8988a2d-7fd5-4781-a793-3e11c34e65b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:40.386444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8988a2d-7fd5-4781-a793-3e11c34e65b1 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:40.397397 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 919/1854] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:41.586339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab7a1a-112b-4002-a06b-90864d0ae473 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:41.588270 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-3cab7a1a-112b-4002-a06b-90864d0ae473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:41.634894 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8988a2d-7fd5-4781-a793-3e11c34e65b1 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:41.644623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8988a2d-7fd5-4781-a793-3e11c34e65b1 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:41.649991 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee25a5-e980-4ad4-a624-b0186c787f90 tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c71b530e014b3890c62da51b34924f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56cc39ef500b456d9f7f8a3e6ab83eb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:41.650654 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee25a5-e980-4ad4-a624-b0186c787f90 tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:41.650937 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee25a5-e980-4ad4-a624-b0186c787f90 tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:41.651217 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee25a5-e980-4ad4-a624-b0186c787f90 tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:41.651968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee25a5-e980-4ad4-a624-b0186c787f90 tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:57:41.652283 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee25a5-e980-4ad4-a624-b0186c787f90 tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:41.663666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee25a5-e980-4ad4-a624-b0186c787f90 tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:41.676528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab7a1a-112b-4002-a06b-90864d0ae473 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:41.682362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884437bc-4c09-423c-8344-b9e68087ef5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:41.683449 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 920/1855] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:57:41.686768 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884437bc-4c09-423c-8344-b9e68087ef5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:41.687386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884437bc-4c09-423c-8344-b9e68087ef5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:41.687826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884437bc-4c09-423c-8344-b9e68087ef5a admin admin] PATH_INFO: `/v3/users/3a3c62345d604cd7961e7bc5c7bd9a83` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:41.689433 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884437bc-4c09-423c-8344-b9e68087ef5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a3c62345d604cd7961e7bc5c7bd9a83)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:41.691710 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884437bc-4c09-423c-8344-b9e68087ef5a admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:41.699435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee25a5-e980-4ad4-a624-b0186c787f90 tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:41.717842 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee25a5-e980-4ad4-a624-b0186c787f90 tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:41.724303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ba206-3609-49a1-a8aa-2310d095209a tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c71b530e014b3890c62da51b34924f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56cc39ef500b456d9f7f8a3e6ab83eb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:41.725259 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ba206-3609-49a1-a8aa-2310d095209a tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:41.727105 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ba206-3609-49a1-a8aa-2310d095209a tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:41.727105 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ba206-3609-49a1-a8aa-2310d095209a tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:41.727387 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ba206-3609-49a1-a8aa-2310d095209a tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:41.729669 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ba206-3609-49a1-a8aa-2310d095209a tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:41.810699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 921/1856] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:41 2022] POST /identity/v3/projects => generated 355 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:41.814352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ba206-3609-49a1-a8aa-2310d095209a tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:41.876510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ba206-3609-49a1-a8aa-2310d095209a tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:41.881606 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8185f-b9a8-457a-afc9-ba2f078afaa6 tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c71b530e014b3890c62da51b34924f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56cc39ef500b456d9f7f8a3e6ab83eb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:41.882274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8185f-b9a8-457a-afc9-ba2f078afaa6 tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:41.882573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8185f-b9a8-457a-afc9-ba2f078afaa6 tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:41.882861 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8185f-b9a8-457a-afc9-ba2f078afaa6 tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:41.884267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8185f-b9a8-457a-afc9-ba2f078afaa6 tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:57:41.884652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8185f-b9a8-457a-afc9-ba2f078afaa6 tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:41.886273 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8185f-b9a8-457a-afc9-ba2f078afaa6 tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:41.894032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-884437bc-4c09-423c-8344-b9e68087ef5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a3c62345d604cd7961e7bc5c7bd9a83'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:41.894687 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-884437bc-4c09-423c-8344-b9e68087ef5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a3c62345d604cd7961e7bc5c7bd9a83'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:41.898654 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 922/1857] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:57:41.942246 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8185f-b9a8-457a-afc9-ba2f078afaa6 tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:41.945436 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d1f8185f-b9a8-457a-afc9-ba2f078afaa6 tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:41.958101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8185f-b9a8-457a-afc9-ba2f078afaa6 tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:41.960919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-884437bc-4c09-423c-8344-b9e68087ef5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a3c62345d604cd7961e7bc5c7bd9a83'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:41.965574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8958b-1f08-4710-879c-570681281bfd tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c71b530e014b3890c62da51b34924f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56cc39ef500b456d9f7f8a3e6ab83eb3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:41.966453 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8958b-1f08-4710-879c-570681281bfd tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:41.966740 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8958b-1f08-4710-879c-570681281bfd tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:41.968425 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8958b-1f08-4710-879c-570681281bfd tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] PATH_INFO: `/v3/projects/2acd72cb4ddb4684860b45feef96c2ae` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:41.969494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-884437bc-4c09-423c-8344-b9e68087ef5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a3c62345d604cd7961e7bc5c7bd9a83'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:41.970173 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-884437bc-4c09-423c-8344-b9e68087ef5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a3c62345d604cd7961e7bc5c7bd9a83'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:41.973070 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8958b-1f08-4710-879c-570681281bfd tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2acd72cb4ddb4684860b45feef96c2ae)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:41.975359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8958b-1f08-4710-879c-570681281bfd tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:41.988204 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 936/1858] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:41 2022] DELETE /identity/v3/users/3a3c62345d604cd7961e7bc5c7bd9a83 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:41.993116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01efa2-7360-41d0-8748-6cf9c55402cf None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:41.993401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01efa2-7360-41d0-8748-6cf9c55402cf None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:41.993775 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01efa2-7360-41d0-8748-6cf9c55402cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:42.014268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-cf01efa2-7360-41d0-8748-6cf9c55402cf None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:42.015659 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-cf01efa2-7360-41d0-8748-6cf9c55402cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:42.081255 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 937/1859] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:57:42.090712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01efa2-7360-41d0-8748-6cf9c55402cf None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:42.092271 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fba8958b-1f08-4710-879c-570681281bfd tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2acd72cb4ddb4684860b45feef96c2ae', 'request_id': 'req-fba8958b-1f08-4710-879c-570681281bfd'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:42.093445 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-cf01efa2-7360-41d0-8748-6cf9c55402cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:42.097864 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fba8958b-1f08-4710-879c-570681281bfd tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2acd72cb4ddb4684860b45feef96c2ae', 'request_id': 'req-fba8958b-1f08-4710-879c-570681281bfd'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:42.108091 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fba8958b-1f08-4710-879c-570681281bfd tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2acd72cb4ddb4684860b45feef96c2ae', 'request_id': 'req-fba8958b-1f08-4710-879c-570681281bfd'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:42.175352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fba8958b-1f08-4710-879c-570681281bfd tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] The token cache is being invalidate because project 2acd72cb4ddb4684860b45feef96c2ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:42.175652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fba8958b-1f08-4710-879c-570681281bfd tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:42.176314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fba8958b-1f08-4710-879c-570681281bfd tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:42.181222 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 923/1860] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:41 2022] DELETE /identity/v3/projects/2acd72cb4ddb4684860b45feef96c2ae => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:57:42.191656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01efa2-7360-41d0-8748-6cf9c55402cf None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:42.253619 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e082ea-4000-4ed0-885b-bdef79d58282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:42.256113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e082ea-4000-4ed0-885b-bdef79d58282 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:42.256595 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e082ea-4000-4ed0-885b-bdef79d58282 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:42.256880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e082ea-4000-4ed0-885b-bdef79d58282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:42.265177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-e5e082ea-4000-4ed0-885b-bdef79d58282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:42.353969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e082ea-4000-4ed0-885b-bdef79d58282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:42.359035 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e082ea-4000-4ed0-885b-bdef79d58282 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:42.374321 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 938/1861] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:57:42.942180 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8958b-1f08-4710-879c-570681281bfd tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:42.944709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fba8958b-1f08-4710-879c-570681281bfd tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:42.971547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8958b-1f08-4710-879c-570681281bfd tempest-VolumeQuotaClassesTest-1719587531 tempest-VolumeQuotaClassesTest-1719587531-project-admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:42.978625 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a096f-8f6c-44e0-8298-38d7d77c0338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:42.979899 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a096f-8f6c-44e0-8298-38d7d77c0338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:42.980574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a096f-8f6c-44e0-8298-38d7d77c0338 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:42.981124 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a096f-8f6c-44e0-8298-38d7d77c0338 admin admin] PATH_INFO: `/v3/projects/d6e1c24c8e7741138591481e4ce25835` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:42.982543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a096f-8f6c-44e0-8298-38d7d77c0338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6e1c24c8e7741138591481e4ce25835)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:42.984931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a096f-8f6c-44e0-8298-38d7d77c0338 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:43.167453 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-eb5a096f-8f6c-44e0-8298-38d7d77c0338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6e1c24c8e7741138591481e4ce25835', 'request_id': 'req-eb5a096f-8f6c-44e0-8298-38d7d77c0338'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:43.174043 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-eb5a096f-8f6c-44e0-8298-38d7d77c0338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6e1c24c8e7741138591481e4ce25835', 'request_id': 'req-eb5a096f-8f6c-44e0-8298-38d7d77c0338'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:43.183219 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-eb5a096f-8f6c-44e0-8298-38d7d77c0338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6e1c24c8e7741138591481e4ce25835', 'request_id': 'req-eb5a096f-8f6c-44e0-8298-38d7d77c0338'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:43.186113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e082ea-4000-4ed0-885b-bdef79d58282 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:43.187718 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-e5e082ea-4000-4ed0-885b-bdef79d58282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:43.201829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e082ea-4000-4ed0-885b-bdef79d58282 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:43.259307 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cffdb-a893-4dee-8f66-de4f5b60d63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:43.260264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cffdb-a893-4dee-8f66-de4f5b60d63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:43.260667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cffdb-a893-4dee-8f66-de4f5b60d63c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:43.261010 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cffdb-a893-4dee-8f66-de4f5b60d63c admin admin] PATH_INFO: `/v3/users/36e2f5969aba44598ada648514c60523` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:43.262842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cffdb-a893-4dee-8f66-de4f5b60d63c admin admin] RBAC: Authorizing `identity:delete_user(user_id=36e2f5969aba44598ada648514c60523)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:43.264897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cffdb-a893-4dee-8f66-de4f5b60d63c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:43.287158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-eb5a096f-8f6c-44e0-8298-38d7d77c0338 admin admin] The token cache is being invalidate because project d6e1c24c8e7741138591481e4ce25835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:43.287694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-eb5a096f-8f6c-44e0-8298-38d7d77c0338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:43.288770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-eb5a096f-8f6c-44e0-8298-38d7d77c0338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:43.290922 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 924/1862] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:42 2022] DELETE /identity/v3/projects/d6e1c24c8e7741138591481e4ce25835 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:43.295246 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a096f-8f6c-44e0-8298-38d7d77c0338 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:43.296696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-eb5a096f-8f6c-44e0-8298-38d7d77c0338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:43.309939 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a096f-8f6c-44e0-8298-38d7d77c0338 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:43.316330 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf315e58-2045-4bad-913a-e2ad5e58f285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:43.317275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf315e58-2045-4bad-913a-e2ad5e58f285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:43.317565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf315e58-2045-4bad-913a-e2ad5e58f285 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:43.317861 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf315e58-2045-4bad-913a-e2ad5e58f285 admin admin] PATH_INFO: `/v3/users/fb0d431099ff4d9895f2825b00bace00` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:43.319242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf315e58-2045-4bad-913a-e2ad5e58f285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb0d431099ff4d9895f2825b00bace00)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:43.321210 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf315e58-2045-4bad-913a-e2ad5e58f285 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:43.472222 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:43.493889 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f90cffdb-a893-4dee-8f66-de4f5b60d63c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e2f5969aba44598ada648514c60523'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:43.494573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f90cffdb-a893-4dee-8f66-de4f5b60d63c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e2f5969aba44598ada648514c60523'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:43.571020 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bf315e58-2045-4bad-913a-e2ad5e58f285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb0d431099ff4d9895f2825b00bace00'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:43.571679 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bf315e58-2045-4bad-913a-e2ad5e58f285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb0d431099ff4d9895f2825b00bace00'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:43.603190 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f90cffdb-a893-4dee-8f66-de4f5b60d63c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e2f5969aba44598ada648514c60523'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:43.612380 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f90cffdb-a893-4dee-8f66-de4f5b60d63c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e2f5969aba44598ada648514c60523'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:43.613993 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f90cffdb-a893-4dee-8f66-de4f5b60d63c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e2f5969aba44598ada648514c60523'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:43.646199 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 939/1863] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:43 2022] DELETE /identity/v3/users/36e2f5969aba44598ada648514c60523 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:57:43.649344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813eb79-2968-418c-a92b-bca7b5d78e32 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:43.651123 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813eb79-2968-418c-a92b-bca7b5d78e32 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:43.651519 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813eb79-2968-418c-a92b-bca7b5d78e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:43.682983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-9813eb79-2968-418c-a92b-bca7b5d78e32 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:43.685021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-9813eb79-2968-418c-a92b-bca7b5d78e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:43.743442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bf315e58-2045-4bad-913a-e2ad5e58f285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb0d431099ff4d9895f2825b00bace00'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:43.750530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 940/1864] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:43.752924 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bf315e58-2045-4bad-913a-e2ad5e58f285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb0d431099ff4d9895f2825b00bace00'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:43.766798 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bf315e58-2045-4bad-913a-e2ad5e58f285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb0d431099ff4d9895f2825b00bace00'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:43.778660 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813eb79-2968-418c-a92b-bca7b5d78e32 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:43.778759 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 925/1865] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:43 2022] DELETE /identity/v3/users/fb0d431099ff4d9895f2825b00bace00 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:57:43.779495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-9813eb79-2968-418c-a92b-bca7b5d78e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:43.851908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813eb79-2968-418c-a92b-bca7b5d78e32 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:43.908519 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002dcd6b-b022-4521-8d22-05c4a6f09162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:43.909190 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dcd6b-b022-4521-8d22-05c4a6f09162 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:43.909475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dcd6b-b022-4521-8d22-05c4a6f09162 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:43.909803 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dcd6b-b022-4521-8d22-05c4a6f09162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:43.911621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-002dcd6b-b022-4521-8d22-05c4a6f09162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:44.002691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002dcd6b-b022-4521-8d22-05c4a6f09162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:44.004411 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002dcd6b-b022-4521-8d22-05c4a6f09162 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:44.043544 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 941/1866] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:44.398949 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf315e58-2045-4bad-913a-e2ad5e58f285 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:44.400363 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bf315e58-2045-4bad-913a-e2ad5e58f285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:44.420576 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf315e58-2045-4bad-913a-e2ad5e58f285 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:44.447890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35135ef7-82ac-4a21-8001-d2dd805c8212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:44.449073 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35135ef7-82ac-4a21-8001-d2dd805c8212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:44.449366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35135ef7-82ac-4a21-8001-d2dd805c8212 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:44.449680 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35135ef7-82ac-4a21-8001-d2dd805c8212 admin admin] PATH_INFO: `/v3/projects/d7c060fa10c7403d9e168e4fad0c697e` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:44.450915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35135ef7-82ac-4a21-8001-d2dd805c8212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c060fa10c7403d9e168e4fad0c697e)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:44.453281 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35135ef7-82ac-4a21-8001-d2dd805c8212 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:44.618531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-35135ef7-82ac-4a21-8001-d2dd805c8212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c060fa10c7403d9e168e4fad0c697e', 'request_id': 'req-35135ef7-82ac-4a21-8001-d2dd805c8212'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:44.626913 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-35135ef7-82ac-4a21-8001-d2dd805c8212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c060fa10c7403d9e168e4fad0c697e', 'request_id': 'req-35135ef7-82ac-4a21-8001-d2dd805c8212'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:44.634210 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-35135ef7-82ac-4a21-8001-d2dd805c8212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c060fa10c7403d9e168e4fad0c697e', 'request_id': 'req-35135ef7-82ac-4a21-8001-d2dd805c8212'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:44.771691 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-35135ef7-82ac-4a21-8001-d2dd805c8212 admin admin] The token cache is being invalidate because project d7c060fa10c7403d9e168e4fad0c697e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:44.771993 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-35135ef7-82ac-4a21-8001-d2dd805c8212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:44.772714 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-35135ef7-82ac-4a21-8001-d2dd805c8212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:44.778427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 926/1867] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:44 2022] DELETE /identity/v3/projects/d7c060fa10c7403d9e168e4fad0c697e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:44.779977 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2ece7-a7d8-481d-bcff-83c2414daf49 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:44.780469 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2ece7-a7d8-481d-bcff-83c2414daf49 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:44.780580 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2ece7-a7d8-481d-bcff-83c2414daf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:44.789654 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:44.805412 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-9fe2ece7-a7d8-481d-bcff-83c2414daf49 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:44.806663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-9fe2ece7-a7d8-481d-bcff-83c2414daf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:44.925934 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 942/1868] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:44.932921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a1399-f9bb-4e75-8111-9b543043ccd7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:44.933424 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a1399-f9bb-4e75-8111-9b543043ccd7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:44.934016 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a1399-f9bb-4e75-8111-9b543043ccd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:44.990163 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-0d3a1399-f9bb-4e75-8111-9b543043ccd7 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:44.993189 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0d3a1399-f9bb-4e75-8111-9b543043ccd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:45.015489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 927/1869] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:57:45.020637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2ece7-a7d8-481d-bcff-83c2414daf49 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:45.034420 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2ece7-a7d8-481d-bcff-83c2414daf49 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:45.039489 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd520b-0439-4da6-8d7c-f57aec8faf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:45.040166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd520b-0439-4da6-8d7c-f57aec8faf22 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:45.040469 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd520b-0439-4da6-8d7c-f57aec8faf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:45.040761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd520b-0439-4da6-8d7c-f57aec8faf22 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:45.041497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd520b-0439-4da6-8d7c-f57aec8faf22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:57:45.041809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd520b-0439-4da6-8d7c-f57aec8faf22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:45.044685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd520b-0439-4da6-8d7c-f57aec8faf22 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:45.060135 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 943/1870] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:57:45.062014 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a1399-f9bb-4e75-8111-9b543043ccd7 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:45.071376 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a1399-f9bb-4e75-8111-9b543043ccd7 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:45.076082 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987702f5-8e46-4a7b-9fed-10db9c7bd7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:45.076769 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987702f5-8e46-4a7b-9fed-10db9c7bd7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:45.077104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987702f5-8e46-4a7b-9fed-10db9c7bd7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:45.077398 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987702f5-8e46-4a7b-9fed-10db9c7bd7f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:45.078102 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987702f5-8e46-4a7b-9fed-10db9c7bd7f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:45.080049 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987702f5-8e46-4a7b-9fed-10db9c7bd7f2 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:45.131535 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd520b-0439-4da6-8d7c-f57aec8faf22 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:45.135039 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f8fd520b-0439-4da6-8d7c-f57aec8faf22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:45.156233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd520b-0439-4da6-8d7c-f57aec8faf22 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:45.162512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c63d5-89f9-401c-aace-a57536337c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:45.163655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c63d5-89f9-401c-aace-a57536337c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:45.164023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c63d5-89f9-401c-aace-a57536337c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:45.164411 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c63d5-89f9-401c-aace-a57536337c86 admin admin] PATH_INFO: `/v3/projects/30d8e17e23c645f7983484115351863c` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:45.165889 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c63d5-89f9-401c-aace-a57536337c86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d8e17e23c645f7983484115351863c)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:45.168883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c63d5-89f9-401c-aace-a57536337c86 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:45.216856 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 928/1871] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:45 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:45.220948 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987702f5-8e46-4a7b-9fed-10db9c7bd7f2 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:45.314366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987702f5-8e46-4a7b-9fed-10db9c7bd7f2 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:45.337960 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-428c63d5-89f9-401c-aace-a57536337c86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d8e17e23c645f7983484115351863c', 'request_id': 'req-428c63d5-89f9-401c-aace-a57536337c86'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:45.381533 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70e224-a88c-4c2c-84cb-f85114d9142f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:45.382317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70e224-a88c-4c2c-84cb-f85114d9142f admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:45.382609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70e224-a88c-4c2c-84cb-f85114d9142f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:45.382885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70e224-a88c-4c2c-84cb-f85114d9142f admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:45.383894 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70e224-a88c-4c2c-84cb-f85114d9142f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:45.385845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70e224-a88c-4c2c-84cb-f85114d9142f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:45.443262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-428c63d5-89f9-401c-aace-a57536337c86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d8e17e23c645f7983484115351863c', 'request_id': 'req-428c63d5-89f9-401c-aace-a57536337c86'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:45.451509 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-428c63d5-89f9-401c-aace-a57536337c86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d8e17e23c645f7983484115351863c', 'request_id': 'req-428c63d5-89f9-401c-aace-a57536337c86'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:45.462040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-428c63d5-89f9-401c-aace-a57536337c86 admin admin] The token cache is being invalidate because project 30d8e17e23c645f7983484115351863c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:45.462331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-428c63d5-89f9-401c-aace-a57536337c86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:45.463001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-428c63d5-89f9-401c-aace-a57536337c86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:45.464932 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 944/1872] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:45 2022] DELETE /identity/v3/projects/30d8e17e23c645f7983484115351863c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:45.469471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c63d5-89f9-401c-aace-a57536337c86 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:45.471176 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-428c63d5-89f9-401c-aace-a57536337c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:45.485648 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 929/1873] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:45 2022] POST /identity/v3/users => generated 294 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:57:45.490166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c63d5-89f9-401c-aace-a57536337c86 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:45.501151 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70e224-a88c-4c2c-84cb-f85114d9142f admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:45.501151 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cf70e224-a88c-4c2c-84cb-f85114d9142f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:45.502293 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626a82e-ce0c-4882-9d46-862f1bf78e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:45.502293 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626a82e-ce0c-4882-9d46-862f1bf78e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:45.502293 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626a82e-ce0c-4882-9d46-862f1bf78e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:45.502293 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626a82e-ce0c-4882-9d46-862f1bf78e29 admin admin] PATH_INFO: `/v3/users/d7c71b530e014b3890c62da51b34924f` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:45.502953 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626a82e-ce0c-4882-9d46-862f1bf78e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c71b530e014b3890c62da51b34924f)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:45.502953 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626a82e-ce0c-4882-9d46-862f1bf78e29 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:45.530076 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70e224-a88c-4c2c-84cb-f85114d9142f admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:45.544938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed344a-8201-484e-9575-432d55f74f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:45.545881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed344a-8201-484e-9575-432d55f74f80 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:45.546163 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed344a-8201-484e-9575-432d55f74f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:45.546597 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed344a-8201-484e-9575-432d55f74f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:45.552373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed344a-8201-484e-9575-432d55f74f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:45.552373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed344a-8201-484e-9575-432d55f74f80 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:45.560665 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 930/1874] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:45.562339 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa3d4a-f6ec-4df3-ac18-9ed3beedbe82 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:45.562629 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa3d4a-f6ec-4df3-ac18-9ed3beedbe82 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:45.563069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa3d4a-f6ec-4df3-ac18-9ed3beedbe82 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:45.564738 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 931/1875] 10.222.0.93 () {54 vars in 921 bytes} [Thu Jun 16 18:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:57:45.565652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa3d4a-f6ec-4df3-ac18-9ed3beedbe82 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:45.580102 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa3d4a-f6ec-4df3-ac18-9ed3beedbe82 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:45.587762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e5150-2e9e-4721-8941-ad7aae11b0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:45.588375 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e5150-2e9e-4721-8941-ad7aae11b0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:45.588726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e5150-2e9e-4721-8941-ad7aae11b0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:45.589030 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e5150-2e9e-4721-8941-ad7aae11b0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:45.589780 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e5150-2e9e-4721-8941-ad7aae11b0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:45.591583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e5150-2e9e-4721-8941-ad7aae11b0e3 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:45.607534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 932/1876] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:45.608987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc4a7a-cddd-4afa-99b9-1850d2bfb6e1 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:45.609281 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc4a7a-cddd-4afa-99b9-1850d2bfb6e1 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:45.609559 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc4a7a-cddd-4afa-99b9-1850d2bfb6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:45.635425 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-1cdc4a7a-cddd-4afa-99b9-1850d2bfb6e1 None None] MFA Rules not processed for user `3503ec98bea14693a17a84e686586bad`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:45.637752 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1cdc4a7a-cddd-4afa-99b9-1850d2bfb6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:45.712489 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9626a82e-ce0c-4882-9d46-862f1bf78e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c71b530e014b3890c62da51b34924f'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:45.713436 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9626a82e-ce0c-4882-9d46-862f1bf78e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c71b530e014b3890c62da51b34924f'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:45.743106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 933/1877] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Jun 16 18:57:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:45.749446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc4a7a-cddd-4afa-99b9-1850d2bfb6e1 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:45.754846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1cdc4a7a-cddd-4afa-99b9-1850d2bfb6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:45.771606 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc4a7a-cddd-4afa-99b9-1850d2bfb6e1 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:45.776353 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fcdd7-cd8d-4c9a-9dbb-8bff3b77df66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:45.777338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fcdd7-cd8d-4c9a-9dbb-8bff3b77df66 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:45.777676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fcdd7-cd8d-4c9a-9dbb-8bff3b77df66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:45.777955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fcdd7-cd8d-4c9a-9dbb-8bff3b77df66 admin admin] PATH_INFO: `/v3/projects/9c02b36d3c554b73b18b7ce54dd61aa4/users/50b7361b54bc4e0cb506b7784cb26149/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:45.783369 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9626a82e-ce0c-4882-9d46-862f1bf78e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c71b530e014b3890c62da51b34924f'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:45.791533 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9626a82e-ce0c-4882-9d46-862f1bf78e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c71b530e014b3890c62da51b34924f'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:45.793811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9626a82e-ce0c-4882-9d46-862f1bf78e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c71b530e014b3890c62da51b34924f'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:45.802731 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fcdd7-cd8d-4c9a-9dbb-8bff3b77df66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c02b36d3c554b73b18b7ce54dd61aa4, user_id=50b7361b54bc4e0cb506b7784cb26149, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:45.806170 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fcdd7-cd8d-4c9a-9dbb-8bff3b77df66 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:45.817872 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 945/1878] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:45 2022] DELETE /identity/v3/users/d7c71b530e014b3890c62da51b34924f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:45.819240 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626a82e-ce0c-4882-9d46-862f1bf78e29 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:45.821677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-9626a82e-ce0c-4882-9d46-862f1bf78e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:45.901852 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 934/1879] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:45 2022] PUT /identity/v3/projects/9c02b36d3c554b73b18b7ce54dd61aa4/users/50b7361b54bc4e0cb506b7784cb26149/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:45.920778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a133ce-d5ee-4de1-abb9-b67ed12eaf5c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:45.920778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a133ce-d5ee-4de1-abb9-b67ed12eaf5c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:45.920778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a133ce-d5ee-4de1-abb9-b67ed12eaf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:45.966262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626a82e-ce0c-4882-9d46-862f1bf78e29 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:45.968515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f9a133ce-d5ee-4de1-abb9-b67ed12eaf5c None None] MFA Rules not processed for user `50b7361b54bc4e0cb506b7784cb26149`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:45.969961 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f9a133ce-d5ee-4de1-abb9-b67ed12eaf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:46.098196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 935/1880] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:46.102751 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a133ce-d5ee-4de1-abb9-b67ed12eaf5c None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:46.109149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def7606-72c5-46e9-9006-3a0f4f0bf7ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:46.109909 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def7606-72c5-46e9-9006-3a0f4f0bf7ca service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:46.111424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def7606-72c5-46e9-9006-3a0f4f0bf7ca service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:46.112288 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def7606-72c5-46e9-9006-3a0f4f0bf7ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:46.131022 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def7606-72c5-46e9-9006-3a0f4f0bf7ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:46.132751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def7606-72c5-46e9-9006-3a0f4f0bf7ca service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:46.166439 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 946/1881] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:46.206351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a133ce-d5ee-4de1-abb9-b67ed12eaf5c None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:46.214566 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e042510-e925-4f07-9bfc-996836a38094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:46.215503 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e042510-e925-4f07-9bfc-996836a38094 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:46.215825 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e042510-e925-4f07-9bfc-996836a38094 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:46.216119 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e042510-e925-4f07-9bfc-996836a38094 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:46.216984 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e042510-e925-4f07-9bfc-996836a38094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:46.219216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e042510-e925-4f07-9bfc-996836a38094 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:46.342860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 936/1882] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:46 2022] POST /identity/v3/projects => generated 387 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:57:46.346005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def7606-72c5-46e9-9006-3a0f4f0bf7ca service nova] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:46.357883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def7606-72c5-46e9-9006-3a0f4f0bf7ca service nova] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:46.458116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739490d-66bf-48bb-bb0b-062c87f866af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:46.458847 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739490d-66bf-48bb-bb0b-062c87f866af admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:46.459138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739490d-66bf-48bb-bb0b-062c87f866af admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:46.459415 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739490d-66bf-48bb-bb0b-062c87f866af admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:46.460193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739490d-66bf-48bb-bb0b-062c87f866af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:46.462385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739490d-66bf-48bb-bb0b-062c87f866af admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:46.527502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e042510-e925-4f07-9bfc-996836a38094 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:46.529555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0e042510-e925-4f07-9bfc-996836a38094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:46.569396 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e042510-e925-4f07-9bfc-996836a38094 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:46.584803 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 947/1883] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:46 2022] POST /identity/v3/users => generated 300 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:46.584803 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739490d-66bf-48bb-bb0b-062c87f866af admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:46.585615 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea66f4-cece-48a9-a42c-b26395b4bb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:46.586499 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea66f4-cece-48a9-a42c-b26395b4bb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:46.586873 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea66f4-cece-48a9-a42c-b26395b4bb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:46.587037 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea66f4-cece-48a9-a42c-b26395b4bb29 admin admin] PATH_INFO: `/v3/projects/56cc39ef500b456d9f7f8a3e6ab83eb3` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:46.589215 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea66f4-cece-48a9-a42c-b26395b4bb29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56cc39ef500b456d9f7f8a3e6ab83eb3)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:46.589476 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b739490d-66bf-48bb-bb0b-062c87f866af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:46.592655 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea66f4-cece-48a9-a42c-b26395b4bb29 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:46.609240 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739490d-66bf-48bb-bb0b-062c87f866af admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:46.617437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece61550-5478-4f58-be6f-a66b9661fe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:46.619328 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece61550-5478-4f58-be6f-a66b9661fe73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:46.619838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece61550-5478-4f58-be6f-a66b9661fe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:46.620326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece61550-5478-4f58-be6f-a66b9661fe73 admin admin] PATH_INFO: `/v3/users/de5b386b1e9540e0bbb2060b7511a068` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:46.622352 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece61550-5478-4f58-be6f-a66b9661fe73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5b386b1e9540e0bbb2060b7511a068)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:46.626036 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece61550-5478-4f58-be6f-a66b9661fe73 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:46.740758 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d7ea66f4-cece-48a9-a42c-b26395b4bb29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56cc39ef500b456d9f7f8a3e6ab83eb3', 'request_id': 'req-d7ea66f4-cece-48a9-a42c-b26395b4bb29'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:46.746303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d7ea66f4-cece-48a9-a42c-b26395b4bb29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56cc39ef500b456d9f7f8a3e6ab83eb3', 'request_id': 'req-d7ea66f4-cece-48a9-a42c-b26395b4bb29'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:46.753217 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d7ea66f4-cece-48a9-a42c-b26395b4bb29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56cc39ef500b456d9f7f8a3e6ab83eb3', 'request_id': 'req-d7ea66f4-cece-48a9-a42c-b26395b4bb29'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:46.860168 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d7ea66f4-cece-48a9-a42c-b26395b4bb29 admin admin] The token cache is being invalidate because project 56cc39ef500b456d9f7f8a3e6ab83eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:46.860168 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d7ea66f4-cece-48a9-a42c-b26395b4bb29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:46.861194 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d7ea66f4-cece-48a9-a42c-b26395b4bb29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:46.862998 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 937/1884] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:46 2022] DELETE /identity/v3/projects/56cc39ef500b456d9f7f8a3e6ab83eb3 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:46.867080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea66f4-cece-48a9-a42c-b26395b4bb29 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:46.872270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d7ea66f4-cece-48a9-a42c-b26395b4bb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:46.883914 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ece61550-5478-4f58-be6f-a66b9661fe73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5b386b1e9540e0bbb2060b7511a068'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:46.885301 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ece61550-5478-4f58-be6f-a66b9661fe73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5b386b1e9540e0bbb2060b7511a068'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:46.948584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea66f4-cece-48a9-a42c-b26395b4bb29 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:46.953868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9205e55-51f5-44f6-af0d-effc2d85bf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:46.955141 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9205e55-51f5-44f6-af0d-effc2d85bf97 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:46.955141 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9205e55-51f5-44f6-af0d-effc2d85bf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:46.955141 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9205e55-51f5-44f6-af0d-effc2d85bf97 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:46.955959 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9205e55-51f5-44f6-af0d-effc2d85bf97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:46.957626 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9205e55-51f5-44f6-af0d-effc2d85bf97 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:46.969395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 938/1885] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:46.970753 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb1aae-3232-431d-b4d7-aac8f7fa62c9 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:46.971363 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb1aae-3232-431d-b4d7-aac8f7fa62c9 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:46.971653 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb1aae-3232-431d-b4d7-aac8f7fa62c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:46.995211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ece61550-5478-4f58-be6f-a66b9661fe73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5b386b1e9540e0bbb2060b7511a068'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:47.001316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-e7bb1aae-3232-431d-b4d7-aac8f7fa62c9 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:47.003644 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e7bb1aae-3232-431d-b4d7-aac8f7fa62c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:47.005618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ece61550-5478-4f58-be6f-a66b9661fe73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5b386b1e9540e0bbb2060b7511a068'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:47.006560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ece61550-5478-4f58-be6f-a66b9661fe73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5b386b1e9540e0bbb2060b7511a068'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:47.019310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 939/1886] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:47.020845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb1aae-3232-431d-b4d7-aac8f7fa62c9 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:47.022946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e7bb1aae-3232-431d-b4d7-aac8f7fa62c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:47.025180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:47.034519 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 948/1887] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:46 2022] DELETE /identity/v3/users/de5b386b1e9540e0bbb2060b7511a068 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:47.036295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ade8e7-df89-4c79-898d-21371b493fc4 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:47.036898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ade8e7-df89-4c79-898d-21371b493fc4 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:47.037580 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ade8e7-df89-4c79-898d-21371b493fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:47.045082 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb1aae-3232-431d-b4d7-aac8f7fa62c9 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:47.064266 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-96ade8e7-df89-4c79-898d-21371b493fc4 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:47.066024 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-96ade8e7-df89-4c79-898d-21371b493fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:47.127799 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab2e5e-dfe3-455a-8cb3-742a0048ed65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:47.128833 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab2e5e-dfe3-455a-8cb3-742a0048ed65 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:47.129123 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab2e5e-dfe3-455a-8cb3-742a0048ed65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:47.129401 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab2e5e-dfe3-455a-8cb3-742a0048ed65 admin admin] PATH_INFO: `/v3/projects/d1b499faa4be42678f937d641b0924d2/users/19d1b60df4284929a716bce7503bae6d/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:47.145455 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab2e5e-dfe3-455a-8cb3-742a0048ed65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b499faa4be42678f937d641b0924d2, user_id=19d1b60df4284929a716bce7503bae6d, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:47.148369 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab2e5e-dfe3-455a-8cb3-742a0048ed65 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:47.153308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 949/1888] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:47.159018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58f201-b68e-4b80-ac54-22b478419555 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:47.159018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58f201-b68e-4b80-ac54-22b478419555 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:47.159018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58f201-b68e-4b80-ac54-22b478419555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:47.180539 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-6e58f201-b68e-4b80-ac54-22b478419555 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:47.181779 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6e58f201-b68e-4b80-ac54-22b478419555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:47.190607 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 950/1889] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:47.194459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58f201-b68e-4b80-ac54-22b478419555 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:47.205706 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58f201-b68e-4b80-ac54-22b478419555 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:47.210864 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db8996-812a-468d-9560-711ed4afd3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:47.211540 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db8996-812a-468d-9560-711ed4afd3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:47.214443 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db8996-812a-468d-9560-711ed4afd3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:47.214443 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db8996-812a-468d-9560-711ed4afd3d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:47.214443 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db8996-812a-468d-9560-711ed4afd3d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:57:47.214443 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db8996-812a-468d-9560-711ed4afd3d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:47.215623 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db8996-812a-468d-9560-711ed4afd3d6 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:47.236210 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 940/1890] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:47 2022] PUT /identity/v3/projects/d1b499faa4be42678f937d641b0924d2/users/19d1b60df4284929a716bce7503bae6d/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:47.236210 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab2e5e-dfe3-455a-8cb3-742a0048ed65 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:47.236756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 951/1891] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:57:47.237462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db8996-812a-468d-9560-711ed4afd3d6 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:47.240718 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c1ab2e5e-dfe3-455a-8cb3-742a0048ed65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:47.252568 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db8996-812a-468d-9560-711ed4afd3d6 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:47.320847 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab2e5e-dfe3-455a-8cb3-742a0048ed65 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:47.326850 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2629b-08eb-4cf5-b8bc-3a3d103d67d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:47.327650 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2629b-08eb-4cf5-b8bc-3a3d103d67d6 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:47.327962 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c437e17-0b10-45c1-847e-42a43d65e5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:47.328133 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2629b-08eb-4cf5-b8bc-3a3d103d67d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:47.329032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2629b-08eb-4cf5-b8bc-3a3d103d67d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:47.329176 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c437e17-0b10-45c1-847e-42a43d65e5aa admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:47.329176 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c437e17-0b10-45c1-847e-42a43d65e5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:47.329410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c437e17-0b10-45c1-847e-42a43d65e5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:47.329946 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c437e17-0b10-45c1-847e-42a43d65e5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:47.331805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c437e17-0b10-45c1-847e-42a43d65e5aa admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:47.341347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2629b-08eb-4cf5-b8bc-3a3d103d67d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:47.344476 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2629b-08eb-4cf5-b8bc-3a3d103d67d6 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:47.344615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 952/1892] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:47.344615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c437e17-0b10-45c1-847e-42a43d65e5aa admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:47.354382 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 941/1893] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:47.358636 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c437e17-0b10-45c1-847e-42a43d65e5aa admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:47.363763 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fcf71-cf9a-469f-bbb6-0e27e3139d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:47.364381 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fcf71-cf9a-469f-bbb6-0e27e3139d96 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:47.364708 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fcf71-cf9a-469f-bbb6-0e27e3139d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:47.364991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fcf71-cf9a-469f-bbb6-0e27e3139d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:47.365615 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2629b-08eb-4cf5-b8bc-3a3d103d67d6 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:47.365730 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fcf71-cf9a-469f-bbb6-0e27e3139d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:47.367813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fcf71-cf9a-469f-bbb6-0e27e3139d96 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:47.378728 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2629b-08eb-4cf5-b8bc-3a3d103d67d6 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:47.388389 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780d151-7402-49d4-8701-5e4e874bc518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:47.389320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780d151-7402-49d4-8701-5e4e874bc518 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:47.389601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780d151-7402-49d4-8701-5e4e874bc518 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:47.389873 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780d151-7402-49d4-8701-5e4e874bc518 admin admin] PATH_INFO: `/v3/projects/d1b499faa4be42678f937d641b0924d2/users/19d1b60df4284929a716bce7503bae6d/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:47.391877 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780d151-7402-49d4-8701-5e4e874bc518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b499faa4be42678f937d641b0924d2, user_id=19d1b60df4284929a716bce7503bae6d, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:47.395748 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780d151-7402-49d4-8701-5e4e874bc518 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:47.409860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 942/1894] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:47 2022] PUT /identity/v3/projects/d1b499faa4be42678f937d641b0924d2/users/19d1b60df4284929a716bce7503bae6d/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:47.421456 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202db8e7-03ea-4311-bd9b-ec09d2100e09 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:47.421747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202db8e7-03ea-4311-bd9b-ec09d2100e09 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:47.422030 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202db8e7-03ea-4311-bd9b-ec09d2100e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:47.452906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-202db8e7-03ea-4311-bd9b-ec09d2100e09 None None] MFA Rules not processed for user `19d1b60df4284929a716bce7503bae6d`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:47.453898 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-202db8e7-03ea-4311-bd9b-ec09d2100e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:47.492522 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 953/1895] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:47 2022] POST /identity/v3/projects => generated 393 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:47.495938 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fcf71-cf9a-469f-bbb6-0e27e3139d96 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:47.538043 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 943/1896] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:57:47.549523 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202db8e7-03ea-4311-bd9b-ec09d2100e09 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:47.550924 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-202db8e7-03ea-4311-bd9b-ec09d2100e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:47.564502 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fcf71-cf9a-469f-bbb6-0e27e3139d96 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:47.569644 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351546b-6a1f-4853-bb27-e5506c1a119f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:47.570395 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351546b-6a1f-4853-bb27-e5506c1a119f admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:47.570754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351546b-6a1f-4853-bb27-e5506c1a119f admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:47.571094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351546b-6a1f-4853-bb27-e5506c1a119f admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:47.571954 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351546b-6a1f-4853-bb27-e5506c1a119f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:47.573896 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351546b-6a1f-4853-bb27-e5506c1a119f admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:47.624469 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202db8e7-03ea-4311-bd9b-ec09d2100e09 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:47.693914 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b275fa-5cd3-4637-8eb7-24d6a94bb17b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:47.694761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b275fa-5cd3-4637-8eb7-24d6a94bb17b service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:47.695175 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b275fa-5cd3-4637-8eb7-24d6a94bb17b service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:47.695559 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b275fa-5cd3-4637-8eb7-24d6a94bb17b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:47.757079 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 954/1897] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:47 2022] POST /identity/v3/users => generated 297 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:47.758713 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351546b-6a1f-4853-bb27-e5506c1a119f admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:47.760980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:47.784816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351546b-6a1f-4853-bb27-e5506c1a119f admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:47.793906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b275fa-5cd3-4637-8eb7-24d6a94bb17b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:47.793906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b275fa-5cd3-4637-8eb7-24d6a94bb17b service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:47.795868 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a63c6c-cac9-418a-b620-c994b32a2c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:47.797302 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a63c6c-cac9-418a-b620-c994b32a2c10 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:47.799203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a63c6c-cac9-418a-b620-c994b32a2c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:47.799588 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a63c6c-cac9-418a-b620-c994b32a2c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:47.800827 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a63c6c-cac9-418a-b620-c994b32a2c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:47.803707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a63c6c-cac9-418a-b620-c994b32a2c10 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:47.804236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 944/1898] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:47.817902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 955/1899] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:47.820677 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b275fa-5cd3-4637-8eb7-24d6a94bb17b service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:47.832245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b275fa-5cd3-4637-8eb7-24d6a94bb17b service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:47.841950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916b8b4-7e1b-4427-92a5-cbbb9085d647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:47.842704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916b8b4-7e1b-4427-92a5-cbbb9085d647 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:47.842990 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916b8b4-7e1b-4427-92a5-cbbb9085d647 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:47.843265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916b8b4-7e1b-4427-92a5-cbbb9085d647 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:47.844015 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916b8b4-7e1b-4427-92a5-cbbb9085d647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:47.845652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916b8b4-7e1b-4427-92a5-cbbb9085d647 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:47.874904 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 945/1900] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:47.877807 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a63c6c-cac9-418a-b620-c994b32a2c10 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:47.889313 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a63c6c-cac9-418a-b620-c994b32a2c10 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:47.893533 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916b8b4-7e1b-4427-92a5-cbbb9085d647 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:47.900391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69247b14-68a7-44a6-a138-45bd73098601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:47.901339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69247b14-68a7-44a6-a138-45bd73098601 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:47.901626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69247b14-68a7-44a6-a138-45bd73098601 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:47.901902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69247b14-68a7-44a6-a138-45bd73098601 admin admin] PATH_INFO: `/v3/projects/6a79899c1060407b896dcaa9fcea3978/users/7e0f6f00a9744fcfb48585e6d15d3d80/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:47.909506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916b8b4-7e1b-4427-92a5-cbbb9085d647 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:47.921612 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69247b14-68a7-44a6-a138-45bd73098601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a79899c1060407b896dcaa9fcea3978, user_id=7e0f6f00a9744fcfb48585e6d15d3d80, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:47.921823 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324a6ed-cd41-4d18-aded-49e052da60da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:47.922779 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324a6ed-cd41-4d18-aded-49e052da60da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:47.923519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324a6ed-cd41-4d18-aded-49e052da60da admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:47.923519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324a6ed-cd41-4d18-aded-49e052da60da admin admin] PATH_INFO: `/v3/users/50b7361b54bc4e0cb506b7784cb26149` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:47.925262 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324a6ed-cd41-4d18-aded-49e052da60da admin admin] RBAC: Authorizing `identity:delete_user(user_id=50b7361b54bc4e0cb506b7784cb26149)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:47.925968 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69247b14-68a7-44a6-a138-45bd73098601 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:47.928299 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324a6ed-cd41-4d18-aded-49e052da60da admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:48.073791 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 956/1901] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:47 2022] PUT /identity/v3/projects/6a79899c1060407b896dcaa9fcea3978/users/7e0f6f00a9744fcfb48585e6d15d3d80/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:48.075491 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425208d-42cb-4468-b646-ae661de59215 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:48.075789 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425208d-42cb-4468-b646-ae661de59215 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:48.076071 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425208d-42cb-4468-b646-ae661de59215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:48.104828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-0425208d-42cb-4468-b646-ae661de59215 None None] MFA Rules not processed for user `7e0f6f00a9744fcfb48585e6d15d3d80`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:48.106702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-0425208d-42cb-4468-b646-ae661de59215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:48.170057 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d324a6ed-cd41-4d18-aded-49e052da60da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50b7361b54bc4e0cb506b7784cb26149'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:48.170987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d324a6ed-cd41-4d18-aded-49e052da60da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50b7361b54bc4e0cb506b7784cb26149'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:48.205589 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 957/1902] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:48.206814 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425208d-42cb-4468-b646-ae661de59215 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:48.252511 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d324a6ed-cd41-4d18-aded-49e052da60da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50b7361b54bc4e0cb506b7784cb26149'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:48.261288 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d324a6ed-cd41-4d18-aded-49e052da60da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50b7361b54bc4e0cb506b7784cb26149'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:48.289761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425208d-42cb-4468-b646-ae661de59215 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:48.295186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0af1e-8038-45a8-9c7b-c66bceaae1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:48.296129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0af1e-8038-45a8-9c7b-c66bceaae1bb admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:48.296509 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0af1e-8038-45a8-9c7b-c66bceaae1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:48.296860 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0af1e-8038-45a8-9c7b-c66bceaae1bb admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:48.297691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0af1e-8038-45a8-9c7b-c66bceaae1bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:48.299808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0af1e-8038-45a8-9c7b-c66bceaae1bb admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:48.302506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d324a6ed-cd41-4d18-aded-49e052da60da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50b7361b54bc4e0cb506b7784cb26149'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:48.314202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 946/1903] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:47 2022] DELETE /identity/v3/users/50b7361b54bc4e0cb506b7784cb26149 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:48.315931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3498d8d-ab5b-4893-8b0b-b9fdf45eb1fc None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:48.316303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3498d8d-ab5b-4893-8b0b-b9fdf45eb1fc None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:48.316696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3498d8d-ab5b-4893-8b0b-b9fdf45eb1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:48.340580 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f3498d8d-ab5b-4893-8b0b-b9fdf45eb1fc None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:48.342123 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f3498d8d-ab5b-4893-8b0b-b9fdf45eb1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:48.343679 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:48.408522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 947/1904] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:48.418942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3498d8d-ab5b-4893-8b0b-b9fdf45eb1fc None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:48.419568 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 958/1905] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:48 2022] POST /identity/v3/projects => generated 393 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:48.423097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0af1e-8038-45a8-9c7b-c66bceaae1bb admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:48.423275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f3498d8d-ab5b-4893-8b0b-b9fdf45eb1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:48.424867 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-21c0af1e-8038-45a8-9c7b-c66bceaae1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:48.491263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3498d8d-ab5b-4893-8b0b-b9fdf45eb1fc None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:48.509926 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0af1e-8038-45a8-9c7b-c66bceaae1bb admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:48.517930 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e3be2-fcc5-4643-9b5c-67d02faff508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:48.518838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e3be2-fcc5-4643-9b5c-67d02faff508 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:48.519204 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e3be2-fcc5-4643-9b5c-67d02faff508 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:48.519574 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e3be2-fcc5-4643-9b5c-67d02faff508 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:48.520350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e3be2-fcc5-4643-9b5c-67d02faff508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:48.522403 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e3be2-fcc5-4643-9b5c-67d02faff508 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:48.551007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375601c-f957-4e18-88c4-a301e9537517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:48.551670 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375601c-f957-4e18-88c4-a301e9537517 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:48.551953 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375601c-f957-4e18-88c4-a301e9537517 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:48.552255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375601c-f957-4e18-88c4-a301e9537517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:48.563319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375601c-f957-4e18-88c4-a301e9537517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:48.564913 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375601c-f957-4e18-88c4-a301e9537517 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:48.576455 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 948/1906] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:48.649752 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375601c-f957-4e18-88c4-a301e9537517 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:48.652202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f375601c-f957-4e18-88c4-a301e9537517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:48.670654 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375601c-f957-4e18-88c4-a301e9537517 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:48.684998 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960a35e-fba9-4cd2-967c-6b21817c898b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:48.686253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960a35e-fba9-4cd2-967c-6b21817c898b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:48.686727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960a35e-fba9-4cd2-967c-6b21817c898b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:48.687008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960a35e-fba9-4cd2-967c-6b21817c898b admin admin] PATH_INFO: `/v3/projects/65f28abf9ca247cd813bcb0e7546be93` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:48.691121 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960a35e-fba9-4cd2-967c-6b21817c898b admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f28abf9ca247cd813bcb0e7546be93)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:48.693175 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960a35e-fba9-4cd2-967c-6b21817c898b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:48.697452 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 959/1907] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:48 2022] POST /identity/v3/users => generated 303 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:57:48.702359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e3be2-fcc5-4643-9b5c-67d02faff508 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:48.720270 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e3be2-fcc5-4643-9b5c-67d02faff508 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:48.729639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1c954-1328-4625-bcb4-97b62a0b527a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:48.729822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1c954-1328-4625-bcb4-97b62a0b527a admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:48.730260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1c954-1328-4625-bcb4-97b62a0b527a admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:48.730579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1c954-1328-4625-bcb4-97b62a0b527a admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:48.731768 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1c954-1328-4625-bcb4-97b62a0b527a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:48.733996 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1c954-1328-4625-bcb4-97b62a0b527a admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:48.745631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 960/1908] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:48.750062 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1c954-1328-4625-bcb4-97b62a0b527a admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:48.759929 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1c954-1328-4625-bcb4-97b62a0b527a admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:48.765184 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba366b-6b55-4b11-90be-64a19c9474c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:48.766055 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba366b-6b55-4b11-90be-64a19c9474c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:48.766366 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba366b-6b55-4b11-90be-64a19c9474c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:48.766642 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba366b-6b55-4b11-90be-64a19c9474c5 admin admin] PATH_INFO: `/v3/projects/a67bcbe7fc95434c831f6e9cf7abd6fb/users/99ea37db24f54d94a9844a9ae4b970f1/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:48.781448 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba366b-6b55-4b11-90be-64a19c9474c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a67bcbe7fc95434c831f6e9cf7abd6fb, user_id=99ea37db24f54d94a9844a9ae4b970f1, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:48.784103 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba366b-6b55-4b11-90be-64a19c9474c5 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:48.857678 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 961/1909] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:48 2022] PUT /identity/v3/projects/a67bcbe7fc95434c831f6e9cf7abd6fb/users/99ea37db24f54d94a9844a9ae4b970f1/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:57:48.862254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba366b-6b55-4b11-90be-64a19c9474c5 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:48.881597 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4960a35e-fba9-4cd2-967c-6b21817c898b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f28abf9ca247cd813bcb0e7546be93', 'request_id': 'req-4960a35e-fba9-4cd2-967c-6b21817c898b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:48.896824 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4960a35e-fba9-4cd2-967c-6b21817c898b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f28abf9ca247cd813bcb0e7546be93', 'request_id': 'req-4960a35e-fba9-4cd2-967c-6b21817c898b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:48.913020 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4960a35e-fba9-4cd2-967c-6b21817c898b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f28abf9ca247cd813bcb0e7546be93', 'request_id': 'req-4960a35e-fba9-4cd2-967c-6b21817c898b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:48.929114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:48.968625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba366b-6b55-4b11-90be-64a19c9474c5 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:49.045456 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4960a35e-fba9-4cd2-967c-6b21817c898b admin admin] The token cache is being invalidate because project 65f28abf9ca247cd813bcb0e7546be93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:49.045788 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4960a35e-fba9-4cd2-967c-6b21817c898b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:49.052066 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a2498-140c-4845-9815-341573ac3d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:49.053552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4960a35e-fba9-4cd2-967c-6b21817c898b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:49.053671 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a2498-140c-4845-9815-341573ac3d55 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:49.054782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a2498-140c-4845-9815-341573ac3d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:49.055304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a2498-140c-4845-9815-341573ac3d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:49.056279 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a2498-140c-4845-9815-341573ac3d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:49.059633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 949/1910] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:48 2022] DELETE /identity/v3/projects/65f28abf9ca247cd813bcb0e7546be93 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:49.059818 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a2498-140c-4845-9815-341573ac3d55 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:49.074303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960a35e-fba9-4cd2-967c-6b21817c898b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:49.074303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4960a35e-fba9-4cd2-967c-6b21817c898b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:49.083300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 962/1911] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:49.084552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960a35e-fba9-4cd2-967c-6b21817c898b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:49.087334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a2498-140c-4845-9815-341573ac3d55 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:49.091344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c05a2498-140c-4845-9815-341573ac3d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:49.104869 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16b25f-fc67-44cb-9fa2-5884bd5bf694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:49.108872 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16b25f-fc67-44cb-9fa2-5884bd5bf694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:49.109224 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16b25f-fc67-44cb-9fa2-5884bd5bf694 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:49.109511 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16b25f-fc67-44cb-9fa2-5884bd5bf694 admin admin] PATH_INFO: `/v3/users/3dca43a7d098494cb598b23f97abb97d` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:49.117848 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16b25f-fc67-44cb-9fa2-5884bd5bf694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dca43a7d098494cb598b23f97abb97d)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:49.123245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16b25f-fc67-44cb-9fa2-5884bd5bf694 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:49.133997 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a2498-140c-4845-9815-341573ac3d55 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:49.150369 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f50a8-4ac0-483b-bad7-2940ff26452a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:49.152032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f50a8-4ac0-483b-bad7-2940ff26452a admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:49.152543 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f50a8-4ac0-483b-bad7-2940ff26452a admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:49.155300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f50a8-4ac0-483b-bad7-2940ff26452a admin admin] PATH_INFO: `/v3/projects/a67bcbe7fc95434c831f6e9cf7abd6fb/users/99ea37db24f54d94a9844a9ae4b970f1/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:49.156717 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f50a8-4ac0-483b-bad7-2940ff26452a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a67bcbe7fc95434c831f6e9cf7abd6fb, user_id=99ea37db24f54d94a9844a9ae4b970f1, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:49.162067 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f50a8-4ac0-483b-bad7-2940ff26452a admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:49.182361 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 963/1912] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:49 2022] PUT /identity/v3/projects/a67bcbe7fc95434c831f6e9cf7abd6fb/users/99ea37db24f54d94a9844a9ae4b970f1/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:57:49.183458 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f50a8-4ac0-483b-bad7-2940ff26452a admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:49.186192 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-a39f50a8-4ac0-483b-bad7-2940ff26452a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:49.302356 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f50a8-4ac0-483b-bad7-2940ff26452a admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:49.309120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768189e-76f8-48de-aaa2-f112e6895e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:49.311035 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768189e-76f8-48de-aaa2-f112e6895e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:49.311327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768189e-76f8-48de-aaa2-f112e6895e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:49.311632 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768189e-76f8-48de-aaa2-f112e6895e93 admin admin] PATH_INFO: `/v3/projects/9c02b36d3c554b73b18b7ce54dd61aa4` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:49.313034 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768189e-76f8-48de-aaa2-f112e6895e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c02b36d3c554b73b18b7ce54dd61aa4)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:49.315093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768189e-76f8-48de-aaa2-f112e6895e93 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:49.363133 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7a16b25f-fc67-44cb-9fa2-5884bd5bf694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dca43a7d098494cb598b23f97abb97d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:49.363850 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7a16b25f-fc67-44cb-9fa2-5884bd5bf694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dca43a7d098494cb598b23f97abb97d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:49.423327 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7a16b25f-fc67-44cb-9fa2-5884bd5bf694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dca43a7d098494cb598b23f97abb97d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:49.431543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7a16b25f-fc67-44cb-9fa2-5884bd5bf694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dca43a7d098494cb598b23f97abb97d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:49.452635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-a768189e-76f8-48de-aaa2-f112e6895e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c02b36d3c554b73b18b7ce54dd61aa4', 'request_id': 'req-a768189e-76f8-48de-aaa2-f112e6895e93'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:49.457866 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7a16b25f-fc67-44cb-9fa2-5884bd5bf694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dca43a7d098494cb598b23f97abb97d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:49.464575 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 950/1913] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:49 2022] DELETE /identity/v3/users/3dca43a7d098494cb598b23f97abb97d => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:57:49.476240 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d18ca-61d6-4f2c-9a4c-62be552a5ecf None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:49.476563 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d18ca-61d6-4f2c-9a4c-62be552a5ecf None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:49.476847 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d18ca-61d6-4f2c-9a4c-62be552a5ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:49.514098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d94d18ca-61d6-4f2c-9a4c-62be552a5ecf None None] MFA Rules not processed for user `99ea37db24f54d94a9844a9ae4b970f1`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:49.515253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-a768189e-76f8-48de-aaa2-f112e6895e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c02b36d3c554b73b18b7ce54dd61aa4', 'request_id': 'req-a768189e-76f8-48de-aaa2-f112e6895e93'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:49.515424 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d94d18ca-61d6-4f2c-9a4c-62be552a5ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:49.523517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-a768189e-76f8-48de-aaa2-f112e6895e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c02b36d3c554b73b18b7ce54dd61aa4', 'request_id': 'req-a768189e-76f8-48de-aaa2-f112e6895e93'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:49.536545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-a768189e-76f8-48de-aaa2-f112e6895e93 admin admin] The token cache is being invalidate because project 9c02b36d3c554b73b18b7ce54dd61aa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:49.536868 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-a768189e-76f8-48de-aaa2-f112e6895e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:49.537961 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-a768189e-76f8-48de-aaa2-f112e6895e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:49.539861 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 964/1914] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:49 2022] DELETE /identity/v3/projects/9c02b36d3c554b73b18b7ce54dd61aa4 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:49.543532 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768189e-76f8-48de-aaa2-f112e6895e93 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:49.546372 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-a768189e-76f8-48de-aaa2-f112e6895e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:49.603532 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 951/1915] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:49.618768 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d18ca-61d6-4f2c-9a4c-62be552a5ecf None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:49.620228 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d94d18ca-61d6-4f2c-9a4c-62be552a5ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:49.644272 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768189e-76f8-48de-aaa2-f112e6895e93 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:49.691312 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d18ca-61d6-4f2c-9a4c-62be552a5ecf None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:49.698217 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619d007-212c-4629-878f-e1923ced1d92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:49.698913 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619d007-212c-4629-878f-e1923ced1d92 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:49.699185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619d007-212c-4629-878f-e1923ced1d92 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:49.701506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619d007-212c-4629-878f-e1923ced1d92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:49.710692 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619d007-212c-4629-878f-e1923ced1d92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:49.713293 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619d007-212c-4629-878f-e1923ced1d92 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:49.724366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 952/1916] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:57:49.728344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89d170-166e-4954-90ed-b2c521405c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:49.729279 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89d170-166e-4954-90ed-b2c521405c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:49.729570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89d170-166e-4954-90ed-b2c521405c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:49.729855 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89d170-166e-4954-90ed-b2c521405c0e admin admin] PATH_INFO: `/v3/users/19d1b60df4284929a716bce7503bae6d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:49.731636 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89d170-166e-4954-90ed-b2c521405c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=19d1b60df4284929a716bce7503bae6d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:49.733867 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89d170-166e-4954-90ed-b2c521405c0e admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:49.824822 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619d007-212c-4629-878f-e1923ced1d92 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:49.836378 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619d007-212c-4629-878f-e1923ced1d92 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:49.840972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10272dc5-3f01-418b-a752-f62de66785d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:49.841846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10272dc5-3f01-418b-a752-f62de66785d0 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:49.842230 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10272dc5-3f01-418b-a752-f62de66785d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:49.842568 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10272dc5-3f01-418b-a752-f62de66785d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:49.844849 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-10272dc5-3f01-418b-a752-f62de66785d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:49.889641 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:49.920633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10272dc5-3f01-418b-a752-f62de66785d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:49.922274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10272dc5-3f01-418b-a752-f62de66785d0 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:49.933186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 953/1917] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:50.001908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-6b89d170-166e-4954-90ed-b2c521405c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19d1b60df4284929a716bce7503bae6d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:50.002779 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-6b89d170-166e-4954-90ed-b2c521405c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19d1b60df4284929a716bce7503bae6d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:50.092925 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-6b89d170-166e-4954-90ed-b2c521405c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19d1b60df4284929a716bce7503bae6d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:50.100817 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-6b89d170-166e-4954-90ed-b2c521405c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19d1b60df4284929a716bce7503bae6d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:50.101501 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-6b89d170-166e-4954-90ed-b2c521405c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19d1b60df4284929a716bce7503bae6d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:50.118939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 965/1918] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:49 2022] DELETE /identity/v3/users/19d1b60df4284929a716bce7503bae6d => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:50.201332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10272dc5-3f01-418b-a752-f62de66785d0 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:50.202680 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-10272dc5-3f01-418b-a752-f62de66785d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:50.219105 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10272dc5-3f01-418b-a752-f62de66785d0 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:50.255435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89d170-166e-4954-90ed-b2c521405c0e admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:50.256980 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6b89d170-166e-4954-90ed-b2c521405c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:50.301233 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00552549-ebc5-474f-acb6-98eca21c90a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:50.302257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00552549-ebc5-474f-acb6-98eca21c90a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:50.302633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00552549-ebc5-474f-acb6-98eca21c90a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:50.303004 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00552549-ebc5-474f-acb6-98eca21c90a5 admin admin] PATH_INFO: `/v3/projects/70b52bfd32eb496cbb3b2b8d15202e62` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:50.304399 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00552549-ebc5-474f-acb6-98eca21c90a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b52bfd32eb496cbb3b2b8d15202e62)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:50.306710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00552549-ebc5-474f-acb6-98eca21c90a5 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:50.345580 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=24,keystone:SELECT=73,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:50.348891 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89d170-166e-4954-90ed-b2c521405c0e admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:50.353492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488f373-ab82-4beb-8ca8-e7ae2459be1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:50.354375 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488f373-ab82-4beb-8ca8-e7ae2459be1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:50.354661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488f373-ab82-4beb-8ca8-e7ae2459be1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:50.354936 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488f373-ab82-4beb-8ca8-e7ae2459be1d admin admin] PATH_INFO: `/v3/users/6b4cd38810104b238960be1f0eb8daa7` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:50.356220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488f373-ab82-4beb-8ca8-e7ae2459be1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b4cd38810104b238960be1f0eb8daa7)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:50.358177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488f373-ab82-4beb-8ca8-e7ae2459be1d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:50.411361 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-00552549-ebc5-474f-acb6-98eca21c90a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b52bfd32eb496cbb3b2b8d15202e62', 'request_id': 'req-00552549-ebc5-474f-acb6-98eca21c90a5'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:50.418805 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-00552549-ebc5-474f-acb6-98eca21c90a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b52bfd32eb496cbb3b2b8d15202e62', 'request_id': 'req-00552549-ebc5-474f-acb6-98eca21c90a5'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:50.438515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-00552549-ebc5-474f-acb6-98eca21c90a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b52bfd32eb496cbb3b2b8d15202e62', 'request_id': 'req-00552549-ebc5-474f-acb6-98eca21c90a5'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:50.591484 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-00552549-ebc5-474f-acb6-98eca21c90a5 admin admin] The token cache is being invalidate because project 70b52bfd32eb496cbb3b2b8d15202e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:50.592026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-00552549-ebc5-474f-acb6-98eca21c90a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:50.592990 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-00552549-ebc5-474f-acb6-98eca21c90a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:50.594889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 954/1919] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:50 2022] DELETE /identity/v3/projects/70b52bfd32eb496cbb3b2b8d15202e62 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:50.599210 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd2ad9-77f7-41c2-9d41-d416126a375d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:50.599502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd2ad9-77f7-41c2-9d41-d416126a375d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:50.599858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd2ad9-77f7-41c2-9d41-d416126a375d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:50.618590 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-76dd2ad9-77f7-41c2-9d41-d416126a375d None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:50.619785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-76dd2ad9-77f7-41c2-9d41-d416126a375d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:50.654223 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-d488f373-ab82-4beb-8ca8-e7ae2459be1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b4cd38810104b238960be1f0eb8daa7'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:50.655024 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-d488f373-ab82-4beb-8ca8-e7ae2459be1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b4cd38810104b238960be1f0eb8daa7'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:50.700041 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 955/1920] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:57:50.708002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee84381-d0b6-407e-be9a-b04cfda72915 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:50.708411 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee84381-d0b6-407e-be9a-b04cfda72915 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:50.708823 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee84381-d0b6-407e-be9a-b04cfda72915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:50.733715 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4ee84381-d0b6-407e-be9a-b04cfda72915 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:50.734938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4ee84381-d0b6-407e-be9a-b04cfda72915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:50.743623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 956/1921] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:50.744465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee84381-d0b6-407e-be9a-b04cfda72915 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:50.745760 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4ee84381-d0b6-407e-be9a-b04cfda72915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:50.751836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-d488f373-ab82-4beb-8ca8-e7ae2459be1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b4cd38810104b238960be1f0eb8daa7'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:50.760969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-d488f373-ab82-4beb-8ca8-e7ae2459be1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b4cd38810104b238960be1f0eb8daa7'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:50.764166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-d488f373-ab82-4beb-8ca8-e7ae2459be1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b4cd38810104b238960be1f0eb8daa7'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:50.777762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee84381-d0b6-407e-be9a-b04cfda72915 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:50.790805 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b110c86-a189-4f38-af0e-54b8d6d54642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:50.792295 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b110c86-a189-4f38-af0e-54b8d6d54642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:50.792987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b110c86-a189-4f38-af0e-54b8d6d54642 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:50.793584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b110c86-a189-4f38-af0e-54b8d6d54642 admin admin] PATH_INFO: `/v3/projects/d1b499faa4be42678f937d641b0924d2` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:50.795759 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b110c86-a189-4f38-af0e-54b8d6d54642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b499faa4be42678f937d641b0924d2)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:50.798664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b110c86-a189-4f38-af0e-54b8d6d54642 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:50.831823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 966/1922] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:50 2022] DELETE /identity/v3/users/6b4cd38810104b238960be1f0eb8daa7 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:50.833887 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488f373-ab82-4beb-8ca8-e7ae2459be1d admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:50.909182 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488f373-ab82-4beb-8ca8-e7ae2459be1d admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:50.915314 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c89a2b-d2db-430f-9ef1-06b43f27eabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:50.916102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c89a2b-d2db-430f-9ef1-06b43f27eabd admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:50.916484 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c89a2b-d2db-430f-9ef1-06b43f27eabd admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:50.916844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c89a2b-d2db-430f-9ef1-06b43f27eabd admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:50.917725 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c89a2b-d2db-430f-9ef1-06b43f27eabd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:57:50.918201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c89a2b-d2db-430f-9ef1-06b43f27eabd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:50.919956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c89a2b-d2db-430f-9ef1-06b43f27eabd admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:50.934247 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 967/1923] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:57:50.935650 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824509a-34db-4ba6-8564-5afb2da943f4 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:50.935946 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824509a-34db-4ba6-8564-5afb2da943f4 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:50.936229 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824509a-34db-4ba6-8564-5afb2da943f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:50.954922 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-7824509a-34db-4ba6-8564-5afb2da943f4 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:50.956217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-7824509a-34db-4ba6-8564-5afb2da943f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:50.966815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 968/1924] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:50.967725 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824509a-34db-4ba6-8564-5afb2da943f4 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:50.982039 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9b110c86-a189-4f38-af0e-54b8d6d54642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b499faa4be42678f937d641b0924d2', 'request_id': 'req-9b110c86-a189-4f38-af0e-54b8d6d54642'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:50.985806 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824509a-34db-4ba6-8564-5afb2da943f4 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:50.990747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9b110c86-a189-4f38-af0e-54b8d6d54642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b499faa4be42678f937d641b0924d2', 'request_id': 'req-9b110c86-a189-4f38-af0e-54b8d6d54642'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:51.011371 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9b110c86-a189-4f38-af0e-54b8d6d54642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b499faa4be42678f937d641b0924d2', 'request_id': 'req-9b110c86-a189-4f38-af0e-54b8d6d54642'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:51.053381 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563223f-b061-4408-b116-3c12606581fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:51.054095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563223f-b061-4408-b116-3c12606581fa admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:51.054336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563223f-b061-4408-b116-3c12606581fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:51.054614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563223f-b061-4408-b116-3c12606581fa admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:51.055325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563223f-b061-4408-b116-3c12606581fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:51.057332 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563223f-b061-4408-b116-3c12606581fa admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:51.082938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9b110c86-a189-4f38-af0e-54b8d6d54642 admin admin] The token cache is being invalidate because project d1b499faa4be42678f937d641b0924d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:51.083232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9b110c86-a189-4f38-af0e-54b8d6d54642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:51.083963 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9b110c86-a189-4f38-af0e-54b8d6d54642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:51.085580 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 957/1925] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:50 2022] DELETE /identity/v3/projects/d1b499faa4be42678f937d641b0924d2 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:51.086493 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b110c86-a189-4f38-af0e-54b8d6d54642 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:51.087805 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9b110c86-a189-4f38-af0e-54b8d6d54642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:51.169830 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b110c86-a189-4f38-af0e-54b8d6d54642 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:51.173748 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed0804-0a22-41cd-b918-a887541df774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:51.174407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed0804-0a22-41cd-b918-a887541df774 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:51.174701 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed0804-0a22-41cd-b918-a887541df774 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:51.174979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed0804-0a22-41cd-b918-a887541df774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:51.177010 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-50ed0804-0a22-41cd-b918-a887541df774 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:51.178318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 969/1926] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:50 2022] POST /identity/v3/projects => generated 387 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:51.180133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705724c-1d1c-4806-b9b2-ebeffc683bd2 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:51.180740 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705724c-1d1c-4806-b9b2-ebeffc683bd2 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:51.181175 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705724c-1d1c-4806-b9b2-ebeffc683bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:51.193998 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed0804-0a22-41cd-b918-a887541df774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:51.195631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed0804-0a22-41cd-b918-a887541df774 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:51.201410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-5705724c-1d1c-4806-b9b2-ebeffc683bd2 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:51.202840 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5705724c-1d1c-4806-b9b2-ebeffc683bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:51.212754 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 958/1927] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:51.215710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed0804-0a22-41cd-b918-a887541df774 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:51.217270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-50ed0804-0a22-41cd-b918-a887541df774 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:51.232138 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed0804-0a22-41cd-b918-a887541df774 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:51.305886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:51.305886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 970/1928] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:51.309385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae9e03-b7b2-43b2-b4e3-b9a0ffa86e76 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:51.311261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae9e03-b7b2-43b2-b4e3-b9a0ffa86e76 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:51.311562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae9e03-b7b2-43b2-b4e3-b9a0ffa86e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:51.335008 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-47ae9e03-b7b2-43b2-b4e3-b9a0ffa86e76 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:51.336549 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-47ae9e03-b7b2-43b2-b4e3-b9a0ffa86e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:51.353811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 971/1929] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:57:51.358533 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e62b1-b547-49c5-b69a-5e33e6ba24b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:51.359527 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e62b1-b547-49c5-b69a-5e33e6ba24b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:51.360016 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e62b1-b547-49c5-b69a-5e33e6ba24b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:51.360567 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e62b1-b547-49c5-b69a-5e33e6ba24b7 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:51.363968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e62b1-b547-49c5-b69a-5e33e6ba24b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:51.366578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e62b1-b547-49c5-b69a-5e33e6ba24b7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:51.366696 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae9e03-b7b2-43b2-b4e3-b9a0ffa86e76 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:51.382177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae9e03-b7b2-43b2-b4e3-b9a0ffa86e76 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:51.387955 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf10499-19c3-4109-bce4-952644622094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:51.388673 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf10499-19c3-4109-bce4-952644622094 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:51.389046 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf10499-19c3-4109-bce4-952644622094 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:51.389546 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf10499-19c3-4109-bce4-952644622094 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:51.390166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf10499-19c3-4109-bce4-952644622094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:57:51.390543 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf10499-19c3-4109-bce4-952644622094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:51.392118 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf10499-19c3-4109-bce4-952644622094 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:51.406389 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 972/1930] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:57:51.410463 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf10499-19c3-4109-bce4-952644622094 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:51.421795 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf10499-19c3-4109-bce4-952644622094 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:51.427738 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72915dc5-a6e3-4013-849a-a6072bb18de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:51.428411 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72915dc5-a6e3-4013-849a-a6072bb18de6 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:51.428736 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72915dc5-a6e3-4013-849a-a6072bb18de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:51.429018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72915dc5-a6e3-4013-849a-a6072bb18de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:51.429748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72915dc5-a6e3-4013-849a-a6072bb18de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:51.431664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72915dc5-a6e3-4013-849a-a6072bb18de6 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:51.514488 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 959/1931] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:51 2022] POST /identity/v3/users => generated 294 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:51.518710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e62b1-b547-49c5-b69a-5e33e6ba24b7 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:51.531402 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e62b1-b547-49c5-b69a-5e33e6ba24b7 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:51.537311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805af48-6086-49f4-9bf4-2524cd680366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:51.537931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805af48-6086-49f4-9bf4-2524cd680366 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:51.539088 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805af48-6086-49f4-9bf4-2524cd680366 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:51.539504 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805af48-6086-49f4-9bf4-2524cd680366 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:51.541880 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805af48-6086-49f4-9bf4-2524cd680366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:51.547816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 973/1932] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:51 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:57:51.547976 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805af48-6086-49f4-9bf4-2524cd680366 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:51.560890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72915dc5-a6e3-4013-849a-a6072bb18de6 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:51.571705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 960/1933] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:51.576147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805af48-6086-49f4-9bf4-2524cd680366 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:51.597504 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805af48-6086-49f4-9bf4-2524cd680366 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:51.672473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72915dc5-a6e3-4013-849a-a6072bb18de6 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:51.680872 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577862c2-ef20-4fe4-a3a3-d70cf7174b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:51.681859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577862c2-ef20-4fe4-a3a3-d70cf7174b0b admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:51.682438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577862c2-ef20-4fe4-a3a3-d70cf7174b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:51.682923 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577862c2-ef20-4fe4-a3a3-d70cf7174b0b admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:51.685315 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577862c2-ef20-4fe4-a3a3-d70cf7174b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:51.687889 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577862c2-ef20-4fe4-a3a3-d70cf7174b0b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:51.716608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d36ab-bbbd-40f6-996c-18efa20ba7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:51.717458 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d36ab-bbbd-40f6-996c-18efa20ba7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:51.717884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d36ab-bbbd-40f6-996c-18efa20ba7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:51.718186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d36ab-bbbd-40f6-996c-18efa20ba7d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:51.719830 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d36ab-bbbd-40f6-996c-18efa20ba7d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:51.722152 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d36ab-bbbd-40f6-996c-18efa20ba7d7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:51.736770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 961/1934] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:57:51.738043 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d36ab-bbbd-40f6-996c-18efa20ba7d7 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:51.752818 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d36ab-bbbd-40f6-996c-18efa20ba7d7 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:51.757689 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c663eb-c026-4c8a-953a-c35ba4b6c433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:51.758883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c663eb-c026-4c8a-953a-c35ba4b6c433 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:51.759161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c663eb-c026-4c8a-953a-c35ba4b6c433 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:51.759448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c663eb-c026-4c8a-953a-c35ba4b6c433 admin admin] PATH_INFO: `/v3/projects/f218547b0fae4e69968e4d4042418097/users/e240c209dfe74332a365b4626f7e4b80/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:51.772581 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 974/1935] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:51 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:51.776873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577862c2-ef20-4fe4-a3a3-d70cf7174b0b admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:51.780294 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c663eb-c026-4c8a-953a-c35ba4b6c433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f218547b0fae4e69968e4d4042418097, user_id=e240c209dfe74332a365b4626f7e4b80, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:51.783128 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c663eb-c026-4c8a-953a-c35ba4b6c433 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:51.787737 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577862c2-ef20-4fe4-a3a3-d70cf7174b0b admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:51.792978 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21e548-8ce0-4fbd-9fde-616175a9b1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:51.793708 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21e548-8ce0-4fbd-9fde-616175a9b1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:51.796948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21e548-8ce0-4fbd-9fde-616175a9b1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:51.796948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21e548-8ce0-4fbd-9fde-616175a9b1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:51.796948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21e548-8ce0-4fbd-9fde-616175a9b1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:51.797188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21e548-8ce0-4fbd-9fde-616175a9b1c3 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:51.807388 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 975/1936] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:51.811874 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21e548-8ce0-4fbd-9fde-616175a9b1c3 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:51.826275 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21e548-8ce0-4fbd-9fde-616175a9b1c3 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:51.833387 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f46917-53dc-4018-a3b0-e31badda0c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:51.840322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f46917-53dc-4018-a3b0-e31badda0c77 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:51.840322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f46917-53dc-4018-a3b0-e31badda0c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:51.840322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f46917-53dc-4018-a3b0-e31badda0c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:51.840322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f46917-53dc-4018-a3b0-e31badda0c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:51.840322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f46917-53dc-4018-a3b0-e31badda0c77 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:51.849599 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 976/1937] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:57:51.850677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f46917-53dc-4018-a3b0-e31badda0c77 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:51.853605 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-61f46917-53dc-4018-a3b0-e31badda0c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:51.869275 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f46917-53dc-4018-a3b0-e31badda0c77 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:51.875708 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67192f22-2f79-4ec3-93c6-349d9dda3083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:51.876621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67192f22-2f79-4ec3-93c6-349d9dda3083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:51.877016 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67192f22-2f79-4ec3-93c6-349d9dda3083 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:51.877289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67192f22-2f79-4ec3-93c6-349d9dda3083 admin admin] PATH_INFO: `/v3/projects/ee110545b7504bb4b7de293eab35656d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:51.885827 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67192f22-2f79-4ec3-93c6-349d9dda3083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee110545b7504bb4b7de293eab35656d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:51.891779 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67192f22-2f79-4ec3-93c6-349d9dda3083 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:51.906616 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 962/1938] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:51 2022] PUT /identity/v3/projects/f218547b0fae4e69968e4d4042418097/users/e240c209dfe74332a365b4626f7e4b80/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:51.909140 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c663eb-c026-4c8a-953a-c35ba4b6c433 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:52.026964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c663eb-c026-4c8a-953a-c35ba4b6c433 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:52.036710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c688d-6b8c-4560-bdda-c241651aa273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:52.037813 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c688d-6b8c-4560-bdda-c241651aa273 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:52.038189 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c688d-6b8c-4560-bdda-c241651aa273 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:52.038569 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c688d-6b8c-4560-bdda-c241651aa273 admin admin] PATH_INFO: `/v3/projects/ac808859d8c54c58946a73d7934a7338/users/660539426fac4cdf946415c996739ff1/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:52.055254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c688d-6b8c-4560-bdda-c241651aa273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac808859d8c54c58946a73d7934a7338, user_id=660539426fac4cdf946415c996739ff1, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:52.058242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c688d-6b8c-4560-bdda-c241651aa273 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:52.178544 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 963/1939] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:51 2022] PUT /identity/v3/projects/ac808859d8c54c58946a73d7934a7338/users/660539426fac4cdf946415c996739ff1/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:52.188924 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f91dc-597b-4e95-b902-2eb50edf7f4a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:52.189193 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f91dc-597b-4e95-b902-2eb50edf7f4a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:52.189478 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f91dc-597b-4e95-b902-2eb50edf7f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:52.195424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-67192f22-2f79-4ec3-93c6-349d9dda3083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee110545b7504bb4b7de293eab35656d', 'request_id': 'req-67192f22-2f79-4ec3-93c6-349d9dda3083'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:52.220203 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-955f91dc-597b-4e95-b902-2eb50edf7f4a None None] MFA Rules not processed for user `e240c209dfe74332a365b4626f7e4b80`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:52.221469 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-955f91dc-597b-4e95-b902-2eb50edf7f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:52.277168 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-67192f22-2f79-4ec3-93c6-349d9dda3083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee110545b7504bb4b7de293eab35656d', 'request_id': 'req-67192f22-2f79-4ec3-93c6-349d9dda3083'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:52.286745 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-67192f22-2f79-4ec3-93c6-349d9dda3083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee110545b7504bb4b7de293eab35656d', 'request_id': 'req-67192f22-2f79-4ec3-93c6-349d9dda3083'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:52.301300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-67192f22-2f79-4ec3-93c6-349d9dda3083 admin admin] The token cache is being invalidate because project ee110545b7504bb4b7de293eab35656d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:52.301890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-67192f22-2f79-4ec3-93c6-349d9dda3083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:52.302754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-67192f22-2f79-4ec3-93c6-349d9dda3083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:52.309258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 977/1940] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:51 2022] DELETE /identity/v3/projects/ee110545b7504bb4b7de293eab35656d => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:52.309258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cce06b-2d0e-4251-9b5c-bc51dc46d5c7 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:52.309258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cce06b-2d0e-4251-9b5c-bc51dc46d5c7 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:52.310013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cce06b-2d0e-4251-9b5c-bc51dc46d5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:52.334098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 964/1941] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:52.334253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f91dc-597b-4e95-b902-2eb50edf7f4a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:52.355905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-c6cce06b-2d0e-4251-9b5c-bc51dc46d5c7 None None] MFA Rules not processed for user `660539426fac4cdf946415c996739ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:52.358324 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c6cce06b-2d0e-4251-9b5c-bc51dc46d5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:52.427453 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:52.476849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 978/1942] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:52.478295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cce06b-2d0e-4251-9b5c-bc51dc46d5c7 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:52.479770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c6cce06b-2d0e-4251-9b5c-bc51dc46d5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:52.487540 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f91dc-597b-4e95-b902-2eb50edf7f4a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:52.493697 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8aea3-51cb-46a5-8d2c-12bf762644c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:52.494614 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8aea3-51cb-46a5-8d2c-12bf762644c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:52.494896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8aea3-51cb-46a5-8d2c-12bf762644c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:52.495177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8aea3-51cb-46a5-8d2c-12bf762644c7 admin admin] PATH_INFO: `/v3/users/0184a34db5f946538b7dc5125b9859e8` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:52.497829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8aea3-51cb-46a5-8d2c-12bf762644c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0184a34db5f946538b7dc5125b9859e8)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:52.498462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cce06b-2d0e-4251-9b5c-bc51dc46d5c7 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:52.500088 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8aea3-51cb-46a5-8d2c-12bf762644c7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:52.504491 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467ca50-eaf4-4823-86b7-25983594db66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:52.505245 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467ca50-eaf4-4823-86b7-25983594db66 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:52.505534 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467ca50-eaf4-4823-86b7-25983594db66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:52.505809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467ca50-eaf4-4823-86b7-25983594db66 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:52.507224 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467ca50-eaf4-4823-86b7-25983594db66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:52.510045 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467ca50-eaf4-4823-86b7-25983594db66 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:52.656011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 979/1943] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:52 2022] POST /identity/v3/projects => generated 389 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:52.657224 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467ca50-eaf4-4823-86b7-25983594db66 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:52.659474 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c467ca50-eaf4-4823-86b7-25983594db66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:52.739021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467ca50-eaf4-4823-86b7-25983594db66 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:52.745986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b542879-dfd4-433b-b13f-a4f4657b8d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:52.747244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b542879-dfd4-433b-b13f-a4f4657b8d7c admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:52.747535 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b542879-dfd4-433b-b13f-a4f4657b8d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:52.747810 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b542879-dfd4-433b-b13f-a4f4657b8d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:52.748537 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b542879-dfd4-433b-b13f-a4f4657b8d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:52.750474 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b542879-dfd4-433b-b13f-a4f4657b8d7c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:52.879100 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-62c8aea3-51cb-46a5-8d2c-12bf762644c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0184a34db5f946538b7dc5125b9859e8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:52.887079 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-62c8aea3-51cb-46a5-8d2c-12bf762644c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0184a34db5f946538b7dc5125b9859e8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:52.893555 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 980/1944] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:52 2022] POST /identity/v3/projects => generated 387 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:52.893555 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b542879-dfd4-433b-b13f-a4f4657b8d7c admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:52.995568 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b542879-dfd4-433b-b13f-a4f4657b8d7c admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:53.002789 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750092c5-9fa3-4f7e-9e8e-ecd2ef1d77f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:53.003560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750092c5-9fa3-4f7e-9e8e-ecd2ef1d77f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:53.003908 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750092c5-9fa3-4f7e-9e8e-ecd2ef1d77f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:53.004255 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750092c5-9fa3-4f7e-9e8e-ecd2ef1d77f4 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:53.005677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750092c5-9fa3-4f7e-9e8e-ecd2ef1d77f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:53.007792 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750092c5-9fa3-4f7e-9e8e-ecd2ef1d77f4 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:53.030329 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-62c8aea3-51cb-46a5-8d2c-12bf762644c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0184a34db5f946538b7dc5125b9859e8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:53.044882 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-62c8aea3-51cb-46a5-8d2c-12bf762644c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0184a34db5f946538b7dc5125b9859e8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:53.069639 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-62c8aea3-51cb-46a5-8d2c-12bf762644c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0184a34db5f946538b7dc5125b9859e8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:53.083942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 965/1945] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:52 2022] DELETE /identity/v3/users/0184a34db5f946538b7dc5125b9859e8 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:53.084803 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8aea3-51cb-46a5-8d2c-12bf762644c7 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:53.086403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-62c8aea3-51cb-46a5-8d2c-12bf762644c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:53.146219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 981/1946] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:52 2022] POST /identity/v3/users => generated 301 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:53.149924 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750092c5-9fa3-4f7e-9e8e-ecd2ef1d77f4 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:53.154786 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-750092c5-9fa3-4f7e-9e8e-ecd2ef1d77f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:53.177724 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750092c5-9fa3-4f7e-9e8e-ecd2ef1d77f4 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:53.209448 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8aea3-51cb-46a5-8d2c-12bf762644c7 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:53.217222 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56f606-0d71-41b5-af77-840e6ae44124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:53.218117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56f606-0d71-41b5-af77-840e6ae44124 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:53.218469 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56f606-0d71-41b5-af77-840e6ae44124 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:53.218818 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56f606-0d71-41b5-af77-840e6ae44124 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:53.219675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56f606-0d71-41b5-af77-840e6ae44124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:53.222556 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56f606-0d71-41b5-af77-840e6ae44124 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:53.297792 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805394c6-6f92-4f36-bfbb-3b72d5f7be8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:53.298614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805394c6-6f92-4f36-bfbb-3b72d5f7be8d admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:53.298814 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805394c6-6f92-4f36-bfbb-3b72d5f7be8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:53.299031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805394c6-6f92-4f36-bfbb-3b72d5f7be8d admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:53.299810 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805394c6-6f92-4f36-bfbb-3b72d5f7be8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:53.301479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805394c6-6f92-4f36-bfbb-3b72d5f7be8d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:53.313764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 982/1947] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:57:53.317821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805394c6-6f92-4f36-bfbb-3b72d5f7be8d admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:53.328744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805394c6-6f92-4f36-bfbb-3b72d5f7be8d admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:53.334257 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c2d2e-e54d-4922-8152-50526048e1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:53.335332 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c2d2e-e54d-4922-8152-50526048e1fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:53.335619 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c2d2e-e54d-4922-8152-50526048e1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:53.335904 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c2d2e-e54d-4922-8152-50526048e1fa admin admin] PATH_INFO: `/v3/projects/2b367b938099440aadc04dd2136f0844/users/5d3a3a07e0ef44bd981ee0cd5efd22a2/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:53.352063 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c2d2e-e54d-4922-8152-50526048e1fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b367b938099440aadc04dd2136f0844, user_id=5d3a3a07e0ef44bd981ee0cd5efd22a2, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:53.354871 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c2d2e-e54d-4922-8152-50526048e1fa admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:53.364704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 966/1948] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:53 2022] POST /identity/v3/users => generated 294 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:53.368816 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56f606-0d71-41b5-af77-840e6ae44124 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:53.379743 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56f606-0d71-41b5-af77-840e6ae44124 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:53.385282 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501f4e6-11ff-402f-b7bb-f7a8755b119f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:53.386049 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501f4e6-11ff-402f-b7bb-f7a8755b119f admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:53.386253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501f4e6-11ff-402f-b7bb-f7a8755b119f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:53.386537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501f4e6-11ff-402f-b7bb-f7a8755b119f admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:53.387384 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501f4e6-11ff-402f-b7bb-f7a8755b119f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:53.389104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501f4e6-11ff-402f-b7bb-f7a8755b119f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:53.399985 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 967/1949] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:53.404590 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501f4e6-11ff-402f-b7bb-f7a8755b119f admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:53.419376 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501f4e6-11ff-402f-b7bb-f7a8755b119f admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:53.424636 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c32db4-21b8-46b1-ae50-84bd83b63f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:53.425392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c32db4-21b8-46b1-ae50-84bd83b63f30 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:53.425684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c32db4-21b8-46b1-ae50-84bd83b63f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:53.425967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c32db4-21b8-46b1-ae50-84bd83b63f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:53.426718 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c32db4-21b8-46b1-ae50-84bd83b63f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:53.428412 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c32db4-21b8-46b1-ae50-84bd83b63f30 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:53.441751 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 968/1950] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:57:53.446110 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c32db4-21b8-46b1-ae50-84bd83b63f30 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:53.456965 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 983/1951] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:53 2022] PUT /identity/v3/projects/2b367b938099440aadc04dd2136f0844/users/5d3a3a07e0ef44bd981ee0cd5efd22a2/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:57:53.459950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c32db4-21b8-46b1-ae50-84bd83b63f30 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:53.461139 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c2d2e-e54d-4922-8152-50526048e1fa admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:53.644917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35facb55-50c2-432d-b1ac-d8409479b8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:53.648963 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35facb55-50c2-432d-b1ac-d8409479b8ae admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:53.649194 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35facb55-50c2-432d-b1ac-d8409479b8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:53.649482 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35facb55-50c2-432d-b1ac-d8409479b8ae admin admin] PATH_INFO: `/v3/projects/dfa71b6d1d0544aabde8b29e2ed617aa/users/2b9895792d9a4bfc83b42f5134ed9a35/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:53.651011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c2d2e-e54d-4922-8152-50526048e1fa admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:53.663320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd0e49-475f-4dee-9dcb-81ed1c3f9221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:53.664149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd0e49-475f-4dee-9dcb-81ed1c3f9221 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:53.664712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd0e49-475f-4dee-9dcb-81ed1c3f9221 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:53.665073 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd0e49-475f-4dee-9dcb-81ed1c3f9221 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:53.666104 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd0e49-475f-4dee-9dcb-81ed1c3f9221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:53.668211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd0e49-475f-4dee-9dcb-81ed1c3f9221 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:53.674424 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35facb55-50c2-432d-b1ac-d8409479b8ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa71b6d1d0544aabde8b29e2ed617aa, user_id=2b9895792d9a4bfc83b42f5134ed9a35, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:53.678678 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35facb55-50c2-432d-b1ac-d8409479b8ae admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:53.680335 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 984/1952] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:53.685191 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd0e49-475f-4dee-9dcb-81ed1c3f9221 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:53.695832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd0e49-475f-4dee-9dcb-81ed1c3f9221 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:53.708357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2006a0-41ce-4044-ad7c-28f9c6cf23bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:53.709339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2006a0-41ce-4044-ad7c-28f9c6cf23bc admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:53.709615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2006a0-41ce-4044-ad7c-28f9c6cf23bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:53.709926 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2006a0-41ce-4044-ad7c-28f9c6cf23bc admin admin] PATH_INFO: `/v3/projects/2b367b938099440aadc04dd2136f0844/users/5d3a3a07e0ef44bd981ee0cd5efd22a2/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:53.716110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2006a0-41ce-4044-ad7c-28f9c6cf23bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b367b938099440aadc04dd2136f0844, user_id=5d3a3a07e0ef44bd981ee0cd5efd22a2, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:53.719165 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2006a0-41ce-4044-ad7c-28f9c6cf23bc admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:53.748173 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 985/1953] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:53 2022] PUT /identity/v3/projects/2b367b938099440aadc04dd2136f0844/users/5d3a3a07e0ef44bd981ee0cd5efd22a2/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:53.750223 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6e8df-d0a8-49ff-84d6-9922c0bc9035 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:53.750520 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6e8df-d0a8-49ff-84d6-9922c0bc9035 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:53.751122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6e8df-d0a8-49ff-84d6-9922c0bc9035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:53.784060 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-5bd6e8df-d0a8-49ff-84d6-9922c0bc9035 None None] MFA Rules not processed for user `5d3a3a07e0ef44bd981ee0cd5efd22a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:53.785334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5bd6e8df-d0a8-49ff-84d6-9922c0bc9035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:53.846661 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 969/1954] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:53 2022] PUT /identity/v3/projects/dfa71b6d1d0544aabde8b29e2ed617aa/users/2b9895792d9a4bfc83b42f5134ed9a35/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:53.858532 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded78a7d-e55d-4690-a8aa-20b6f7a50f15 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:53.858960 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded78a7d-e55d-4690-a8aa-20b6f7a50f15 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:53.859351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded78a7d-e55d-4690-a8aa-20b6f7a50f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:53.874391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:53.880892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 986/1955] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:57:53.882745 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6e8df-d0a8-49ff-84d6-9922c0bc9035 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:53.889674 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5bd6e8df-d0a8-49ff-84d6-9922c0bc9035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:53.939579 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-ded78a7d-e55d-4690-a8aa-20b6f7a50f15 None None] MFA Rules not processed for user `2b9895792d9a4bfc83b42f5134ed9a35`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:53.940930 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ded78a7d-e55d-4690-a8aa-20b6f7a50f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:53.972287 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6e8df-d0a8-49ff-84d6-9922c0bc9035 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:54.027242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 970/1956] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:54.028628 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded78a7d-e55d-4690-a8aa-20b6f7a50f15 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:54.031543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ded78a7d-e55d-4690-a8aa-20b6f7a50f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:54.035290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac89bfd-2321-4460-9dab-cddffa7d4da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:54.036163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac89bfd-2321-4460-9dab-cddffa7d4da5 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:54.036291 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac89bfd-2321-4460-9dab-cddffa7d4da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:54.036508 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac89bfd-2321-4460-9dab-cddffa7d4da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:54.120374 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded78a7d-e55d-4690-a8aa-20b6f7a50f15 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:54.125608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac89bfd-2321-4460-9dab-cddffa7d4da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:54.126394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333961dd-4eb4-41e1-b2e5-954290e5364a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:54.127269 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac89bfd-2321-4460-9dab-cddffa7d4da5 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:54.127377 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333961dd-4eb4-41e1-b2e5-954290e5364a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:54.128626 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333961dd-4eb4-41e1-b2e5-954290e5364a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:54.128736 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333961dd-4eb4-41e1-b2e5-954290e5364a admin admin] PATH_INFO: `/v3/projects/cf2d4c693839456fb5ea1fece6182c83` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:54.129920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333961dd-4eb4-41e1-b2e5-954290e5364a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2d4c693839456fb5ea1fece6182c83)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:54.131893 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333961dd-4eb4-41e1-b2e5-954290e5364a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:54.138511 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 987/1957] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:54.139329 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac89bfd-2321-4460-9dab-cddffa7d4da5 service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:54.150355 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac89bfd-2321-4460-9dab-cddffa7d4da5 service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:54.158705 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df7df1-bdfa-4937-aa63-f8a927e65d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:54.160204 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df7df1-bdfa-4937-aa63-f8a927e65d00 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:54.160204 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df7df1-bdfa-4937-aa63-f8a927e65d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:54.160703 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df7df1-bdfa-4937-aa63-f8a927e65d00 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:54.161486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df7df1-bdfa-4937-aa63-f8a927e65d00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:54.163605 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df7df1-bdfa-4937-aa63-f8a927e65d00 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:54.269918 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-333961dd-4eb4-41e1-b2e5-954290e5364a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2d4c693839456fb5ea1fece6182c83', 'request_id': 'req-333961dd-4eb4-41e1-b2e5-954290e5364a'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:54.275526 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-333961dd-4eb4-41e1-b2e5-954290e5364a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2d4c693839456fb5ea1fece6182c83', 'request_id': 'req-333961dd-4eb4-41e1-b2e5-954290e5364a'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:54.283551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-333961dd-4eb4-41e1-b2e5-954290e5364a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2d4c693839456fb5ea1fece6182c83', 'request_id': 'req-333961dd-4eb4-41e1-b2e5-954290e5364a'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:54.338113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 988/1958] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:54 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:54.340924 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df7df1-bdfa-4937-aa63-f8a927e65d00 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:54.408913 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-333961dd-4eb4-41e1-b2e5-954290e5364a admin admin] The token cache is being invalidate because project cf2d4c693839456fb5ea1fece6182c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:54.410547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-333961dd-4eb4-41e1-b2e5-954290e5364a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:54.412889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-333961dd-4eb4-41e1-b2e5-954290e5364a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:54.416596 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 971/1959] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:54 2022] DELETE /identity/v3/projects/cf2d4c693839456fb5ea1fece6182c83 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:54.419499 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333961dd-4eb4-41e1-b2e5-954290e5364a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:54.427143 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df7df1-bdfa-4937-aa63-f8a927e65d00 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:54.428786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-333961dd-4eb4-41e1-b2e5-954290e5364a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:54.433684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b80fb6-5ea8-41e8-b6b1-175f6c57823c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:54.434706 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b80fb6-5ea8-41e8-b6b1-175f6c57823c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:54.435025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b80fb6-5ea8-41e8-b6b1-175f6c57823c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:54.435308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b80fb6-5ea8-41e8-b6b1-175f6c57823c admin admin] PATH_INFO: `/v3/users/e240c209dfe74332a365b4626f7e4b80` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:54.436727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b80fb6-5ea8-41e8-b6b1-175f6c57823c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e240c209dfe74332a365b4626f7e4b80)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:54.439001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b80fb6-5ea8-41e8-b6b1-175f6c57823c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:54.514848 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333961dd-4eb4-41e1-b2e5-954290e5364a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:54.519709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a336197-1b31-4b59-a1f7-5dd94371a926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:54.520422 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a336197-1b31-4b59-a1f7-5dd94371a926 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:54.520717 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a336197-1b31-4b59-a1f7-5dd94371a926 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:54.521001 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a336197-1b31-4b59-a1f7-5dd94371a926 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:54.521829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a336197-1b31-4b59-a1f7-5dd94371a926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:54.523801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a336197-1b31-4b59-a1f7-5dd94371a926 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:55.094441 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 972/1960] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:54 2022] POST /identity/v3/users => generated 300 bytes in 677 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:55.097888 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b73f7-8eda-40d1-9398-f4f01b3af187 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:55.097888 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b73f7-8eda-40d1-9398-f4f01b3af187 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:55.097888 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b73f7-8eda-40d1-9398-f4f01b3af187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:55.114749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b19b73f7-8eda-40d1-9398-f4f01b3af187 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:55.115957 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b19b73f7-8eda-40d1-9398-f4f01b3af187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:55.124863 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 973/1961] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:55.125987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b73f7-8eda-40d1-9398-f4f01b3af187 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:55.135951 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b73f7-8eda-40d1-9398-f4f01b3af187 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:55.140963 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7029d-d645-42ae-aace-d05ce23eab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:55.141622 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7029d-d645-42ae-aace-d05ce23eab3a admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:55.141901 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7029d-d645-42ae-aace-d05ce23eab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:55.142182 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7029d-d645-42ae-aace-d05ce23eab3a admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:55.142959 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7029d-d645-42ae-aace-d05ce23eab3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:55.144576 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7029d-d645-42ae-aace-d05ce23eab3a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:55.154497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 974/1962] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:55.155644 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f536ce0-dd92-4136-afdf-4cbda9e24f7a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:55.155933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f536ce0-dd92-4136-afdf-4cbda9e24f7a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:55.156211 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f536ce0-dd92-4136-afdf-4cbda9e24f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:55.173805 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4f536ce0-dd92-4136-afdf-4cbda9e24f7a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:55.218548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4f536ce0-dd92-4136-afdf-4cbda9e24f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:55.219461 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-60b80fb6-5ea8-41e8-b6b1-175f6c57823c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e240c209dfe74332a365b4626f7e4b80'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:55.219461 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-60b80fb6-5ea8-41e8-b6b1-175f6c57823c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e240c209dfe74332a365b4626f7e4b80'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:55.219666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 975/1963] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:55.219666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f536ce0-dd92-4136-afdf-4cbda9e24f7a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:55.219666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f536ce0-dd92-4136-afdf-4cbda9e24f7a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:55.219666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be6c5b-eb3a-45cd-8aae-b486f18c4b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:55.220002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be6c5b-eb3a-45cd-8aae-b486f18c4b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:55.220002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be6c5b-eb3a-45cd-8aae-b486f18c4b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:55.220002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be6c5b-eb3a-45cd-8aae-b486f18c4b24 admin admin] PATH_INFO: `/v3/projects/02ddb0ec037545e5b6fae23d91288d3c/users/c302d698765e4bd19b57ca5d07f62bc6/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:55.220002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be6c5b-eb3a-45cd-8aae-b486f18c4b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ddb0ec037545e5b6fae23d91288d3c, user_id=c302d698765e4bd19b57ca5d07f62bc6, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:55.220002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be6c5b-eb3a-45cd-8aae-b486f18c4b24 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:55.631022 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-60b80fb6-5ea8-41e8-b6b1-175f6c57823c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e240c209dfe74332a365b4626f7e4b80'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:55.638996 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 976/1964] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:55 2022] PUT /identity/v3/projects/02ddb0ec037545e5b6fae23d91288d3c/users/c302d698765e4bd19b57ca5d07f62bc6/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:55.642300 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be6c5b-eb3a-45cd-8aae-b486f18c4b24 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:55.642300 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-24be6c5b-eb3a-45cd-8aae-b486f18c4b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:55.646528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-60b80fb6-5ea8-41e8-b6b1-175f6c57823c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e240c209dfe74332a365b4626f7e4b80'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:55.647583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-60b80fb6-5ea8-41e8-b6b1-175f6c57823c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e240c209dfe74332a365b4626f7e4b80'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:55.676840 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 989/1965] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:54 2022] DELETE /identity/v3/users/e240c209dfe74332a365b4626f7e4b80 => generated 0 bytes in 1337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:55.677715 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b80fb6-5ea8-41e8-b6b1-175f6c57823c admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:55.679907 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-60b80fb6-5ea8-41e8-b6b1-175f6c57823c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:55.725801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be6c5b-eb3a-45cd-8aae-b486f18c4b24 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:55.761276 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b80fb6-5ea8-41e8-b6b1-175f6c57823c admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:55.769688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a5bff-8a5e-4009-a335-8814247577bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:55.770757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a5bff-8a5e-4009-a335-8814247577bc admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:55.771097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a5bff-8a5e-4009-a335-8814247577bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:55.771429 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a5bff-8a5e-4009-a335-8814247577bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:55.772623 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a5bff-8a5e-4009-a335-8814247577bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:55.773969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a5bff-8a5e-4009-a335-8814247577bc admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:55.788610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 990/1966] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:55.793565 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abe71e-aa29-404d-9167-62c7bae19d0f None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:55.793565 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abe71e-aa29-404d-9167-62c7bae19d0f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:55.793565 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abe71e-aa29-404d-9167-62c7bae19d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:55.793835 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafd890-862b-4128-8c2a-bad03a5e946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:55.793835 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafd890-862b-4128-8c2a-bad03a5e946c admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:55.793835 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafd890-862b-4128-8c2a-bad03a5e946c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:55.793835 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafd890-862b-4128-8c2a-bad03a5e946c admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:55.794154 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafd890-862b-4128-8c2a-bad03a5e946c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:57:55.794313 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafd890-862b-4128-8c2a-bad03a5e946c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:55.795928 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafd890-862b-4128-8c2a-bad03a5e946c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:55.811187 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 977/1967] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:57:55.811187 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafd890-862b-4128-8c2a-bad03a5e946c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:55.819004 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-d9abe71e-aa29-404d-9167-62c7bae19d0f None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:55.819004 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-d9abe71e-aa29-404d-9167-62c7bae19d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:55.824419 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafd890-862b-4128-8c2a-bad03a5e946c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:55.830372 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 991/1968] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:55.830372 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abe71e-aa29-404d-9167-62c7bae19d0f None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:55.841970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac19735-a956-4efe-9571-ae485413ae68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:55.842913 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac19735-a956-4efe-9571-ae485413ae68 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:55.843006 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac19735-a956-4efe-9571-ae485413ae68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:55.843326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac19735-a956-4efe-9571-ae485413ae68 admin admin] PATH_INFO: `/v3/projects/02ddb0ec037545e5b6fae23d91288d3c/users/c302d698765e4bd19b57ca5d07f62bc6/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:55.845885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac19735-a956-4efe-9571-ae485413ae68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ddb0ec037545e5b6fae23d91288d3c, user_id=c302d698765e4bd19b57ca5d07f62bc6, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:55.846972 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abe71e-aa29-404d-9167-62c7bae19d0f None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:55.849266 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac19735-a956-4efe-9571-ae485413ae68 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:55.853334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9ac59-efbc-4222-9038-f0dd22935c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:55.856556 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9ac59-efbc-4222-9038-f0dd22935c22 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:55.856942 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9ac59-efbc-4222-9038-f0dd22935c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:55.857233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9ac59-efbc-4222-9038-f0dd22935c22 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:55.858255 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9ac59-efbc-4222-9038-f0dd22935c22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:55.860371 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9ac59-efbc-4222-9038-f0dd22935c22 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:55.863362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 978/1969] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:55 2022] PUT /identity/v3/projects/02ddb0ec037545e5b6fae23d91288d3c/users/c302d698765e4bd19b57ca5d07f62bc6/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:55.864643 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac19735-a956-4efe-9571-ae485413ae68 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:55.874828 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8ac19735-a956-4efe-9571-ae485413ae68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:55.937501 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac19735-a956-4efe-9571-ae485413ae68 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:55.941488 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfa934-c74d-456f-bd12-ea23bd1fef09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:55.942387 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfa934-c74d-456f-bd12-ea23bd1fef09 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:55.942521 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfa934-c74d-456f-bd12-ea23bd1fef09 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:55.942705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfa934-c74d-456f-bd12-ea23bd1fef09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:55.960330 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:56.016398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 992/1970] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:55 2022] POST /identity/v3/projects => generated 365 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:56.018545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ec352-5e69-4c0e-a9f2-0b38caaa1eec None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:56.019062 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ec352-5e69-4c0e-a9f2-0b38caaa1eec None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:56.020105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ec352-5e69-4c0e-a9f2-0b38caaa1eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:56.021864 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfa934-c74d-456f-bd12-ea23bd1fef09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:56.023321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfa934-c74d-456f-bd12-ea23bd1fef09 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:56.035487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 979/1971] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:56.036258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfa934-c74d-456f-bd12-ea23bd1fef09 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:56.048123 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfa934-c74d-456f-bd12-ea23bd1fef09 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:56.056373 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-119ec352-5e69-4c0e-a9f2-0b38caaa1eec None None] MFA Rules not processed for user `c302d698765e4bd19b57ca5d07f62bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:56.064989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-119ec352-5e69-4c0e-a9f2-0b38caaa1eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:56.121777 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad0139-a46f-490a-9a08-965bfb543edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:56.122509 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad0139-a46f-490a-9a08-965bfb543edd admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:56.122741 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad0139-a46f-490a-9a08-965bfb543edd admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:56.123018 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad0139-a46f-490a-9a08-965bfb543edd admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:56.123718 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad0139-a46f-490a-9a08-965bfb543edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:56.125769 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad0139-a46f-490a-9a08-965bfb543edd admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:56.163808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 993/1972] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:56.171587 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ec352-5e69-4c0e-a9f2-0b38caaa1eec None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:56.173306 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-119ec352-5e69-4c0e-a9f2-0b38caaa1eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:56.240382 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ec352-5e69-4c0e-a9f2-0b38caaa1eec None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:56.245124 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28855961-b4f6-471e-8289-fbf258db3962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:56.247354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28855961-b4f6-471e-8289-fbf258db3962 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:56.247354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28855961-b4f6-471e-8289-fbf258db3962 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:56.247354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28855961-b4f6-471e-8289-fbf258db3962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:56.261252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28855961-b4f6-471e-8289-fbf258db3962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:56.263001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28855961-b4f6-471e-8289-fbf258db3962 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:56.278607 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 994/1973] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:57:56.288316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 980/1974] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:56 2022] POST /identity/v3/users => generated 283 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:56.291809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28855961-b4f6-471e-8289-fbf258db3962 service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:56.304445 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28855961-b4f6-471e-8289-fbf258db3962 service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:56.315434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed97922-874e-4a06-8753-88f97fbbf7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:56.321880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed97922-874e-4a06-8753-88f97fbbf7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:56.321880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed97922-874e-4a06-8753-88f97fbbf7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:56.321880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed97922-874e-4a06-8753-88f97fbbf7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:56.321880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed97922-874e-4a06-8753-88f97fbbf7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:56.321880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed97922-874e-4a06-8753-88f97fbbf7f5 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:56.335523 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 995/1975] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:56.339479 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad0139-a46f-490a-9a08-965bfb543edd admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:56.345789 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:56.356682 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad0139-a46f-490a-9a08-965bfb543edd admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:56.359939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed97922-874e-4a06-8753-88f97fbbf7f5 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:56.362296 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5ed97922-874e-4a06-8753-88f97fbbf7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:56.378129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98405a52-4e13-46b2-8ce1-903d6df717a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:56.378129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98405a52-4e13-46b2-8ce1-903d6df717a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:56.378129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98405a52-4e13-46b2-8ce1-903d6df717a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:56.378129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98405a52-4e13-46b2-8ce1-903d6df717a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:56.378476 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98405a52-4e13-46b2-8ce1-903d6df717a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:56.380065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98405a52-4e13-46b2-8ce1-903d6df717a4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:56.386862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed97922-874e-4a06-8753-88f97fbbf7f5 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:56.408126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 981/1976] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:56.408228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b459e-9d91-4404-8618-546b5a486bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:56.408228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b459e-9d91-4404-8618-546b5a486bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:56.408228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b459e-9d91-4404-8618-546b5a486bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:56.408228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b459e-9d91-4404-8618-546b5a486bf3 admin admin] PATH_INFO: `/v3/users/7e0f6f00a9744fcfb48585e6d15d3d80` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:56.408547 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b459e-9d91-4404-8618-546b5a486bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e0f6f00a9744fcfb48585e6d15d3d80)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:56.408547 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b459e-9d91-4404-8618-546b5a486bf3 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:56.411968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98405a52-4e13-46b2-8ce1-903d6df717a4 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:56.427715 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98405a52-4e13-46b2-8ce1-903d6df717a4 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:56.435302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185afee-773a-47ac-a735-e99246457118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:56.436827 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185afee-773a-47ac-a735-e99246457118 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:56.437295 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185afee-773a-47ac-a735-e99246457118 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:56.437749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185afee-773a-47ac-a735-e99246457118 admin admin] PATH_INFO: `/v3/projects/592da9db9cfb44fc840df37cc89828e4/users/2e14ab941bb94320ab7c5f3bf571cea0/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:56.462258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185afee-773a-47ac-a735-e99246457118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=592da9db9cfb44fc840df37cc89828e4, user_id=2e14ab941bb94320ab7c5f3bf571cea0, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:56.466426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185afee-773a-47ac-a735-e99246457118 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:56.610788 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 982/1977] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:56 2022] PUT /identity/v3/projects/592da9db9cfb44fc840df37cc89828e4/users/2e14ab941bb94320ab7c5f3bf571cea0/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:56.622201 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf328b-be7f-42ff-aefa-1baa9a2b319e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:56.622592 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf328b-be7f-42ff-aefa-1baa9a2b319e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:56.622948 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf328b-be7f-42ff-aefa-1baa9a2b319e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:56.655062 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-1cdf328b-be7f-42ff-aefa-1baa9a2b319e None None] MFA Rules not processed for user `2e14ab941bb94320ab7c5f3bf571cea0`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:56.656426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1cdf328b-be7f-42ff-aefa-1baa9a2b319e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:56.675426 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-af1b459e-9d91-4404-8618-546b5a486bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e0f6f00a9744fcfb48585e6d15d3d80'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:56.676680 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-af1b459e-9d91-4404-8618-546b5a486bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e0f6f00a9744fcfb48585e6d15d3d80'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:56.737028 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 983/1978] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:56.740478 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf328b-be7f-42ff-aefa-1baa9a2b319e None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:56.740478 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1cdf328b-be7f-42ff-aefa-1baa9a2b319e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:56.778477 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-af1b459e-9d91-4404-8618-546b5a486bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e0f6f00a9744fcfb48585e6d15d3d80'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:56.795159 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-af1b459e-9d91-4404-8618-546b5a486bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e0f6f00a9744fcfb48585e6d15d3d80'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:56.796185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-af1b459e-9d91-4404-8618-546b5a486bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e0f6f00a9744fcfb48585e6d15d3d80'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:56.831907 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf328b-be7f-42ff-aefa-1baa9a2b319e None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:56.843381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434660a-7152-4548-a94f-2b802d4aebbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:56.845307 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434660a-7152-4548-a94f-2b802d4aebbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:56.845851 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434660a-7152-4548-a94f-2b802d4aebbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:56.846942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434660a-7152-4548-a94f-2b802d4aebbb admin admin] PATH_INFO: `/v3/projects/f218547b0fae4e69968e4d4042418097` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:56.850052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 996/1979] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:56 2022] DELETE /identity/v3/users/7e0f6f00a9744fcfb48585e6d15d3d80 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:57:56.850366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434660a-7152-4548-a94f-2b802d4aebbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f218547b0fae4e69968e4d4042418097)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:56.851042 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b459e-9d91-4404-8618-546b5a486bf3 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:56.852378 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434660a-7152-4548-a94f-2b802d4aebbb admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:56.852539 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-af1b459e-9d91-4404-8618-546b5a486bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:56.940450 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b459e-9d91-4404-8618-546b5a486bf3 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:56.945390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2fb54-c9b9-4ccf-9cd9-ff4250427039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:56.946187 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2fb54-c9b9-4ccf-9cd9-ff4250427039 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:56.946575 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2fb54-c9b9-4ccf-9cd9-ff4250427039 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:56.946925 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2fb54-c9b9-4ccf-9cd9-ff4250427039 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:56.948165 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2fb54-c9b9-4ccf-9cd9-ff4250427039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:56.952053 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2fb54-c9b9-4ccf-9cd9-ff4250427039 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:57.065077 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-1434660a-7152-4548-a94f-2b802d4aebbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f218547b0fae4e69968e4d4042418097', 'request_id': 'req-1434660a-7152-4548-a94f-2b802d4aebbb'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.070537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-1434660a-7152-4548-a94f-2b802d4aebbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f218547b0fae4e69968e4d4042418097', 'request_id': 'req-1434660a-7152-4548-a94f-2b802d4aebbb'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.076791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-1434660a-7152-4548-a94f-2b802d4aebbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f218547b0fae4e69968e4d4042418097', 'request_id': 'req-1434660a-7152-4548-a94f-2b802d4aebbb'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.087461 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 997/1980] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:56 2022] POST /identity/v3/projects => generated 365 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:57.087461 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ce530-841d-492f-bee1-21c716a3bb69 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:57.087461 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ce530-841d-492f-bee1-21c716a3bb69 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:57.087461 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ce530-841d-492f-bee1-21c716a3bb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:57.106188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-6f1ce530-841d-492f-bee1-21c716a3bb69 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:57.112495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6f1ce530-841d-492f-bee1-21c716a3bb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:57.166917 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 998/1981] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:57.169172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ce530-841d-492f-bee1-21c716a3bb69 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:57.180769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ce530-841d-492f-bee1-21c716a3bb69 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:57.186414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-1434660a-7152-4548-a94f-2b802d4aebbb admin admin] The token cache is being invalidate because project f218547b0fae4e69968e4d4042418097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:57.186414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-1434660a-7152-4548-a94f-2b802d4aebbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.186414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-1434660a-7152-4548-a94f-2b802d4aebbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.186414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 984/1982] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:56 2022] DELETE /identity/v3/projects/f218547b0fae4e69968e4d4042418097 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:57.187247 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ba570-ec68-44a5-975f-0908b031b097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:57.187363 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434660a-7152-4548-a94f-2b802d4aebbb admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:57.187459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ba570-ec68-44a5-975f-0908b031b097 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:57.187723 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ba570-ec68-44a5-975f-0908b031b097 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:57.188180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ba570-ec68-44a5-975f-0908b031b097 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:57.189021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ba570-ec68-44a5-975f-0908b031b097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:57.189830 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1434660a-7152-4548-a94f-2b802d4aebbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:57.191160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ba570-ec68-44a5-975f-0908b031b097 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:57.249431 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434660a-7152-4548-a94f-2b802d4aebbb admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:57.301844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d910d-778b-4e74-8ea8-1562c3bca395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:57.301844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d910d-778b-4e74-8ea8-1562c3bca395 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:57.301844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d910d-778b-4e74-8ea8-1562c3bca395 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:57.301844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d910d-778b-4e74-8ea8-1562c3bca395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:57.303456 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8f3d910d-778b-4e74-8ea8-1562c3bca395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:57.316286 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d910d-778b-4e74-8ea8-1562c3bca395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:57.317504 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d910d-778b-4e74-8ea8-1562c3bca395 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:57.331227 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 985/1983] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:57.331227 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d910d-778b-4e74-8ea8-1562c3bca395 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:57.331227 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8f3d910d-778b-4e74-8ea8-1562c3bca395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:57.344255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d910d-778b-4e74-8ea8-1562c3bca395 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:57.349095 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03478957-ee52-4e6e-b168-10176524fbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:57.349976 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03478957-ee52-4e6e-b168-10176524fbf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:57.350258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03478957-ee52-4e6e-b168-10176524fbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:57.350531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03478957-ee52-4e6e-b168-10176524fbf1 admin admin] PATH_INFO: `/v3/users/5d3a3a07e0ef44bd981ee0cd5efd22a2` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:57.351812 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03478957-ee52-4e6e-b168-10176524fbf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d3a3a07e0ef44bd981ee0cd5efd22a2)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:57.353793 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03478957-ee52-4e6e-b168-10176524fbf1 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:57.362674 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 999/1984] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:57 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:57.367698 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ba570-ec68-44a5-975f-0908b031b097 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:57.370014 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-db4ba570-ec68-44a5-975f-0908b031b097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:57.390572 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ba570-ec68-44a5-975f-0908b031b097 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:57.396853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e7db5-ad5a-4fba-8752-4b1a2bbdcdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:57.396985 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e7db5-ad5a-4fba-8752-4b1a2bbdcdd6 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:57.397514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e7db5-ad5a-4fba-8752-4b1a2bbdcdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:57.397864 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e7db5-ad5a-4fba-8752-4b1a2bbdcdd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:57.398721 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e7db5-ad5a-4fba-8752-4b1a2bbdcdd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:57.400786 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e7db5-ad5a-4fba-8752-4b1a2bbdcdd6 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:57.417106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1000/1985] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:57.418405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e7db5-ad5a-4fba-8752-4b1a2bbdcdd6 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:57.430112 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e7db5-ad5a-4fba-8752-4b1a2bbdcdd6 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:57.435625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf167-bc39-4f08-a806-2b47690fa28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:57.439826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf167-bc39-4f08-a806-2b47690fa28e admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:57.439826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf167-bc39-4f08-a806-2b47690fa28e admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:57.439826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf167-bc39-4f08-a806-2b47690fa28e admin admin] PATH_INFO: `/v3/projects/5917d868ca9c4924abf8cb61a2579a90/users/aa1d9d93867b4f7989c4baf4c852d8e0/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:57.478006 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bf167-bc39-4f08-a806-2b47690fa28e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5917d868ca9c4924abf8cb61a2579a90, user_id=aa1d9d93867b4f7989c4baf4c852d8e0, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:57.484801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bf167-bc39-4f08-a806-2b47690fa28e admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:57.574908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:57.632535 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1001/1986] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:57 2022] PUT /identity/v3/projects/5917d868ca9c4924abf8cb61a2579a90/users/aa1d9d93867b4f7989c4baf4c852d8e0/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:57.634557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf167-bc39-4f08-a806-2b47690fa28e admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:57.650465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-03478957-ee52-4e6e-b168-10176524fbf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d3a3a07e0ef44bd981ee0cd5efd22a2'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.654514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-03478957-ee52-4e6e-b168-10176524fbf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d3a3a07e0ef44bd981ee0cd5efd22a2'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.728001 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-03478957-ee52-4e6e-b168-10176524fbf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d3a3a07e0ef44bd981ee0cd5efd22a2'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.733195 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf167-bc39-4f08-a806-2b47690fa28e admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:57.736637 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-03478957-ee52-4e6e-b168-10176524fbf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d3a3a07e0ef44bd981ee0cd5efd22a2'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.740054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fc765-78a3-4cb5-a4fc-9a4f849e95ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:57.741121 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fc765-78a3-4cb5-a4fc-9a4f849e95ea admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:57.741700 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fc765-78a3-4cb5-a4fc-9a4f849e95ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:57.742129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fc765-78a3-4cb5-a4fc-9a4f849e95ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:57.743089 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fc765-78a3-4cb5-a4fc-9a4f849e95ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:57.745115 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fc765-78a3-4cb5-a4fc-9a4f849e95ea admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:57.754251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-03478957-ee52-4e6e-b168-10176524fbf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d3a3a07e0ef44bd981ee0cd5efd22a2'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.756874 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1002/1987] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:57.757827 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fc765-78a3-4cb5-a4fc-9a4f849e95ea admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:57.760186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b78fc765-78a3-4cb5-a4fc-9a4f849e95ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:57.762453 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 986/1988] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:57 2022] DELETE /identity/v3/users/5d3a3a07e0ef44bd981ee0cd5efd22a2 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:57.763312 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03478957-ee52-4e6e-b168-10176524fbf1 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:57.764765 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-03478957-ee52-4e6e-b168-10176524fbf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:57.865144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fc765-78a3-4cb5-a4fc-9a4f849e95ea admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:57.865837 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03478957-ee52-4e6e-b168-10176524fbf1 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:57.871570 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a788d49-e0dc-430b-9819-c990780df61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:57.872846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a788d49-e0dc-430b-9819-c990780df61f admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:57.873182 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a788d49-e0dc-430b-9819-c990780df61f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:57.873528 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a788d49-e0dc-430b-9819-c990780df61f admin admin] PATH_INFO: `/v3/projects/5917d868ca9c4924abf8cb61a2579a90/users/aa1d9d93867b4f7989c4baf4c852d8e0/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:57.875756 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a788d49-e0dc-430b-9819-c990780df61f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5917d868ca9c4924abf8cb61a2579a90, user_id=aa1d9d93867b4f7989c4baf4c852d8e0, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:57.887463 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a788d49-e0dc-430b-9819-c990780df61f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:57.926261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 987/1989] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:57 2022] PUT /identity/v3/projects/5917d868ca9c4924abf8cb61a2579a90/users/aa1d9d93867b4f7989c4baf4c852d8e0/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:57.938765 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b32bb2-d7a7-468a-a733-aceee3a61eca None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:57.939239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b32bb2-d7a7-468a-a733-aceee3a61eca None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:57.939524 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b32bb2-d7a7-468a-a733-aceee3a61eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:57.945976 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a63985-fbd4-4fc5-ab1f-03ad8eb4c73c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:57.946667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a63985-fbd4-4fc5-ab1f-03ad8eb4c73c service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:57.946951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a63985-fbd4-4fc5-ab1f-03ad8eb4c73c service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:57.947225 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a63985-fbd4-4fc5-ab1f-03ad8eb4c73c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:57.949753 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-72a63985-fbd4-4fc5-ab1f-03ad8eb4c73c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:58.002765 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-12b32bb2-d7a7-468a-a733-aceee3a61eca None None] MFA Rules not processed for user `aa1d9d93867b4f7989c4baf4c852d8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:58.004717 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-12b32bb2-d7a7-468a-a733-aceee3a61eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:58.063035 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a63985-fbd4-4fc5-ab1f-03ad8eb4c73c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:58.063035 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a63985-fbd4-4fc5-ab1f-03ad8eb4c73c service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:58.081102 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1003/1990] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:58.082557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a63985-fbd4-4fc5-ab1f-03ad8eb4c73c service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:58.085243 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-72a63985-fbd4-4fc5-ab1f-03ad8eb4c73c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:58.103306 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a63985-fbd4-4fc5-ab1f-03ad8eb4c73c service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:58.178647 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 988/1991] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:58.183507 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0ed91-a5a3-4eb2-9ed1-9a5f0044f7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:58.184692 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0ed91-a5a3-4eb2-9ed1-9a5f0044f7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:58.190040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0ed91-a5a3-4eb2-9ed1-9a5f0044f7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:58.190040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0ed91-a5a3-4eb2-9ed1-9a5f0044f7d4 admin admin] PATH_INFO: `/v3/projects/6a79899c1060407b896dcaa9fcea3978` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:58.190040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0ed91-a5a3-4eb2-9ed1-9a5f0044f7d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a79899c1060407b896dcaa9fcea3978)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:58.190040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0ed91-a5a3-4eb2-9ed1-9a5f0044f7d4 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:58.190439 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b32bb2-d7a7-468a-a733-aceee3a61eca None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:58.192674 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-12b32bb2-d7a7-468a-a733-aceee3a61eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:58.243235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:58.302129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b32bb2-d7a7-468a-a733-aceee3a61eca None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:58.330946 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-66d0ed91-a5a3-4eb2-9ed1-9a5f0044f7d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a79899c1060407b896dcaa9fcea3978', 'request_id': 'req-66d0ed91-a5a3-4eb2-9ed1-9a5f0044f7d4'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:58.377676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2a2f0-15f3-4ef6-b3d5-149d999d3d2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:58.382919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2a2f0-15f3-4ef6-b3d5-149d999d3d2c service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:58.382919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2a2f0-15f3-4ef6-b3d5-149d999d3d2c service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:58.382919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2a2f0-15f3-4ef6-b3d5-149d999d3d2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:58.430685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-66d0ed91-a5a3-4eb2-9ed1-9a5f0044f7d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a79899c1060407b896dcaa9fcea3978', 'request_id': 'req-66d0ed91-a5a3-4eb2-9ed1-9a5f0044f7d4'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:58.438769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-66d0ed91-a5a3-4eb2-9ed1-9a5f0044f7d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a79899c1060407b896dcaa9fcea3978', 'request_id': 'req-66d0ed91-a5a3-4eb2-9ed1-9a5f0044f7d4'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:58.450371 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-66d0ed91-a5a3-4eb2-9ed1-9a5f0044f7d4 admin admin] The token cache is being invalidate because project 6a79899c1060407b896dcaa9fcea3978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:58.450994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-66d0ed91-a5a3-4eb2-9ed1-9a5f0044f7d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:58.451844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-66d0ed91-a5a3-4eb2-9ed1-9a5f0044f7d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:58.453654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1004/1992] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:58 2022] DELETE /identity/v3/projects/6a79899c1060407b896dcaa9fcea3978 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:58.454467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2a2f0-15f3-4ef6-b3d5-149d999d3d2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:58.456225 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2a2f0-15f3-4ef6-b3d5-149d999d3d2c service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:58.458424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0ed91-a5a3-4eb2-9ed1-9a5f0044f7d4 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:58.460001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-66d0ed91-a5a3-4eb2-9ed1-9a5f0044f7d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:58.493336 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 989/1993] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:57:58.494601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2a2f0-15f3-4ef6-b3d5-149d999d3d2c service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:58.496654 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-33c2a2f0-15f3-4ef6-b3d5-149d999d3d2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:58.555289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0ed91-a5a3-4eb2-9ed1-9a5f0044f7d4 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:58.571203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a42739-e4bc-46da-bf97-34b72b25d942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:58.572723 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a42739-e4bc-46da-bf97-34b72b25d942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:58.573011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a42739-e4bc-46da-bf97-34b72b25d942 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:58.573353 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a42739-e4bc-46da-bf97-34b72b25d942 admin admin] PATH_INFO: `/v3/users/99ea37db24f54d94a9844a9ae4b970f1` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:58.575346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a42739-e4bc-46da-bf97-34b72b25d942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99ea37db24f54d94a9844a9ae4b970f1)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:58.580225 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a42739-e4bc-46da-bf97-34b72b25d942 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:58.609531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2a2f0-15f3-4ef6-b3d5-149d999d3d2c service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:58.615195 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44589117-b2b0-436f-a7b4-d6e8e39fa7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:58.615868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44589117-b2b0-436f-a7b4-d6e8e39fa7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:58.616311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44589117-b2b0-436f-a7b4-d6e8e39fa7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:58.617048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44589117-b2b0-436f-a7b4-d6e8e39fa7b6 admin admin] PATH_INFO: `/v3/projects/2b367b938099440aadc04dd2136f0844` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:58.618689 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44589117-b2b0-436f-a7b4-d6e8e39fa7b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b367b938099440aadc04dd2136f0844)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:58.622145 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44589117-b2b0-436f-a7b4-d6e8e39fa7b6 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:58.888992 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-44589117-b2b0-436f-a7b4-d6e8e39fa7b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b367b938099440aadc04dd2136f0844', 'request_id': 'req-44589117-b2b0-436f-a7b4-d6e8e39fa7b6'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:58.891719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-06a42739-e4bc-46da-bf97-34b72b25d942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99ea37db24f54d94a9844a9ae4b970f1'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:58.892504 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-06a42739-e4bc-46da-bf97-34b72b25d942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99ea37db24f54d94a9844a9ae4b970f1'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:58.895434 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-44589117-b2b0-436f-a7b4-d6e8e39fa7b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b367b938099440aadc04dd2136f0844', 'request_id': 'req-44589117-b2b0-436f-a7b4-d6e8e39fa7b6'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:58.901735 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-44589117-b2b0-436f-a7b4-d6e8e39fa7b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b367b938099440aadc04dd2136f0844', 'request_id': 'req-44589117-b2b0-436f-a7b4-d6e8e39fa7b6'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:58.983778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-06a42739-e4bc-46da-bf97-34b72b25d942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99ea37db24f54d94a9844a9ae4b970f1'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:58.992868 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-06a42739-e4bc-46da-bf97-34b72b25d942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99ea37db24f54d94a9844a9ae4b970f1'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:58.993774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-06a42739-e4bc-46da-bf97-34b72b25d942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99ea37db24f54d94a9844a9ae4b970f1'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:59.021516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1005/1994] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:58 2022] DELETE /identity/v3/users/99ea37db24f54d94a9844a9ae4b970f1 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:59.022563 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a42739-e4bc-46da-bf97-34b72b25d942 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:59.024161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-06a42739-e4bc-46da-bf97-34b72b25d942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:59.074964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-44589117-b2b0-436f-a7b4-d6e8e39fa7b6 admin admin] The token cache is being invalidate because project 2b367b938099440aadc04dd2136f0844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:59.075344 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-44589117-b2b0-436f-a7b4-d6e8e39fa7b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:59.077825 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-44589117-b2b0-436f-a7b4-d6e8e39fa7b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:59.078514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 990/1995] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:58 2022] DELETE /identity/v3/projects/2b367b938099440aadc04dd2136f0844 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:59.079111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44589117-b2b0-436f-a7b4-d6e8e39fa7b6 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:59.080910 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-44589117-b2b0-436f-a7b4-d6e8e39fa7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:59.107397 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a42739-e4bc-46da-bf97-34b72b25d942 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:59.111612 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff47ac-832d-4570-8b12-71549250415d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:59.112339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff47ac-832d-4570-8b12-71549250415d service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:59.112684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff47ac-832d-4570-8b12-71549250415d service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:59.112966 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff47ac-832d-4570-8b12-71549250415d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:59.114890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-d0ff47ac-832d-4570-8b12-71549250415d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:59.171712 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44589117-b2b0-436f-a7b4-d6e8e39fa7b6 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:59.196668 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff47ac-832d-4570-8b12-71549250415d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:59.198288 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff47ac-832d-4570-8b12-71549250415d service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:59.208735 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1006/1996] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:59.210181 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1cb58-8bd9-4b43-95cf-85773c75efc6 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:59.210485 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1cb58-8bd9-4b43-95cf-85773c75efc6 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:59.210802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1cb58-8bd9-4b43-95cf-85773c75efc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:59.230194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-00c1cb58-8bd9-4b43-95cf-85773c75efc6 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:59.231448 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-00c1cb58-8bd9-4b43-95cf-85773c75efc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:59.243627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c76b7-f4a7-4347-a796-aeb894e1d814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:59.248568 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c76b7-f4a7-4347-a796-aeb894e1d814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:59.248568 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c76b7-f4a7-4347-a796-aeb894e1d814 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:59.248568 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c76b7-f4a7-4347-a796-aeb894e1d814 admin admin] PATH_INFO: `/v3/users/33a3f9ebb97c48c8886666f6be5202a3` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:59.252995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c76b7-f4a7-4347-a796-aeb894e1d814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a3f9ebb97c48c8886666f6be5202a3)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:59.257004 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c76b7-f4a7-4347-a796-aeb894e1d814 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:59.272540 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:59.319382 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1007/1997] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:59.328078 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543930b7-90e3-458b-92a7-ac8845635c9f None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:59.328374 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543930b7-90e3-458b-92a7-ac8845635c9f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:59.328676 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543930b7-90e3-458b-92a7-ac8845635c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:59.347108 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-543930b7-90e3-458b-92a7-ac8845635c9f None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:59.348312 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-543930b7-90e3-458b-92a7-ac8845635c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:59.356780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1008/1998] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:57:59.360788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543930b7-90e3-458b-92a7-ac8845635c9f None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:59.373838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543930b7-90e3-458b-92a7-ac8845635c9f None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:59.378723 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d8436-de9b-47c7-9602-8037182baa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:59.379791 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d8436-de9b-47c7-9602-8037182baa99 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:59.379791 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d8436-de9b-47c7-9602-8037182baa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:59.379966 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d8436-de9b-47c7-9602-8037182baa99 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:59.380721 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d8436-de9b-47c7-9602-8037182baa99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:57:59.381031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d8436-de9b-47c7-9602-8037182baa99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:59.382913 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d8436-de9b-47c7-9602-8037182baa99 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:59.396206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1009/1999] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:57:59.399919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d8436-de9b-47c7-9602-8037182baa99 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:59.411002 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d8436-de9b-47c7-9602-8037182baa99 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:59.417383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd46665-846d-4d68-8256-e2d9f76350f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:59.418829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd46665-846d-4d68-8256-e2d9f76350f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:59.418927 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd46665-846d-4d68-8256-e2d9f76350f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:59.419471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd46665-846d-4d68-8256-e2d9f76350f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:59.421168 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd46665-846d-4d68-8256-e2d9f76350f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:59.423077 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd46665-846d-4d68-8256-e2d9f76350f8 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:59.508312 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fc6c76b7-f4a7-4347-a796-aeb894e1d814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a3f9ebb97c48c8886666f6be5202a3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:59.509213 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fc6c76b7-f4a7-4347-a796-aeb894e1d814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a3f9ebb97c48c8886666f6be5202a3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:59.531304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1010/2000] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:59 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:57:59.535717 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd46665-846d-4d68-8256-e2d9f76350f8 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:59.605919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fc6c76b7-f4a7-4347-a796-aeb894e1d814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a3f9ebb97c48c8886666f6be5202a3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:59.611268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd46665-846d-4d68-8256-e2d9f76350f8 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:59.612104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fc6c76b7-f4a7-4347-a796-aeb894e1d814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a3f9ebb97c48c8886666f6be5202a3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:59.616876 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81331387-630c-484b-aa69-b7026f1d73e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:59.617549 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81331387-630c-484b-aa69-b7026f1d73e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:59.617826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81331387-630c-484b-aa69-b7026f1d73e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:59.618108 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81331387-630c-484b-aa69-b7026f1d73e1 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:59.618809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81331387-630c-484b-aa69-b7026f1d73e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:59.625091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81331387-630c-484b-aa69-b7026f1d73e1 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:59.629820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fc6c76b7-f4a7-4347-a796-aeb894e1d814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a3f9ebb97c48c8886666f6be5202a3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:59.633251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 991/2001] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:59 2022] DELETE /identity/v3/users/33a3f9ebb97c48c8886666f6be5202a3 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:59.637270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c76b7-f4a7-4347-a796-aeb894e1d814 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:59.638655 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fc6c76b7-f4a7-4347-a796-aeb894e1d814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:59.707277 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c76b7-f4a7-4347-a796-aeb894e1d814 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:59.712050 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcd076-f82d-4ffe-8c00-ea0376acbdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:59.712967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcd076-f82d-4ffe-8c00-ea0376acbdca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:59.713328 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcd076-f82d-4ffe-8c00-ea0376acbdca admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:59.713653 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcd076-f82d-4ffe-8c00-ea0376acbdca admin admin] PATH_INFO: `/v3/projects/a67bcbe7fc95434c831f6e9cf7abd6fb` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:59.714860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fcd076-f82d-4ffe-8c00-ea0376acbdca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a67bcbe7fc95434c831f6e9cf7abd6fb)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:59.717137 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fcd076-f82d-4ffe-8c00-ea0376acbdca admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:59.737489 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:59.742433 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1011/2002] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:59 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:59.743557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81331387-630c-484b-aa69-b7026f1d73e1 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:59.750817 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-81331387-630c-484b-aa69-b7026f1d73e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:59.767466 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81331387-630c-484b-aa69-b7026f1d73e1 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:59.775088 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f8a7a-7538-4020-993a-2aa62d03ac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:59.776296 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f8a7a-7538-4020-993a-2aa62d03ac07 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:59.776680 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f8a7a-7538-4020-993a-2aa62d03ac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:59.777646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f8a7a-7538-4020-993a-2aa62d03ac07 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:59.778610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f8a7a-7538-4020-993a-2aa62d03ac07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:59.780914 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f8a7a-7538-4020-993a-2aa62d03ac07 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:59.797568 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1012/2003] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:59.801402 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f8a7a-7538-4020-993a-2aa62d03ac07 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:59.811823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f8a7a-7538-4020-993a-2aa62d03ac07 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:59.817564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0f5d0-fc4c-469b-83f7-4e67c179170b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:59.819563 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0f5d0-fc4c-469b-83f7-4e67c179170b admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:59.819844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0f5d0-fc4c-469b-83f7-4e67c179170b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:59.820122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0f5d0-fc4c-469b-83f7-4e67c179170b admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:59.820887 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0f5d0-fc4c-469b-83f7-4e67c179170b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:59.823155 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0f5d0-fc4c-469b-83f7-4e67c179170b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:59.836013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1013/2004] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:57:59.837991 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f1fcd076-f82d-4ffe-8c00-ea0376acbdca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a67bcbe7fc95434c831f6e9cf7abd6fb', 'request_id': 'req-f1fcd076-f82d-4ffe-8c00-ea0376acbdca'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:59.840305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0f5d0-fc4c-469b-83f7-4e67c179170b admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:59.843588 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f1fcd076-f82d-4ffe-8c00-ea0376acbdca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a67bcbe7fc95434c831f6e9cf7abd6fb', 'request_id': 'req-f1fcd076-f82d-4ffe-8c00-ea0376acbdca'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:59.850077 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f1fcd076-f82d-4ffe-8c00-ea0376acbdca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a67bcbe7fc95434c831f6e9cf7abd6fb', 'request_id': 'req-f1fcd076-f82d-4ffe-8c00-ea0376acbdca'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:59.850447 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0f5d0-fc4c-469b-83f7-4e67c179170b admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:59.907128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f134bda-a203-41d3-af34-ea95935418c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:59.908062 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f134bda-a203-41d3-af34-ea95935418c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:59.908347 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f134bda-a203-41d3-af34-ea95935418c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:59.915684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f134bda-a203-41d3-af34-ea95935418c7 admin admin] PATH_INFO: `/v3/projects/42b140f4931a48c9aed1c1e9e3ab280b/users/e3818b63658b4c7588db8b4c4a25f16c/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:59.923230 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f134bda-a203-41d3-af34-ea95935418c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b140f4931a48c9aed1c1e9e3ab280b, user_id=e3818b63658b4c7588db8b4c4a25f16c, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:59.925956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f134bda-a203-41d3-af34-ea95935418c7 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:59.933855 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f1fcd076-f82d-4ffe-8c00-ea0376acbdca admin admin] The token cache is being invalidate because project a67bcbe7fc95434c831f6e9cf7abd6fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:59.940636 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f1fcd076-f82d-4ffe-8c00-ea0376acbdca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:59.940636 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f1fcd076-f82d-4ffe-8c00-ea0376acbdca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:59.940636 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 992/2005] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:59 2022] DELETE /identity/v3/projects/a67bcbe7fc95434c831f6e9cf7abd6fb => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:59.940636 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcd076-f82d-4ffe-8c00-ea0376acbdca admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:59.940636 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f1fcd076-f82d-4ffe-8c00-ea0376acbdca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:59.954545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcd076-f82d-4ffe-8c00-ea0376acbdca admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:59.959557 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b4d17-1d9c-46cd-80e0-330610ac17bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:59.960381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b4d17-1d9c-46cd-80e0-330610ac17bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:59.960701 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b4d17-1d9c-46cd-80e0-330610ac17bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:59.961024 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b4d17-1d9c-46cd-80e0-330610ac17bc admin admin] PATH_INFO: `/v3/projects/4081c97a70084bce91322020f8f1b4f5` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:59.962277 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b4d17-1d9c-46cd-80e0-330610ac17bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4081c97a70084bce91322020f8f1b4f5)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:59.964284 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b4d17-1d9c-46cd-80e0-330610ac17bc admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:00.065653 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1014/2006] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:59 2022] PUT /identity/v3/projects/42b140f4931a48c9aed1c1e9e3ab280b/users/e3818b63658b4c7588db8b4c4a25f16c/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:00.066943 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2df94a-0da2-4f78-9a63-1756ab96214a None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:00.067231 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2df94a-0da2-4f78-9a63-1756ab96214a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:00.067518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2df94a-0da2-4f78-9a63-1756ab96214a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:00.085257 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-cd2df94a-0da2-4f78-9a63-1756ab96214a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:00.086473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-cd2df94a-0da2-4f78-9a63-1756ab96214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:00.111440 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ea4b4d17-1d9c-46cd-80e0-330610ac17bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4081c97a70084bce91322020f8f1b4f5', 'request_id': 'req-ea4b4d17-1d9c-46cd-80e0-330610ac17bc'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:00.118058 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ea4b4d17-1d9c-46cd-80e0-330610ac17bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4081c97a70084bce91322020f8f1b4f5', 'request_id': 'req-ea4b4d17-1d9c-46cd-80e0-330610ac17bc'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:00.125994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ea4b4d17-1d9c-46cd-80e0-330610ac17bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4081c97a70084bce91322020f8f1b4f5', 'request_id': 'req-ea4b4d17-1d9c-46cd-80e0-330610ac17bc'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:00.153943 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1015/2007] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:00.155361 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24c4cb-ecdc-4f7d-9fd3-eef4341d9d34 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:00.155761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24c4cb-ecdc-4f7d-9fd3-eef4341d9d34 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:00.156046 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24c4cb-ecdc-4f7d-9fd3-eef4341d9d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:00.173934 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-fc24c4cb-ecdc-4f7d-9fd3-eef4341d9d34 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:00.175246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-fc24c4cb-ecdc-4f7d-9fd3-eef4341d9d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:00.231183 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ea4b4d17-1d9c-46cd-80e0-330610ac17bc admin admin] The token cache is being invalidate because project 4081c97a70084bce91322020f8f1b4f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:00.231483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ea4b4d17-1d9c-46cd-80e0-330610ac17bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:00.234439 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ea4b4d17-1d9c-46cd-80e0-330610ac17bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:00.234439 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 993/2008] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:59 2022] DELETE /identity/v3/projects/4081c97a70084bce91322020f8f1b4f5 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:00.235407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25fc08-0b87-4af8-b33f-fb758441ada5 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:00.235698 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25fc08-0b87-4af8-b33f-fb758441ada5 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:00.235982 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25fc08-0b87-4af8-b33f-fb758441ada5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:00.240849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1016/2009] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:00.242288 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e64531-ab14-40f1-b752-24c35b8869bc None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:00.242584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e64531-ab14-40f1-b752-24c35b8869bc None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:00.242866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e64531-ab14-40f1-b752-24c35b8869bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:00.260407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-8b25fc08-0b87-4af8-b33f-fb758441ada5 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:00.261674 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8b25fc08-0b87-4af8-b33f-fb758441ada5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:00.269181 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-20e64531-ab14-40f1-b752-24c35b8869bc None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:00.273037 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 994/2010] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:00.273301 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-20e64531-ab14-40f1-b752-24c35b8869bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:00.273403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25fc08-0b87-4af8-b33f-fb758441ada5 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:00.274419 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8b25fc08-0b87-4af8-b33f-fb758441ada5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:00.279688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1017/2011] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:00.280925 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e64531-ab14-40f1-b752-24c35b8869bc None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:00.295988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e64531-ab14-40f1-b752-24c35b8869bc None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:00.300768 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc11aa-761c-43c6-85e4-23405f9df6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:00.301435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc11aa-761c-43c6-85e4-23405f9df6cf admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:00.363160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc11aa-761c-43c6-85e4-23405f9df6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:00.363160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc11aa-761c-43c6-85e4-23405f9df6cf admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:00.363160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc11aa-761c-43c6-85e4-23405f9df6cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:58:00.363160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc11aa-761c-43c6-85e4-23405f9df6cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:00.363160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc11aa-761c-43c6-85e4-23405f9df6cf admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:00.363160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1018/2012] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:58:00.363667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b3b45-f21a-4aae-9cd5-fdbe2928c4ee None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:00.363667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b3b45-f21a-4aae-9cd5-fdbe2928c4ee None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:00.363667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b3b45-f21a-4aae-9cd5-fdbe2928c4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:00.363870 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25fc08-0b87-4af8-b33f-fb758441ada5 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:00.363950 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-704b3b45-f21a-4aae-9cd5-fdbe2928c4ee None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:00.364028 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27d913-0401-4fd9-bdf6-572e3f975656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:00.364028 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27d913-0401-4fd9-bdf6-572e3f975656 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:00.364028 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27d913-0401-4fd9-bdf6-572e3f975656 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:00.364256 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-704b3b45-f21a-4aae-9cd5-fdbe2928c4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:00.364329 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27d913-0401-4fd9-bdf6-572e3f975656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:00.364329 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5c27d913-0401-4fd9-bdf6-572e3f975656 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:00.364511 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1019/2013] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:00.364587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27d913-0401-4fd9-bdf6-572e3f975656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:00.364587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27d913-0401-4fd9-bdf6-572e3f975656 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:00.364587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 995/2014] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:00.366572 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b3b45-f21a-4aae-9cd5-fdbe2928c4ee None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:00.368633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27d913-0401-4fd9-bdf6-572e3f975656 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:00.377013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b3b45-f21a-4aae-9cd5-fdbe2928c4ee None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:00.379281 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27d913-0401-4fd9-bdf6-572e3f975656 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:00.382178 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5756e-cae6-4818-9b32-c28452501850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:00.382859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5756e-cae6-4818-9b32-c28452501850 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:00.383622 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5756e-cae6-4818-9b32-c28452501850 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:00.383898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5756e-cae6-4818-9b32-c28452501850 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:00.384651 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5756e-cae6-4818-9b32-c28452501850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:00.386155 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4fc30-2c12-4b07-b08f-c4ad9ec0fa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:00.386642 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5756e-cae6-4818-9b32-c28452501850 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:00.386859 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4fc30-2c12-4b07-b08f-c4ad9ec0fa67 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:00.387212 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4fc30-2c12-4b07-b08f-c4ad9ec0fa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:00.387499 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4fc30-2c12-4b07-b08f-c4ad9ec0fa67 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:00.388279 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4fc30-2c12-4b07-b08f-c4ad9ec0fa67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:58:00.388636 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4fc30-2c12-4b07-b08f-c4ad9ec0fa67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:00.390305 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4fc30-2c12-4b07-b08f-c4ad9ec0fa67 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:00.402309 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 996/2015] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:58:00.406610 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4fc30-2c12-4b07-b08f-c4ad9ec0fa67 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:00.416218 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4fc30-2c12-4b07-b08f-c4ad9ec0fa67 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:00.421612 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1a0bf-9a3e-4ef3-ab4a-5f5fe65f4ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:00.422442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1a0bf-9a3e-4ef3-ab4a-5f5fe65f4ecf admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:00.422735 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1a0bf-9a3e-4ef3-ab4a-5f5fe65f4ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:00.423022 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1a0bf-9a3e-4ef3-ab4a-5f5fe65f4ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:00.423713 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1a0bf-9a3e-4ef3-ab4a-5f5fe65f4ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:00.425666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1a0bf-9a3e-4ef3-ab4a-5f5fe65f4ecf admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:00.557857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1020/2016] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:00 2022] POST /identity/v3/projects => generated 399 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:58:00.561395 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5756e-cae6-4818-9b32-c28452501850 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:00.581742 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 997/2017] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:00 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:58:00.586118 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1a0bf-9a3e-4ef3-ab4a-5f5fe65f4ecf admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:00.679354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1a0bf-9a3e-4ef3-ab4a-5f5fe65f4ecf admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:00.684345 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba465756-14e9-4470-97a3-202afc304451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:00.685187 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5756e-cae6-4818-9b32-c28452501850 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:00.685309 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba465756-14e9-4470-97a3-202afc304451 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:00.685509 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba465756-14e9-4470-97a3-202afc304451 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:00.685791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba465756-14e9-4470-97a3-202afc304451 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:00.687121 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba465756-14e9-4470-97a3-202afc304451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:00.689618 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba465756-14e9-4470-97a3-202afc304451 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:00.691481 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd57390-bc36-4a89-a081-40d2490bf27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:00.692312 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd57390-bc36-4a89-a081-40d2490bf27e admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:00.692651 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd57390-bc36-4a89-a081-40d2490bf27e admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:00.694569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd57390-bc36-4a89-a081-40d2490bf27e admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:00.694569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd57390-bc36-4a89-a081-40d2490bf27e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:00.695575 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd57390-bc36-4a89-a081-40d2490bf27e admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:00.767264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 998/2018] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:00 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:00.769340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1021/2019] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:00 2022] POST /identity/v3/users => generated 300 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:58:00.774833 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd57390-bc36-4a89-a081-40d2490bf27e admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:00.785018 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba465756-14e9-4470-97a3-202afc304451 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:00.786452 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd57390-bc36-4a89-a081-40d2490bf27e admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:00.791640 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54955e7d-5ac9-41b3-8a6f-abb4d2eba3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:00.792326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54955e7d-5ac9-41b3-8a6f-abb4d2eba3ad admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:00.793238 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54955e7d-5ac9-41b3-8a6f-abb4d2eba3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:00.793525 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54955e7d-5ac9-41b3-8a6f-abb4d2eba3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:00.794443 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54955e7d-5ac9-41b3-8a6f-abb4d2eba3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:00.796366 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54955e7d-5ac9-41b3-8a6f-abb4d2eba3ad admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:00.807954 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1022/2020] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:00.811930 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54955e7d-5ac9-41b3-8a6f-abb4d2eba3ad admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:00.812627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba465756-14e9-4470-97a3-202afc304451 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:00.820392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ef75d-9075-4dcc-9b27-c8a642155d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:00.821184 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ef75d-9075-4dcc-9b27-c8a642155d1b admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:00.821507 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ef75d-9075-4dcc-9b27-c8a642155d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:00.822464 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ef75d-9075-4dcc-9b27-c8a642155d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:00.823252 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ef75d-9075-4dcc-9b27-c8a642155d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:00.825286 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ef75d-9075-4dcc-9b27-c8a642155d1b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:00.827530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54955e7d-5ac9-41b3-8a6f-abb4d2eba3ad admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:00.838901 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598675a-c463-465a-a1f9-63783671c3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:00.840031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598675a-c463-465a-a1f9-63783671c3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:00.840325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598675a-c463-465a-a1f9-63783671c3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:00.840644 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598675a-c463-465a-a1f9-63783671c3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:00.841383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598675a-c463-465a-a1f9-63783671c3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:00.843410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598675a-c463-465a-a1f9-63783671c3c2 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:00.846311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 999/2021] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:00.849749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ef75d-9075-4dcc-9b27-c8a642155d1b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:00.861849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1023/2022] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:00.862915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598675a-c463-465a-a1f9-63783671c3c2 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:00.865661 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ef75d-9075-4dcc-9b27-c8a642155d1b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:00.870734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c670a1-8b8f-4c98-90c7-885b2200e38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:00.871408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c670a1-8b8f-4c98-90c7-885b2200e38f admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:00.871698 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c670a1-8b8f-4c98-90c7-885b2200e38f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:00.871980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c670a1-8b8f-4c98-90c7-885b2200e38f admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:00.872869 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c670a1-8b8f-4c98-90c7-885b2200e38f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:00.873526 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598675a-c463-465a-a1f9-63783671c3c2 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:00.874420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c670a1-8b8f-4c98-90c7-885b2200e38f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:00.878398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cbf05-3106-4c1f-82de-61f99689efc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:00.879384 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cbf05-3106-4c1f-82de-61f99689efc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:00.879746 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cbf05-3106-4c1f-82de-61f99689efc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:00.880027 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cbf05-3106-4c1f-82de-61f99689efc1 admin admin] PATH_INFO: `/v3/projects/0d2afac1ef3b4d4bb0e4c0cd2de51370/users/126a7ce19656451d98d024b61ef5a8b7/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:00.886000 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1000/2023] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:58:00.890116 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c670a1-8b8f-4c98-90c7-885b2200e38f admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:00.895422 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cbf05-3106-4c1f-82de-61f99689efc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2afac1ef3b4d4bb0e4c0cd2de51370, user_id=126a7ce19656451d98d024b61ef5a8b7, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:00.898196 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cbf05-3106-4c1f-82de-61f99689efc1 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:00.899952 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c670a1-8b8f-4c98-90c7-885b2200e38f admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:00.905358 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31594f5-3df5-47ef-bb0a-a96f0c86e931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:00.906275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31594f5-3df5-47ef-bb0a-a96f0c86e931 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:00.906589 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31594f5-3df5-47ef-bb0a-a96f0c86e931 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:00.906887 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31594f5-3df5-47ef-bb0a-a96f0c86e931 admin admin] PATH_INFO: `/v3/projects/c9aa3ab1f27947929fc8cd3198412a44/users/11e0adf023364295a05f6e121fbf1fb1/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:00.921950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31594f5-3df5-47ef-bb0a-a96f0c86e931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9aa3ab1f27947929fc8cd3198412a44, user_id=11e0adf023364295a05f6e121fbf1fb1, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:00.927760 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31594f5-3df5-47ef-bb0a-a96f0c86e931 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:01.013867 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1024/2025] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:00 2022] PUT /identity/v3/projects/0d2afac1ef3b4d4bb0e4c0cd2de51370/users/126a7ce19656451d98d024b61ef5a8b7/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:01.033237 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1001/2025] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:00 2022] PUT /identity/v3/projects/c9aa3ab1f27947929fc8cd3198412a44/users/11e0adf023364295a05f6e121fbf1fb1/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:01.044191 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef69242-8e9b-4c51-a4a0-a88dc9729663 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:01.044191 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef69242-8e9b-4c51-a4a0-a88dc9729663 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:01.044191 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef69242-8e9b-4c51-a4a0-a88dc9729663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:01.044568 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8c3d8-be0a-4878-90d2-d92c7d401b6b None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:01.044568 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8c3d8-be0a-4878-90d2-d92c7d401b6b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:01.044568 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8c3d8-be0a-4878-90d2-d92c7d401b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:01.074374 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-6ef69242-8e9b-4c51-a4a0-a88dc9729663 None None] MFA Rules not processed for user `126a7ce19656451d98d024b61ef5a8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:01.075603 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6ef69242-8e9b-4c51-a4a0-a88dc9729663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:01.089140 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-dfa8c3d8-be0a-4878-90d2-d92c7d401b6b None None] MFA Rules not processed for user `11e0adf023364295a05f6e121fbf1fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:01.092637 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-dfa8c3d8-be0a-4878-90d2-d92c7d401b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:01.148221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1025/2026] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:01.154240 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef69242-8e9b-4c51-a4a0-a88dc9729663 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:01.158811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1002/2027] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:58:01.163104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8c3d8-be0a-4878-90d2-d92c7d401b6b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:01.170131 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:01.236332 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef69242-8e9b-4c51-a4a0-a88dc9729663 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:01.242870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0232c7-6b61-495a-9479-20ee3feb7229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:01.246397 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0232c7-6b61-495a-9479-20ee3feb7229 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:01.246397 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0232c7-6b61-495a-9479-20ee3feb7229 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:01.246397 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0232c7-6b61-495a-9479-20ee3feb7229 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:01.246397 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0232c7-6b61-495a-9479-20ee3feb7229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:01.247466 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0232c7-6b61-495a-9479-20ee3feb7229 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:01.249413 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8c3d8-be0a-4878-90d2-d92c7d401b6b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:01.255366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48b426-37d4-457e-b545-18fbefbb8d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:01.256049 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48b426-37d4-457e-b545-18fbefbb8d84 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:01.256330 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48b426-37d4-457e-b545-18fbefbb8d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:01.256657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48b426-37d4-457e-b545-18fbefbb8d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:01.257407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48b426-37d4-457e-b545-18fbefbb8d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:01.259596 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48b426-37d4-457e-b545-18fbefbb8d84 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:01.386671 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1026/2028] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:01 2022] POST /identity/v3/projects => generated 377 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:01.390500 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1003/2029] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:01 2022] POST /identity/v3/projects => generated 401 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:58:01.390964 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0232c7-6b61-495a-9479-20ee3feb7229 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:01.391517 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48b426-37d4-457e-b545-18fbefbb8d84 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:01.453808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48b426-37d4-457e-b545-18fbefbb8d84 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:01.454598 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0232c7-6b61-495a-9479-20ee3feb7229 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:01.460165 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173134f8-f6fe-4044-bfa8-3b6d5ef4c7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:01.461773 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173134f8-f6fe-4044-bfa8-3b6d5ef4c7d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:01.462059 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173134f8-f6fe-4044-bfa8-3b6d5ef4c7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:01.462438 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173134f8-f6fe-4044-bfa8-3b6d5ef4c7d1 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:01.463196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173134f8-f6fe-4044-bfa8-3b6d5ef4c7d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:01.465864 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173134f8-f6fe-4044-bfa8-3b6d5ef4c7d1 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:01.467434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975f197-017a-4724-a760-0e328cc68798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:01.468070 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975f197-017a-4724-a760-0e328cc68798 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:01.468557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975f197-017a-4724-a760-0e328cc68798 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:01.468995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975f197-017a-4724-a760-0e328cc68798 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:01.469852 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975f197-017a-4724-a760-0e328cc68798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:01.471982 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975f197-017a-4724-a760-0e328cc68798 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:01.557734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1004/2030] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:01 2022] POST /identity/v3/users => generated 307 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:01.558828 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173134f8-f6fe-4044-bfa8-3b6d5ef4c7d1 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:01.568994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173134f8-f6fe-4044-bfa8-3b6d5ef4c7d1 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:01.574585 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987425f-6aca-4211-ba15-5d0b921ac8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:01.575281 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987425f-6aca-4211-ba15-5d0b921ac8cc admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:01.575573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987425f-6aca-4211-ba15-5d0b921ac8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:01.575856 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987425f-6aca-4211-ba15-5d0b921ac8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:01.576632 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987425f-6aca-4211-ba15-5d0b921ac8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:01.578380 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987425f-6aca-4211-ba15-5d0b921ac8cc admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:01.591156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1005/2031] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:01.594534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987425f-6aca-4211-ba15-5d0b921ac8cc admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:01.604310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987425f-6aca-4211-ba15-5d0b921ac8cc admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:01.609667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85047ca-404c-4578-862c-270b1009d362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:01.610540 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85047ca-404c-4578-862c-270b1009d362 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:01.610811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85047ca-404c-4578-862c-270b1009d362 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:01.611090 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85047ca-404c-4578-862c-270b1009d362 admin admin] PATH_INFO: `/v3/projects/62ef5b8a2b614632a7bc720b19be4cd3/users/3171a75c15cb4f84bb93d22fe8f6dec3/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:01.628806 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85047ca-404c-4578-862c-270b1009d362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ef5b8a2b614632a7bc720b19be4cd3, user_id=3171a75c15cb4f84bb93d22fe8f6dec3, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:01.631555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85047ca-404c-4578-862c-270b1009d362 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:01.646088 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1027/2032] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:01 2022] POST /identity/v3/users => generated 295 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:01.649888 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975f197-017a-4724-a760-0e328cc68798 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:01.660105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975f197-017a-4724-a760-0e328cc68798 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:01.666151 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9cb63-e9a4-4257-af8d-d382d461836f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:01.666814 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9cb63-e9a4-4257-af8d-d382d461836f admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:01.667100 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9cb63-e9a4-4257-af8d-d382d461836f admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:01.667377 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9cb63-e9a4-4257-af8d-d382d461836f admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:01.668734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9cb63-e9a4-4257-af8d-d382d461836f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:01.670327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9cb63-e9a4-4257-af8d-d382d461836f admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:01.684117 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1028/2033] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:58:01.685118 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9cb63-e9a4-4257-af8d-d382d461836f admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:01.694953 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9cb63-e9a4-4257-af8d-d382d461836f admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:01.700498 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7e00c-f437-4b98-9ef1-ccc820e7bc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:01.701389 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7e00c-f437-4b98-9ef1-ccc820e7bc56 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:01.701677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7e00c-f437-4b98-9ef1-ccc820e7bc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:01.701952 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7e00c-f437-4b98-9ef1-ccc820e7bc56 admin admin] PATH_INFO: `/v3/projects/6b64ea68e8914a0fa60ebe794ecf2f4c/users/c49310c3198d4bf2baa978f0f83d8f23/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:01.717309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7e00c-f437-4b98-9ef1-ccc820e7bc56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b64ea68e8914a0fa60ebe794ecf2f4c, user_id=c49310c3198d4bf2baa978f0f83d8f23, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:01.720023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7e00c-f437-4b98-9ef1-ccc820e7bc56 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:01.774436 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1006/2034] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:01 2022] PUT /identity/v3/projects/62ef5b8a2b614632a7bc720b19be4cd3/users/3171a75c15cb4f84bb93d22fe8f6dec3/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:01.778705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85047ca-404c-4578-862c-270b1009d362 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:01.844746 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1029/2035] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:01 2022] PUT /identity/v3/projects/6b64ea68e8914a0fa60ebe794ecf2f4c/users/c49310c3198d4bf2baa978f0f83d8f23/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:01.848686 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7e00c-f437-4b98-9ef1-ccc820e7bc56 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:01.863617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85047ca-404c-4578-862c-270b1009d362 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:01.952652 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7e00c-f437-4b98-9ef1-ccc820e7bc56 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:01.952900 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee14c7c-a621-4680-a429-e95394db32e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:01.954915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee14c7c-a621-4680-a429-e95394db32e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:01.955789 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee14c7c-a621-4680-a429-e95394db32e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:01.956184 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee14c7c-a621-4680-a429-e95394db32e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:01.957594 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee14c7c-a621-4680-a429-e95394db32e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:01.958023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1405b-6b02-41b3-bc75-53a82667c407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:01.958706 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1405b-6b02-41b3-bc75-53a82667c407 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:01.958994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1405b-6b02-41b3-bc75-53a82667c407 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:01.959375 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee14c7c-a621-4680-a429-e95394db32e9 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:01.960844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1405b-6b02-41b3-bc75-53a82667c407 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:01.961943 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1405b-6b02-41b3-bc75-53a82667c407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:01.963920 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1405b-6b02-41b3-bc75-53a82667c407 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:01.974233 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1007/2036] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:01.976542 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5b718-064a-46b8-9be9-1704968cfb88 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:01.977568 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5b718-064a-46b8-9be9-1704968cfb88 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:01.977858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5b718-064a-46b8-9be9-1704968cfb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:01.981381 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1030/2037] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:58:01.984767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1405b-6b02-41b3-bc75-53a82667c407 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:01.996947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1405b-6b02-41b3-bc75-53a82667c407 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:02.003063 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e6d41-8e87-40b0-b1b6-27cd34c9fac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:02.004113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e6d41-8e87-40b0-b1b6-27cd34c9fac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:02.004496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e6d41-8e87-40b0-b1b6-27cd34c9fac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:02.004843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e6d41-8e87-40b0-b1b6-27cd34c9fac8 admin admin] PATH_INFO: `/v3/projects/62ef5b8a2b614632a7bc720b19be4cd3/users/3171a75c15cb4f84bb93d22fe8f6dec3/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:02.007690 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e6d41-8e87-40b0-b1b6-27cd34c9fac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ef5b8a2b614632a7bc720b19be4cd3, user_id=3171a75c15cb4f84bb93d22fe8f6dec3, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:02.010388 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-ccf5b718-064a-46b8-9be9-1704968cfb88 None None] MFA Rules not processed for user `e3818b63658b4c7588db8b4c4a25f16c`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:02.011085 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e6d41-8e87-40b0-b1b6-27cd34c9fac8 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:02.012359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ccf5b718-064a-46b8-9be9-1704968cfb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:02.037238 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1031/2038] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:01 2022] PUT /identity/v3/projects/62ef5b8a2b614632a7bc720b19be4cd3/users/3171a75c15cb4f84bb93d22fe8f6dec3/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:02.037238 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e6d41-8e87-40b0-b1b6-27cd34c9fac8 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:02.099405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e6d41-8e87-40b0-b1b6-27cd34c9fac8 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:02.102986 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1008/2039] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:02.104518 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fe7e5-9fee-4110-a9ff-56389fa1564d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:02.104967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fe7e5-9fee-4110-a9ff-56389fa1564d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:02.105384 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fe7e5-9fee-4110-a9ff-56389fa1564d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:02.108372 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d91c0-53fb-4c57-85fd-0b49a454fa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:02.109590 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d91c0-53fb-4c57-85fd-0b49a454fa33 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:02.109880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d91c0-53fb-4c57-85fd-0b49a454fa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:02.110180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d91c0-53fb-4c57-85fd-0b49a454fa33 admin admin] PATH_INFO: `/v3/projects/6b64ea68e8914a0fa60ebe794ecf2f4c/users/c49310c3198d4bf2baa978f0f83d8f23/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:02.112328 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d91c0-53fb-4c57-85fd-0b49a454fa33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b64ea68e8914a0fa60ebe794ecf2f4c, user_id=c49310c3198d4bf2baa978f0f83d8f23, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:02.123958 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d91c0-53fb-4c57-85fd-0b49a454fa33 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:02.141559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1032/2040] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:02 2022] PUT /identity/v3/projects/6b64ea68e8914a0fa60ebe794ecf2f4c/users/c49310c3198d4bf2baa978f0f83d8f23/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:02.141718 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5f1fe7e5-9fee-4110-a9ff-56389fa1564d None None] MFA Rules not processed for user `3171a75c15cb4f84bb93d22fe8f6dec3`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:02.142588 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d91c0-53fb-4c57-85fd-0b49a454fa33 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:02.143331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5f1fe7e5-9fee-4110-a9ff-56389fa1564d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:02.144564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-bc6d91c0-53fb-4c57-85fd-0b49a454fa33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:02.204909 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d91c0-53fb-4c57-85fd-0b49a454fa33 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:02.208751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef442a-c21c-4a95-8a6a-1d457aebe262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:02.209392 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef442a-c21c-4a95-8a6a-1d457aebe262 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:02.209675 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef442a-c21c-4a95-8a6a-1d457aebe262 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:02.209952 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef442a-c21c-4a95-8a6a-1d457aebe262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:02.217805 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1009/2041] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:02.219182 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57263388-5561-4a87-b092-66ebd03dbbfb None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:02.219474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57263388-5561-4a87-b092-66ebd03dbbfb None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:02.219754 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57263388-5561-4a87-b092-66ebd03dbbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:02.258444 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-57263388-5561-4a87-b092-66ebd03dbbfb None None] MFA Rules not processed for user `c49310c3198d4bf2baa978f0f83d8f23`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:02.260542 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-57263388-5561-4a87-b092-66ebd03dbbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:02.281597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef442a-c21c-4a95-8a6a-1d457aebe262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:02.283230 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef442a-c21c-4a95-8a6a-1d457aebe262 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:02.292469 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1033/2042] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:02.293282 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef442a-c21c-4a95-8a6a-1d457aebe262 service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:02.294619 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-74ef442a-c21c-4a95-8a6a-1d457aebe262 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:02.305417 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef442a-c21c-4a95-8a6a-1d457aebe262 service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:02.309860 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8254b-5d87-4f61-85e6-068a2aeff11e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:02.310654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8254b-5d87-4f61-85e6-068a2aeff11e service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:02.310946 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8254b-5d87-4f61-85e6-068a2aeff11e service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:02.311232 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8254b-5d87-4f61-85e6-068a2aeff11e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:02.321950 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8254b-5d87-4f61-85e6-068a2aeff11e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:02.323395 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8254b-5d87-4f61-85e6-068a2aeff11e service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:02.334641 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1034/2043] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:02 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:02.336873 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1010/2044] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:02.340877 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:02.470565 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8254b-5d87-4f61-85e6-068a2aeff11e service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:02.479275 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8254b-5d87-4f61-85e6-068a2aeff11e service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:02.483675 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad42790-b20a-4bd8-aaa0-e9816c466b92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:02.484329 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad42790-b20a-4bd8-aaa0-e9816c466b92 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:02.484662 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad42790-b20a-4bd8-aaa0-e9816c466b92 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:02.484940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad42790-b20a-4bd8-aaa0-e9816c466b92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:02.540971 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad42790-b20a-4bd8-aaa0-e9816c466b92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:02.542984 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad42790-b20a-4bd8-aaa0-e9816c466b92 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:02.552227 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1035/2045] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:03.229686 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:03.235544 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57263388-5561-4a87-b092-66ebd03dbbfb None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:03.246038 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57263388-5561-4a87-b092-66ebd03dbbfb None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:03.250260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f05f8-407d-4e59-b0bd-a3c3cc5f4c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:03.250915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f05f8-407d-4e59-b0bd-a3c3cc5f4c01 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:03.251332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f05f8-407d-4e59-b0bd-a3c3cc5f4c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:03.251612 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f05f8-407d-4e59-b0bd-a3c3cc5f4c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:03.316196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f05f8-407d-4e59-b0bd-a3c3cc5f4c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:03.319981 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f05f8-407d-4e59-b0bd-a3c3cc5f4c01 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:03.327561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1011/2046] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:03.574945 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad42790-b20a-4bd8-aaa0-e9816c466b92 service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:03.577135 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-8ad42790-b20a-4bd8-aaa0-e9816c466b92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:03.656854 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad42790-b20a-4bd8-aaa0-e9816c466b92 service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:03.656854 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db92d7-2265-4f64-a048-8695c67994c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:03.657136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db92d7-2265-4f64-a048-8695c67994c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:03.657661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db92d7-2265-4f64-a048-8695c67994c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:03.657944 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db92d7-2265-4f64-a048-8695c67994c7 admin admin] PATH_INFO: `/v3/users/2e14ab941bb94320ab7c5f3bf571cea0` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:03.659184 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db92d7-2265-4f64-a048-8695c67994c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e14ab941bb94320ab7c5f3bf571cea0)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:03.661157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db92d7-2265-4f64-a048-8695c67994c7 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:03.836931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f05f8-407d-4e59-b0bd-a3c3cc5f4c01 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:03.845455 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f05f8-407d-4e59-b0bd-a3c3cc5f4c01 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:03.849112 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a8252-e80d-48f2-bfc8-304c16dc0a6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:03.849755 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a8252-e80d-48f2-bfc8-304c16dc0a6c service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:03.850043 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a8252-e80d-48f2-bfc8-304c16dc0a6c service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:03.850324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a8252-e80d-48f2-bfc8-304c16dc0a6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:03.852108 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fc3a8252-e80d-48f2-bfc8-304c16dc0a6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:03.911489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a8252-e80d-48f2-bfc8-304c16dc0a6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:03.912972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a8252-e80d-48f2-bfc8-304c16dc0a6c service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:03.922397 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1012/2047] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:58:03.948344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-72db92d7-2265-4f64-a048-8695c67994c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e14ab941bb94320ab7c5f3bf571cea0'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:03.949075 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-72db92d7-2265-4f64-a048-8695c67994c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e14ab941bb94320ab7c5f3bf571cea0'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:04.093503 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-72db92d7-2265-4f64-a048-8695c67994c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e14ab941bb94320ab7c5f3bf571cea0'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:04.101310 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-72db92d7-2265-4f64-a048-8695c67994c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e14ab941bb94320ab7c5f3bf571cea0'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:04.102044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-72db92d7-2265-4f64-a048-8695c67994c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e14ab941bb94320ab7c5f3bf571cea0'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:04.119203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1036/2048] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:03 2022] DELETE /identity/v3/users/2e14ab941bb94320ab7c5f3bf571cea0 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:04.123741 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65cc5d-f81e-4b9f-b5f6-7c832c749afd None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:04.124042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65cc5d-f81e-4b9f-b5f6-7c832c749afd None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:04.124332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65cc5d-f81e-4b9f-b5f6-7c832c749afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:04.142614 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5c65cc5d-f81e-4b9f-b5f6-7c832c749afd None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:04.143823 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5c65cc5d-f81e-4b9f-b5f6-7c832c749afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:04.203284 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1013/2049] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:04.214169 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db92d7-2265-4f64-a048-8695c67994c7 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:04.216282 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-72db92d7-2265-4f64-a048-8695c67994c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:04.299307 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db92d7-2265-4f64-a048-8695c67994c7 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:04.303362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d772e66-6be2-48a2-b9bd-c85b0cff8915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:04.304180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d772e66-6be2-48a2-b9bd-c85b0cff8915 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:04.304406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d772e66-6be2-48a2-b9bd-c85b0cff8915 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:04.304748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d772e66-6be2-48a2-b9bd-c85b0cff8915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:04.316296 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d772e66-6be2-48a2-b9bd-c85b0cff8915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:04.317844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d772e66-6be2-48a2-b9bd-c85b0cff8915 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:04.335849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1037/2050] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:04.341959 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852500de-71cd-4e42-84af-2b413545005c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:04.342453 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852500de-71cd-4e42-84af-2b413545005c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:04.342532 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852500de-71cd-4e42-84af-2b413545005c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:04.361258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-852500de-71cd-4e42-84af-2b413545005c None None] MFA Rules not processed for user `e3818b63658b4c7588db8b4c4a25f16c`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:04.362407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-852500de-71cd-4e42-84af-2b413545005c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:04.420818 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:04.436080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1014/2051] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:04.782066 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d772e66-6be2-48a2-b9bd-c85b0cff8915 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:04.784119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2d772e66-6be2-48a2-b9bd-c85b0cff8915 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:04.799867 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d772e66-6be2-48a2-b9bd-c85b0cff8915 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:04.813322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8787e-9a03-415b-9a2c-118533e20407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:04.813322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8787e-9a03-415b-9a2c-118533e20407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:04.813322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8787e-9a03-415b-9a2c-118533e20407 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:04.813322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8787e-9a03-415b-9a2c-118533e20407 admin admin] PATH_INFO: `/v3/projects/592da9db9cfb44fc840df37cc89828e4` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:04.814111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8787e-9a03-415b-9a2c-118533e20407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=592da9db9cfb44fc840df37cc89828e4)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:04.814111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8787e-9a03-415b-9a2c-118533e20407 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:04.882126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:04.952739 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-15c8787e-9a03-415b-9a2c-118533e20407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '592da9db9cfb44fc840df37cc89828e4', 'request_id': 'req-15c8787e-9a03-415b-9a2c-118533e20407'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:05.054404 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-15c8787e-9a03-415b-9a2c-118533e20407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '592da9db9cfb44fc840df37cc89828e4', 'request_id': 'req-15c8787e-9a03-415b-9a2c-118533e20407'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:05.064276 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-15c8787e-9a03-415b-9a2c-118533e20407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '592da9db9cfb44fc840df37cc89828e4', 'request_id': 'req-15c8787e-9a03-415b-9a2c-118533e20407'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:05.086100 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-15c8787e-9a03-415b-9a2c-118533e20407 admin admin] The token cache is being invalidate because project 592da9db9cfb44fc840df37cc89828e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:05.086100 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-15c8787e-9a03-415b-9a2c-118533e20407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:05.086715 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-15c8787e-9a03-415b-9a2c-118533e20407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:05.088481 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1038/2052] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:04 2022] DELETE /identity/v3/projects/592da9db9cfb44fc840df37cc89828e4 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:05.094351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852500de-71cd-4e42-84af-2b413545005c None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:05.109739 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852500de-71cd-4e42-84af-2b413545005c None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:05.184604 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32a08b-b38e-4ff8-9825-c7dce36b273c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:05.189068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32a08b-b38e-4ff8-9825-c7dce36b273c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:05.189485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32a08b-b38e-4ff8-9825-c7dce36b273c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:05.189820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32a08b-b38e-4ff8-9825-c7dce36b273c admin admin] PATH_INFO: `/v3/users/aa1d9d93867b4f7989c4baf4c852d8e0` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:05.191184 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32a08b-b38e-4ff8-9825-c7dce36b273c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa1d9d93867b4f7989c4baf4c852d8e0)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:05.193172 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32a08b-b38e-4ff8-9825-c7dce36b273c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:05.464713 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ee32a08b-b38e-4ff8-9825-c7dce36b273c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa1d9d93867b4f7989c4baf4c852d8e0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:05.466043 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ee32a08b-b38e-4ff8-9825-c7dce36b273c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa1d9d93867b4f7989c4baf4c852d8e0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:05.577609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ee32a08b-b38e-4ff8-9825-c7dce36b273c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa1d9d93867b4f7989c4baf4c852d8e0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:05.586733 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ee32a08b-b38e-4ff8-9825-c7dce36b273c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa1d9d93867b4f7989c4baf4c852d8e0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:05.601119 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ee32a08b-b38e-4ff8-9825-c7dce36b273c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa1d9d93867b4f7989c4baf4c852d8e0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:05.607446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1015/2053] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:05 2022] DELETE /identity/v3/users/aa1d9d93867b4f7989c4baf4c852d8e0 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:06.015962 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8787e-9a03-415b-9a2c-118533e20407 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:06.017472 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-15c8787e-9a03-415b-9a2c-118533e20407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:06.038351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32a08b-b38e-4ff8-9825-c7dce36b273c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:06.039802 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ee32a08b-b38e-4ff8-9825-c7dce36b273c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:06.090806 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8787e-9a03-415b-9a2c-118533e20407 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:06.114707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32a08b-b38e-4ff8-9825-c7dce36b273c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:06.119501 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39357268-047d-48d4-afa9-fded93891224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:06.121049 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39357268-047d-48d4-afa9-fded93891224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:06.121343 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39357268-047d-48d4-afa9-fded93891224 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:06.121684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39357268-047d-48d4-afa9-fded93891224 admin admin] PATH_INFO: `/v3/projects/5917d868ca9c4924abf8cb61a2579a90` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:06.123140 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39357268-047d-48d4-afa9-fded93891224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5917d868ca9c4924abf8cb61a2579a90)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:06.125984 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39357268-047d-48d4-afa9-fded93891224 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:06.141964 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685ced4-79b2-4158-be8a-1bd06854896c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:06.142616 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685ced4-79b2-4158-be8a-1bd06854896c service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:06.142899 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685ced4-79b2-4158-be8a-1bd06854896c service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:06.143423 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685ced4-79b2-4158-be8a-1bd06854896c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:06.145122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6685ced4-79b2-4158-be8a-1bd06854896c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:06.209357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685ced4-79b2-4158-be8a-1bd06854896c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:06.210994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685ced4-79b2-4158-be8a-1bd06854896c service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:06.220982 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1039/2054] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:06.278071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-39357268-047d-48d4-afa9-fded93891224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5917d868ca9c4924abf8cb61a2579a90', 'request_id': 'req-39357268-047d-48d4-afa9-fded93891224'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:06.283816 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-39357268-047d-48d4-afa9-fded93891224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5917d868ca9c4924abf8cb61a2579a90', 'request_id': 'req-39357268-047d-48d4-afa9-fded93891224'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:06.290134 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-39357268-047d-48d4-afa9-fded93891224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5917d868ca9c4924abf8cb61a2579a90', 'request_id': 'req-39357268-047d-48d4-afa9-fded93891224'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:06.418009 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-39357268-047d-48d4-afa9-fded93891224 admin admin] The token cache is being invalidate because project 5917d868ca9c4924abf8cb61a2579a90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:06.418596 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-39357268-047d-48d4-afa9-fded93891224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:06.419414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-39357268-047d-48d4-afa9-fded93891224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:06.421317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1016/2055] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:06 2022] DELETE /identity/v3/projects/5917d868ca9c4924abf8cb61a2579a90 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:06.426505 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cc140-e3e6-4e7a-8191-baffdbd75854 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:06.426804 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cc140-e3e6-4e7a-8191-baffdbd75854 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:06.427307 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cc140-e3e6-4e7a-8191-baffdbd75854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:06.447558 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-8c8cc140-e3e6-4e7a-8191-baffdbd75854 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:06.448916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-8c8cc140-e3e6-4e7a-8191-baffdbd75854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:06.506919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1040/2056] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:06.515050 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e506608-5432-4b2f-afaf-71f9a0829827 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:06.522554 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e506608-5432-4b2f-afaf-71f9a0829827 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:06.522554 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e506608-5432-4b2f-afaf-71f9a0829827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:06.534366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-1e506608-5432-4b2f-afaf-71f9a0829827 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:06.535671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1e506608-5432-4b2f-afaf-71f9a0829827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:06.544468 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1017/2057] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:06.550553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cc140-e3e6-4e7a-8191-baffdbd75854 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:06.562929 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cc140-e3e6-4e7a-8191-baffdbd75854 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:06.568682 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09051e0-0b6b-496a-aa4e-ca395913126d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:06.569630 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09051e0-0b6b-496a-aa4e-ca395913126d admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:06.570011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09051e0-0b6b-496a-aa4e-ca395913126d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:06.570500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09051e0-0b6b-496a-aa4e-ca395913126d admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:06.571607 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09051e0-0b6b-496a-aa4e-ca395913126d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:58:06.572019 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09051e0-0b6b-496a-aa4e-ca395913126d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:06.576127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09051e0-0b6b-496a-aa4e-ca395913126d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:06.597041 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1041/2058] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:58:06.597302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e506608-5432-4b2f-afaf-71f9a0829827 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:06.608253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e506608-5432-4b2f-afaf-71f9a0829827 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:06.613852 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74668910-ce84-4eb6-8b88-24454e9173c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:06.614612 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74668910-ce84-4eb6-8b88-24454e9173c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:06.614949 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74668910-ce84-4eb6-8b88-24454e9173c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:06.615257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74668910-ce84-4eb6-8b88-24454e9173c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:06.615956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74668910-ce84-4eb6-8b88-24454e9173c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:06.617949 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74668910-ce84-4eb6-8b88-24454e9173c8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:06.839608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1018/2059] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:06 2022] POST /identity/v3/projects => generated 387 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:06.840813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09051e0-0b6b-496a-aa4e-ca395913126d admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:06.851116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09051e0-0b6b-496a-aa4e-ca395913126d admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:06.906434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165699b-6376-4b2f-8570-cb40dc3b4e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:06.907111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165699b-6376-4b2f-8570-cb40dc3b4e1b admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:06.908614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165699b-6376-4b2f-8570-cb40dc3b4e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:06.908614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165699b-6376-4b2f-8570-cb40dc3b4e1b admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:06.908614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165699b-6376-4b2f-8570-cb40dc3b4e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:06.910308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165699b-6376-4b2f-8570-cb40dc3b4e1b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:07.005028 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1042/2060] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:06 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:07.005123 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74668910-ce84-4eb6-8b88-24454e9173c8 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:07.013482 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74668910-ce84-4eb6-8b88-24454e9173c8 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:07.018105 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc57eb6-2700-475f-86ca-c032857be942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:07.018884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc57eb6-2700-475f-86ca-c032857be942 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:07.019049 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc57eb6-2700-475f-86ca-c032857be942 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:07.019326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc57eb6-2700-475f-86ca-c032857be942 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:07.025185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc57eb6-2700-475f-86ca-c032857be942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:07.025185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc57eb6-2700-475f-86ca-c032857be942 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:07.033402 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1019/2061] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:07.037408 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165699b-6376-4b2f-8570-cb40dc3b4e1b admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:07.049122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165699b-6376-4b2f-8570-cb40dc3b4e1b admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:07.054661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace68a57-1d71-4661-93c6-11534b536632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:07.055347 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace68a57-1d71-4661-93c6-11534b536632 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:07.057927 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace68a57-1d71-4661-93c6-11534b536632 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:07.057927 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace68a57-1d71-4661-93c6-11534b536632 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:07.058894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace68a57-1d71-4661-93c6-11534b536632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:07.060527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace68a57-1d71-4661-93c6-11534b536632 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:07.064112 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:07.077785 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1043/2062] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:07.097712 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc57eb6-2700-475f-86ca-c032857be942 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:07.129298 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc57eb6-2700-475f-86ca-c032857be942 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:07.141114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3747470-51de-4a07-b426-b1e1585954ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:07.142522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3747470-51de-4a07-b426-b1e1585954ef admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:07.142988 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3747470-51de-4a07-b426-b1e1585954ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:07.143278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3747470-51de-4a07-b426-b1e1585954ef admin admin] PATH_INFO: `/v3/projects/e09da0fce7694ab3a3d21bbcab424a66/users/82919a5543ec436aa1751eb577a3eb38/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:07.159765 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3747470-51de-4a07-b426-b1e1585954ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09da0fce7694ab3a3d21bbcab424a66, user_id=82919a5543ec436aa1751eb577a3eb38, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:07.162508 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3747470-51de-4a07-b426-b1e1585954ef admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:07.265836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1020/2063] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:07 2022] PUT /identity/v3/projects/e09da0fce7694ab3a3d21bbcab424a66/users/82919a5543ec436aa1751eb577a3eb38/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:07.276133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54b3c6-9012-41b1-b037-8d88ced6d03f None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:07.276450 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54b3c6-9012-41b1-b037-8d88ced6d03f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:07.277237 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54b3c6-9012-41b1-b037-8d88ced6d03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:07.305597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-cb54b3c6-9012-41b1-b037-8d88ced6d03f None None] MFA Rules not processed for user `82919a5543ec436aa1751eb577a3eb38`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:07.306874 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-cb54b3c6-9012-41b1-b037-8d88ced6d03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:07.373418 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1044/2064] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:07.377927 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3747470-51de-4a07-b426-b1e1585954ef admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:07.443277 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3747470-51de-4a07-b426-b1e1585954ef admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:07.448648 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:07.450328 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1830169-fc9e-4c1e-950c-90bd61022fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:07.451030 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1830169-fc9e-4c1e-950c-90bd61022fac admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:07.451375 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1830169-fc9e-4c1e-950c-90bd61022fac admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:07.451650 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1830169-fc9e-4c1e-950c-90bd61022fac admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:07.452671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1830169-fc9e-4c1e-950c-90bd61022fac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:07.454601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1830169-fc9e-4c1e-950c-90bd61022fac admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:07.535501 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1021/2065] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:07 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:07.540792 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54b3c6-9012-41b1-b037-8d88ced6d03f None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:07.552660 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54b3c6-9012-41b1-b037-8d88ced6d03f None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:07.610427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d55d70-57e4-47df-b360-f8e411041451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:07.611032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d55d70-57e4-47df-b360-f8e411041451 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:07.611321 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d55d70-57e4-47df-b360-f8e411041451 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:07.611601 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d55d70-57e4-47df-b360-f8e411041451 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:07.612305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d55d70-57e4-47df-b360-f8e411041451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:07.614406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d55d70-57e4-47df-b360-f8e411041451 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:07.720988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1045/2066] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:07 2022] POST /identity/v3/users => generated 299 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:07.721722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1830169-fc9e-4c1e-950c-90bd61022fac admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:07.732188 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1830169-fc9e-4c1e-950c-90bd61022fac admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:07.738053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561ace4-42e6-4b57-a848-ed97ee9d1276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:07.738740 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561ace4-42e6-4b57-a848-ed97ee9d1276 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:07.739045 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561ace4-42e6-4b57-a848-ed97ee9d1276 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:07.739328 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561ace4-42e6-4b57-a848-ed97ee9d1276 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:07.740070 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561ace4-42e6-4b57-a848-ed97ee9d1276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:07.741700 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561ace4-42e6-4b57-a848-ed97ee9d1276 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:07.753045 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1022/2067] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:07.757615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d55d70-57e4-47df-b360-f8e411041451 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:07.770312 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d55d70-57e4-47df-b360-f8e411041451 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:07.775315 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5897db-72ec-4162-89f4-714cb92f373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:07.776276 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5897db-72ec-4162-89f4-714cb92f373d admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:07.776667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5897db-72ec-4162-89f4-714cb92f373d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:07.777730 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5897db-72ec-4162-89f4-714cb92f373d admin admin] PATH_INFO: `/v3/projects/36a63da2dafa4a3089af5e25a875943b/users/6cd609fa43c24e2ebcf0c6f380afe5fe/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:07.795990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5897db-72ec-4162-89f4-714cb92f373d admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a63da2dafa4a3089af5e25a875943b, user_id=6cd609fa43c24e2ebcf0c6f380afe5fe, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:07.799288 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5897db-72ec-4162-89f4-714cb92f373d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:07.864473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1046/2068] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:07 2022] PUT /identity/v3/projects/36a63da2dafa4a3089af5e25a875943b/users/6cd609fa43c24e2ebcf0c6f380afe5fe/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:07.870393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561ace4-42e6-4b57-a848-ed97ee9d1276 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:07.881393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561ace4-42e6-4b57-a848-ed97ee9d1276 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:07.941424 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6cb67-6da7-4105-aa60-e9ebf2417a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:07.941424 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6cb67-6da7-4105-aa60-e9ebf2417a3b admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:07.941710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6cb67-6da7-4105-aa60-e9ebf2417a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:07.941796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6cb67-6da7-4105-aa60-e9ebf2417a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:07.942532 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6cb67-6da7-4105-aa60-e9ebf2417a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:07.944189 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6cb67-6da7-4105-aa60-e9ebf2417a3b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:07.955504 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1023/2069] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:07.959524 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5897db-72ec-4162-89f4-714cb92f373d admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:07.970744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5897db-72ec-4162-89f4-714cb92f373d admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:07.975416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73267409-a648-48ef-8fcf-ea711cb15203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:07.976876 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73267409-a648-48ef-8fcf-ea711cb15203 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:07.977163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73267409-a648-48ef-8fcf-ea711cb15203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:07.977442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73267409-a648-48ef-8fcf-ea711cb15203 admin admin] PATH_INFO: `/v3/projects/36a63da2dafa4a3089af5e25a875943b/users/6cd609fa43c24e2ebcf0c6f380afe5fe/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:07.979449 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73267409-a648-48ef-8fcf-ea711cb15203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a63da2dafa4a3089af5e25a875943b, user_id=6cd609fa43c24e2ebcf0c6f380afe5fe, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:07.982165 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73267409-a648-48ef-8fcf-ea711cb15203 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:07.992595 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1047/2070] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:07 2022] PUT /identity/v3/projects/36a63da2dafa4a3089af5e25a875943b/users/6cd609fa43c24e2ebcf0c6f380afe5fe/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:08.004142 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b84d6-9050-4554-b4f3-9619e5eb9a7b None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:08.004563 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b84d6-9050-4554-b4f3-9619e5eb9a7b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:08.004919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b84d6-9050-4554-b4f3-9619e5eb9a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:08.034072 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d30b84d6-9050-4554-b4f3-9619e5eb9a7b None None] MFA Rules not processed for user `6cd609fa43c24e2ebcf0c6f380afe5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:08.036312 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d30b84d6-9050-4554-b4f3-9619e5eb9a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:08.109191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1024/2071] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:08.121883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73267409-a648-48ef-8fcf-ea711cb15203 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:08.123555 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-73267409-a648-48ef-8fcf-ea711cb15203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:08.192064 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73267409-a648-48ef-8fcf-ea711cb15203 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:08.196106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232469f-9552-460b-ba20-5f8bc3518066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:08.196826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232469f-9552-460b-ba20-5f8bc3518066 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:08.199179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232469f-9552-460b-ba20-5f8bc3518066 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:08.199179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232469f-9552-460b-ba20-5f8bc3518066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:08.210067 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232469f-9552-460b-ba20-5f8bc3518066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:08.211553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232469f-9552-460b-ba20-5f8bc3518066 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:08.221490 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1048/2072] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:58:08.251808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b84d6-9050-4554-b4f3-9619e5eb9a7b None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:08.337693 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b84d6-9050-4554-b4f3-9619e5eb9a7b None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:08.342485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de6977-5855-4ed4-ae82-b2e7e5391873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:08.343610 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de6977-5855-4ed4-ae82-b2e7e5391873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:08.343901 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de6977-5855-4ed4-ae82-b2e7e5391873 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:08.344202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de6977-5855-4ed4-ae82-b2e7e5391873 admin admin] PATH_INFO: `/v3/users/82919a5543ec436aa1751eb577a3eb38` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:08.345574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de6977-5855-4ed4-ae82-b2e7e5391873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82919a5543ec436aa1751eb577a3eb38)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:08.347566 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de6977-5855-4ed4-ae82-b2e7e5391873 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:08.370809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232469f-9552-460b-ba20-5f8bc3518066 service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:08.372268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-7232469f-9552-460b-ba20-5f8bc3518066 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:08.388993 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232469f-9552-460b-ba20-5f8bc3518066 service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:08.394110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b54eb-682f-408a-8215-7e4fe9f050b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:08.395056 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b54eb-682f-408a-8215-7e4fe9f050b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:08.395412 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b54eb-682f-408a-8215-7e4fe9f050b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:08.395759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b54eb-682f-408a-8215-7e4fe9f050b0 admin admin] PATH_INFO: `/v3/users/660539426fac4cdf946415c996739ff1` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:08.397065 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b54eb-682f-408a-8215-7e4fe9f050b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=660539426fac4cdf946415c996739ff1)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:08.399090 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b54eb-682f-408a-8215-7e4fe9f050b0 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:08.557632 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a1de6977-5855-4ed4-ae82-b2e7e5391873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82919a5543ec436aa1751eb577a3eb38'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:08.558311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a1de6977-5855-4ed4-ae82-b2e7e5391873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82919a5543ec436aa1751eb577a3eb38'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:08.636915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a1de6977-5855-4ed4-ae82-b2e7e5391873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82919a5543ec436aa1751eb577a3eb38'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:08.656921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a1de6977-5855-4ed4-ae82-b2e7e5391873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82919a5543ec436aa1751eb577a3eb38'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:08.657171 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-553b54eb-682f-408a-8215-7e4fe9f050b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '660539426fac4cdf946415c996739ff1'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:08.657171 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-553b54eb-682f-408a-8215-7e4fe9f050b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '660539426fac4cdf946415c996739ff1'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:08.670078 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a1de6977-5855-4ed4-ae82-b2e7e5391873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82919a5543ec436aa1751eb577a3eb38'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:08.676576 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1025/2073] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:08 2022] DELETE /identity/v3/users/82919a5543ec436aa1751eb577a3eb38 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:08.686507 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228efad-4b3e-40e8-9c7b-d6564eca777b None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:08.686809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228efad-4b3e-40e8-9c7b-d6564eca777b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:08.687092 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228efad-4b3e-40e8-9c7b-d6564eca777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:08.710247 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5228efad-4b3e-40e8-9c7b-d6564eca777b None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:08.711465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5228efad-4b3e-40e8-9c7b-d6564eca777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:08.745207 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-553b54eb-682f-408a-8215-7e4fe9f050b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '660539426fac4cdf946415c996739ff1'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:08.753637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-553b54eb-682f-408a-8215-7e4fe9f050b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '660539426fac4cdf946415c996739ff1'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:08.754419 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-553b54eb-682f-408a-8215-7e4fe9f050b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '660539426fac4cdf946415c996739ff1'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:08.773102 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1026/2074] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:08.787280 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1049/2075] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:08 2022] DELETE /identity/v3/users/660539426fac4cdf946415c996739ff1 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:08.787530 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9e70d-bee8-44a4-b691-87c7f59c5adc None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:08.787530 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9e70d-bee8-44a4-b691-87c7f59c5adc None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:08.787530 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9e70d-bee8-44a4-b691-87c7f59c5adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:08.787795 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b54eb-682f-408a-8215-7e4fe9f050b0 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:08.787795 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-553b54eb-682f-408a-8215-7e4fe9f050b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:08.797922 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-fef9e70d-bee8-44a4-b691-87c7f59c5adc None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:08.799199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fef9e70d-bee8-44a4-b691-87c7f59c5adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:08.845762 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b54eb-682f-408a-8215-7e4fe9f050b0 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:08.849495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a15b2-cd7d-4e32-afd7-220750ad1eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:08.850150 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a15b2-cd7d-4e32-afd7-220750ad1eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:08.850435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a15b2-cd7d-4e32-afd7-220750ad1eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:08.850718 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a15b2-cd7d-4e32-afd7-220750ad1eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:08.860520 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1027/2076] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:08.878542 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9e70d-bee8-44a4-b691-87c7f59c5adc None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:08.881432 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fef9e70d-bee8-44a4-b691-87c7f59c5adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:08.898785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9e70d-bee8-44a4-b691-87c7f59c5adc None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:08.903869 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2252c4a-80e8-4492-aef4-065c828dd8be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:08.904707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2252c4a-80e8-4492-aef4-065c828dd8be service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:08.905089 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2252c4a-80e8-4492-aef4-065c828dd8be service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:08.905478 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2252c4a-80e8-4492-aef4-065c828dd8be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:08.916097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:08.919302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2252c4a-80e8-4492-aef4-065c828dd8be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:08.919302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2252c4a-80e8-4492-aef4-065c828dd8be service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:08.932612 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1028/2077] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:08.934305 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2252c4a-80e8-4492-aef4-065c828dd8be service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:08.936020 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f2252c4a-80e8-4492-aef4-065c828dd8be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:08.940197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a15b2-cd7d-4e32-afd7-220750ad1eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:08.941965 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a15b2-cd7d-4e32-afd7-220750ad1eb4 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:08.950493 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2252c4a-80e8-4492-aef4-065c828dd8be service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:08.956487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f76a5-9bc1-40aa-9f45-e7fa5efea812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:08.957369 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f76a5-9bc1-40aa-9f45-e7fa5efea812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:08.957691 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f76a5-9bc1-40aa-9f45-e7fa5efea812 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:08.957920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f76a5-9bc1-40aa-9f45-e7fa5efea812 admin admin] PATH_INFO: `/v3/users/11e0adf023364295a05f6e121fbf1fb1` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:08.958798 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1050/2078] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:08.959179 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f76a5-9bc1-40aa-9f45-e7fa5efea812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e0adf023364295a05f6e121fbf1fb1)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:08.961330 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f76a5-9bc1-40aa-9f45-e7fa5efea812 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:09.121186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:09.209558 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fa5f76a5-9bc1-40aa-9f45-e7fa5efea812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e0adf023364295a05f6e121fbf1fb1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:09.210321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fa5f76a5-9bc1-40aa-9f45-e7fa5efea812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e0adf023364295a05f6e121fbf1fb1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:09.327829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fa5f76a5-9bc1-40aa-9f45-e7fa5efea812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e0adf023364295a05f6e121fbf1fb1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:09.339978 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fa5f76a5-9bc1-40aa-9f45-e7fa5efea812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e0adf023364295a05f6e121fbf1fb1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:09.362668 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fa5f76a5-9bc1-40aa-9f45-e7fa5efea812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e0adf023364295a05f6e121fbf1fb1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:09.374734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1029/2079] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:08 2022] DELETE /identity/v3/users/11e0adf023364295a05f6e121fbf1fb1 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:09.379714 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28031b-068f-4e49-b180-ef5042b406ae None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:09.380695 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28031b-068f-4e49-b180-ef5042b406ae None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:09.380695 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28031b-068f-4e49-b180-ef5042b406ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:09.418869 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-2a28031b-068f-4e49-b180-ef5042b406ae None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:09.420123 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2a28031b-068f-4e49-b180-ef5042b406ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:09.502631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1051/2080] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:09.532270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f76a5-9bc1-40aa-9f45-e7fa5efea812 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:09.534372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fa5f76a5-9bc1-40aa-9f45-e7fa5efea812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:09.603026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f76a5-9bc1-40aa-9f45-e7fa5efea812 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:09.608641 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dcdd0-20a9-4d87-b773-c2621001f15c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:09.609333 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dcdd0-20a9-4d87-b773-c2621001f15c service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:09.609663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dcdd0-20a9-4d87-b773-c2621001f15c service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:09.609941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dcdd0-20a9-4d87-b773-c2621001f15c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:09.620750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dcdd0-20a9-4d87-b773-c2621001f15c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:09.622446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dcdd0-20a9-4d87-b773-c2621001f15c service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:09.634194 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1030/2081] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:58:09.793415 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28031b-068f-4e49-b180-ef5042b406ae None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:09.795201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2a28031b-068f-4e49-b180-ef5042b406ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:09.824738 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28031b-068f-4e49-b180-ef5042b406ae None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:09.831417 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e50c24-4a17-402f-a909-f333486b836c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:09.833498 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e50c24-4a17-402f-a909-f333486b836c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:09.834442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e50c24-4a17-402f-a909-f333486b836c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:09.835112 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e50c24-4a17-402f-a909-f333486b836c admin admin] PATH_INFO: `/v3/projects/e09da0fce7694ab3a3d21bbcab424a66` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:09.838090 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e50c24-4a17-402f-a909-f333486b836c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e09da0fce7694ab3a3d21bbcab424a66)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:09.841208 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e50c24-4a17-402f-a909-f333486b836c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:10.008288 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-84e50c24-4a17-402f-a909-f333486b836c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e09da0fce7694ab3a3d21bbcab424a66', 'request_id': 'req-84e50c24-4a17-402f-a909-f333486b836c'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.054036 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dcdd0-20a9-4d87-b773-c2621001f15c service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:10.055582 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-051dcdd0-20a9-4d87-b773-c2621001f15c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:10.071849 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dcdd0-20a9-4d87-b773-c2621001f15c service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:10.075476 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-84e50c24-4a17-402f-a909-f333486b836c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e09da0fce7694ab3a3d21bbcab424a66', 'request_id': 'req-84e50c24-4a17-402f-a909-f333486b836c'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.087397 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-84e50c24-4a17-402f-a909-f333486b836c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e09da0fce7694ab3a3d21bbcab424a66', 'request_id': 'req-84e50c24-4a17-402f-a909-f333486b836c'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.108850 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-84e50c24-4a17-402f-a909-f333486b836c admin admin] The token cache is being invalidate because project e09da0fce7694ab3a3d21bbcab424a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:10.109360 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-84e50c24-4a17-402f-a909-f333486b836c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.110233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-84e50c24-4a17-402f-a909-f333486b836c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.111970 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1052/2082] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:09 2022] DELETE /identity/v3/projects/e09da0fce7694ab3a3d21bbcab424a66 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:10.117319 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e50c24-4a17-402f-a909-f333486b836c admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:10.122020 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-84e50c24-4a17-402f-a909-f333486b836c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:10.186840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0b071-7c2b-41c8-a8e7-7c6be3fbc231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:10.188847 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0b071-7c2b-41c8-a8e7-7c6be3fbc231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:10.189146 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0b071-7c2b-41c8-a8e7-7c6be3fbc231 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:10.189434 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0b071-7c2b-41c8-a8e7-7c6be3fbc231 admin admin] PATH_INFO: `/v3/projects/ac808859d8c54c58946a73d7934a7338` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:10.190902 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0b071-7c2b-41c8-a8e7-7c6be3fbc231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac808859d8c54c58946a73d7934a7338)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:10.196663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0b071-7c2b-41c8-a8e7-7c6be3fbc231 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:10.226080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:10.271244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e50c24-4a17-402f-a909-f333486b836c admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:10.277161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048ad76-7729-41d8-8231-3a6f2166cfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:10.278340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048ad76-7729-41d8-8231-3a6f2166cfa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:10.278618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048ad76-7729-41d8-8231-3a6f2166cfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:10.278894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048ad76-7729-41d8-8231-3a6f2166cfa2 admin admin] PATH_INFO: `/v3/users/6cd609fa43c24e2ebcf0c6f380afe5fe` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:10.280169 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048ad76-7729-41d8-8231-3a6f2166cfa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd609fa43c24e2ebcf0c6f380afe5fe)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:10.282673 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048ad76-7729-41d8-8231-3a6f2166cfa2 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:10.379682 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-37b0b071-7c2b-41c8-a8e7-7c6be3fbc231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac808859d8c54c58946a73d7934a7338', 'request_id': 'req-37b0b071-7c2b-41c8-a8e7-7c6be3fbc231'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.394146 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-37b0b071-7c2b-41c8-a8e7-7c6be3fbc231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac808859d8c54c58946a73d7934a7338', 'request_id': 'req-37b0b071-7c2b-41c8-a8e7-7c6be3fbc231'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.419477 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-37b0b071-7c2b-41c8-a8e7-7c6be3fbc231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac808859d8c54c58946a73d7934a7338', 'request_id': 'req-37b0b071-7c2b-41c8-a8e7-7c6be3fbc231'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.450018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4048ad76-7729-41d8-8231-3a6f2166cfa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd609fa43c24e2ebcf0c6f380afe5fe'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.450874 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4048ad76-7729-41d8-8231-3a6f2166cfa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd609fa43c24e2ebcf0c6f380afe5fe'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.522517 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-37b0b071-7c2b-41c8-a8e7-7c6be3fbc231 admin admin] The token cache is being invalidate because project ac808859d8c54c58946a73d7934a7338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:10.522865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-37b0b071-7c2b-41c8-a8e7-7c6be3fbc231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.523517 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-37b0b071-7c2b-41c8-a8e7-7c6be3fbc231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.525341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1031/2083] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:10 2022] DELETE /identity/v3/projects/ac808859d8c54c58946a73d7934a7338 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:10.525897 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0b071-7c2b-41c8-a8e7-7c6be3fbc231 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:10.527253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-37b0b071-7c2b-41c8-a8e7-7c6be3fbc231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:10.593020 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0b071-7c2b-41c8-a8e7-7c6be3fbc231 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:10.597698 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502eab8-a84d-4e6a-9a87-e558272a7e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:10.598561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502eab8-a84d-4e6a-9a87-e558272a7e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:10.598839 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502eab8-a84d-4e6a-9a87-e558272a7e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:10.599110 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502eab8-a84d-4e6a-9a87-e558272a7e7e admin admin] PATH_INFO: `/v3/projects/c9aa3ab1f27947929fc8cd3198412a44` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:10.600317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502eab8-a84d-4e6a-9a87-e558272a7e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9aa3ab1f27947929fc8cd3198412a44)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:10.602405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502eab8-a84d-4e6a-9a87-e558272a7e7e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:10.613038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4048ad76-7729-41d8-8231-3a6f2166cfa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd609fa43c24e2ebcf0c6f380afe5fe'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.621276 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4048ad76-7729-41d8-8231-3a6f2166cfa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd609fa43c24e2ebcf0c6f380afe5fe'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.622252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4048ad76-7729-41d8-8231-3a6f2166cfa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd609fa43c24e2ebcf0c6f380afe5fe'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.640627 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1053/2084] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:10 2022] DELETE /identity/v3/users/6cd609fa43c24e2ebcf0c6f380afe5fe => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:10.641526 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048ad76-7729-41d8-8231-3a6f2166cfa2 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:10.643242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-4048ad76-7729-41d8-8231-3a6f2166cfa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:10.708055 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048ad76-7729-41d8-8231-3a6f2166cfa2 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:10.713179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78588a9d-d276-480d-89e8-eb6dd2ad27db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:10.714315 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78588a9d-d276-480d-89e8-eb6dd2ad27db admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:10.714847 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78588a9d-d276-480d-89e8-eb6dd2ad27db admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:10.715315 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78588a9d-d276-480d-89e8-eb6dd2ad27db admin admin] PATH_INFO: `/v3/users/2b9895792d9a4bfc83b42f5134ed9a35` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:10.717003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78588a9d-d276-480d-89e8-eb6dd2ad27db admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b9895792d9a4bfc83b42f5134ed9a35)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:10.718948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78588a9d-d276-480d-89e8-eb6dd2ad27db admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:10.751628 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2502eab8-a84d-4e6a-9a87-e558272a7e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9aa3ab1f27947929fc8cd3198412a44', 'request_id': 'req-2502eab8-a84d-4e6a-9a87-e558272a7e7e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.757160 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2502eab8-a84d-4e6a-9a87-e558272a7e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9aa3ab1f27947929fc8cd3198412a44', 'request_id': 'req-2502eab8-a84d-4e6a-9a87-e558272a7e7e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.763746 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2502eab8-a84d-4e6a-9a87-e558272a7e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9aa3ab1f27947929fc8cd3198412a44', 'request_id': 'req-2502eab8-a84d-4e6a-9a87-e558272a7e7e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.868903 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2502eab8-a84d-4e6a-9a87-e558272a7e7e admin admin] The token cache is being invalidate because project c9aa3ab1f27947929fc8cd3198412a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:10.869556 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2502eab8-a84d-4e6a-9a87-e558272a7e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.871119 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2502eab8-a84d-4e6a-9a87-e558272a7e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:10.873772 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1032/2085] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:10 2022] DELETE /identity/v3/projects/c9aa3ab1f27947929fc8cd3198412a44 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:10.877610 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502eab8-a84d-4e6a-9a87-e558272a7e7e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:10.879470 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2502eab8-a84d-4e6a-9a87-e558272a7e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:10.956678 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502eab8-a84d-4e6a-9a87-e558272a7e7e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:10.962685 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e95e60-e4c5-44bb-a277-8291e20c8e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:10.963909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e95e60-e4c5-44bb-a277-8291e20c8e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:10.964344 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e95e60-e4c5-44bb-a277-8291e20c8e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:10.964932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e95e60-e4c5-44bb-a277-8291e20c8e79 admin admin] PATH_INFO: `/v3/users/3171a75c15cb4f84bb93d22fe8f6dec3` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:10.967350 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e95e60-e4c5-44bb-a277-8291e20c8e79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3171a75c15cb4f84bb93d22fe8f6dec3)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:10.969919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e95e60-e4c5-44bb-a277-8291e20c8e79 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:11.009530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-78588a9d-d276-480d-89e8-eb6dd2ad27db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b9895792d9a4bfc83b42f5134ed9a35'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:11.011752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-78588a9d-d276-480d-89e8-eb6dd2ad27db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b9895792d9a4bfc83b42f5134ed9a35'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:11.083037 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-78588a9d-d276-480d-89e8-eb6dd2ad27db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b9895792d9a4bfc83b42f5134ed9a35'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:11.094239 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-78588a9d-d276-480d-89e8-eb6dd2ad27db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b9895792d9a4bfc83b42f5134ed9a35'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:11.094982 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-78588a9d-d276-480d-89e8-eb6dd2ad27db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b9895792d9a4bfc83b42f5134ed9a35'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:11.115090 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1054/2086] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:10 2022] DELETE /identity/v3/users/2b9895792d9a4bfc83b42f5134ed9a35 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:11.203977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-13e95e60-e4c5-44bb-a277-8291e20c8e79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3171a75c15cb4f84bb93d22fe8f6dec3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:11.204671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-13e95e60-e4c5-44bb-a277-8291e20c8e79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3171a75c15cb4f84bb93d22fe8f6dec3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:11.248409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78588a9d-d276-480d-89e8-eb6dd2ad27db admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:11.249899 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-78588a9d-d276-480d-89e8-eb6dd2ad27db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:11.273151 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-13e95e60-e4c5-44bb-a277-8291e20c8e79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3171a75c15cb4f84bb93d22fe8f6dec3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:11.288070 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-13e95e60-e4c5-44bb-a277-8291e20c8e79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3171a75c15cb4f84bb93d22fe8f6dec3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:11.300362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-13e95e60-e4c5-44bb-a277-8291e20c8e79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3171a75c15cb4f84bb93d22fe8f6dec3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:11.307362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1033/2087] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:10 2022] DELETE /identity/v3/users/3171a75c15cb4f84bb93d22fe8f6dec3 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:11.333587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:11.335489 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78588a9d-d276-480d-89e8-eb6dd2ad27db admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:11.392917 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25f6cb-d9d7-4bda-aeda-594c9103df36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:11.393962 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25f6cb-d9d7-4bda-aeda-594c9103df36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:11.394372 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25f6cb-d9d7-4bda-aeda-594c9103df36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:11.394701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25f6cb-d9d7-4bda-aeda-594c9103df36 admin admin] PATH_INFO: `/v3/projects/36a63da2dafa4a3089af5e25a875943b` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:11.395958 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25f6cb-d9d7-4bda-aeda-594c9103df36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36a63da2dafa4a3089af5e25a875943b)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:11.398490 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25f6cb-d9d7-4bda-aeda-594c9103df36 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:11.545171 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ed25f6cb-d9d7-4bda-aeda-594c9103df36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36a63da2dafa4a3089af5e25a875943b', 'request_id': 'req-ed25f6cb-d9d7-4bda-aeda-594c9103df36'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:11.659073 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ed25f6cb-d9d7-4bda-aeda-594c9103df36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36a63da2dafa4a3089af5e25a875943b', 'request_id': 'req-ed25f6cb-d9d7-4bda-aeda-594c9103df36'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:11.666304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ed25f6cb-d9d7-4bda-aeda-594c9103df36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36a63da2dafa4a3089af5e25a875943b', 'request_id': 'req-ed25f6cb-d9d7-4bda-aeda-594c9103df36'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:11.670153 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e95e60-e4c5-44bb-a277-8291e20c8e79 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:11.671775 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-13e95e60-e4c5-44bb-a277-8291e20c8e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:11.678459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ed25f6cb-d9d7-4bda-aeda-594c9103df36 admin admin] The token cache is being invalidate because project 36a63da2dafa4a3089af5e25a875943b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:11.678961 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ed25f6cb-d9d7-4bda-aeda-594c9103df36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:11.679613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ed25f6cb-d9d7-4bda-aeda-594c9103df36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:11.681853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1055/2088] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:11 2022] DELETE /identity/v3/projects/36a63da2dafa4a3089af5e25a875943b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:11.688119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:11.688380 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e95e60-e4c5-44bb-a277-8291e20c8e79 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:11.690169 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2db7f3-f4c3-4f80-ae4c-90ceaca1abfb None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:11.690525 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2db7f3-f4c3-4f80-ae4c-90ceaca1abfb None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:11.690884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2db7f3-f4c3-4f80-ae4c-90ceaca1abfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:11.728679 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-7a2db7f3-f4c3-4f80-ae4c-90ceaca1abfb None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:11.728679 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-7a2db7f3-f4c3-4f80-ae4c-90ceaca1abfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:11.787133 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfc048-6510-4fb7-8d7e-2938f3a9a98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:11.788304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1056/2089] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:11.788932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfc048-6510-4fb7-8d7e-2938f3a9a98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:11.789534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfc048-6510-4fb7-8d7e-2938f3a9a98c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:11.790029 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfc048-6510-4fb7-8d7e-2938f3a9a98c admin admin] PATH_INFO: `/v3/projects/dfa71b6d1d0544aabde8b29e2ed617aa` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:11.797443 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d2926-f2c8-4545-a6b9-2df5a9948fc7 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:11.797632 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfc048-6510-4fb7-8d7e-2938f3a9a98c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa71b6d1d0544aabde8b29e2ed617aa)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:11.797787 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d2926-f2c8-4545-a6b9-2df5a9948fc7 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:11.798008 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d2926-f2c8-4545-a6b9-2df5a9948fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:11.801311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfc048-6510-4fb7-8d7e-2938f3a9a98c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:11.816430 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-655d2926-f2c8-4545-a6b9-2df5a9948fc7 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:11.817687 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-655d2926-f2c8-4545-a6b9-2df5a9948fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:11.825632 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1057/2090] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:58:11.829802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d2926-f2c8-4545-a6b9-2df5a9948fc7 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:11.838511 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d2926-f2c8-4545-a6b9-2df5a9948fc7 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:11.843878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee78d8-4967-4cfa-b2b3-4c8017b3d771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:11.844615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee78d8-4967-4cfa-b2b3-4c8017b3d771 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:11.844901 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee78d8-4967-4cfa-b2b3-4c8017b3d771 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:11.845177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee78d8-4967-4cfa-b2b3-4c8017b3d771 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:11.845916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee78d8-4967-4cfa-b2b3-4c8017b3d771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:58:11.846221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee78d8-4967-4cfa-b2b3-4c8017b3d771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:11.847828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee78d8-4967-4cfa-b2b3-4c8017b3d771 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:11.861054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1058/2091] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:58:11.862097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee78d8-4967-4cfa-b2b3-4c8017b3d771 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:11.863868 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-a3ee78d8-4967-4cfa-b2b3-4c8017b3d771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:11.876849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee78d8-4967-4cfa-b2b3-4c8017b3d771 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:11.881593 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7543ce-42ff-4dca-bca1-dafe636e7b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:11.884278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7543ce-42ff-4dca-bca1-dafe636e7b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:11.884278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7543ce-42ff-4dca-bca1-dafe636e7b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:11.884278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7543ce-42ff-4dca-bca1-dafe636e7b9d admin admin] PATH_INFO: `/v3/projects/62ef5b8a2b614632a7bc720b19be4cd3` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:11.884556 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7543ce-42ff-4dca-bca1-dafe636e7b9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=62ef5b8a2b614632a7bc720b19be4cd3)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:11.886478 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7543ce-42ff-4dca-bca1-dafe636e7b9d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:11.920405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-edcfc048-6510-4fb7-8d7e-2938f3a9a98c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa71b6d1d0544aabde8b29e2ed617aa', 'request_id': 'req-edcfc048-6510-4fb7-8d7e-2938f3a9a98c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:11.925981 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-edcfc048-6510-4fb7-8d7e-2938f3a9a98c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa71b6d1d0544aabde8b29e2ed617aa', 'request_id': 'req-edcfc048-6510-4fb7-8d7e-2938f3a9a98c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:11.932317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-edcfc048-6510-4fb7-8d7e-2938f3a9a98c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa71b6d1d0544aabde8b29e2ed617aa', 'request_id': 'req-edcfc048-6510-4fb7-8d7e-2938f3a9a98c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:12.011231 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9c7543ce-42ff-4dca-bca1-dafe636e7b9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62ef5b8a2b614632a7bc720b19be4cd3', 'request_id': 'req-9c7543ce-42ff-4dca-bca1-dafe636e7b9d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:12.024232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-edcfc048-6510-4fb7-8d7e-2938f3a9a98c admin admin] The token cache is being invalidate because project dfa71b6d1d0544aabde8b29e2ed617aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:12.024551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-edcfc048-6510-4fb7-8d7e-2938f3a9a98c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:12.025181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-edcfc048-6510-4fb7-8d7e-2938f3a9a98c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:12.027274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1034/2092] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:11 2022] DELETE /identity/v3/projects/dfa71b6d1d0544aabde8b29e2ed617aa => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:12.030470 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfc048-6510-4fb7-8d7e-2938f3a9a98c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:12.030470 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-edcfc048-6510-4fb7-8d7e-2938f3a9a98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:12.093447 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfc048-6510-4fb7-8d7e-2938f3a9a98c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:12.118651 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9c7543ce-42ff-4dca-bca1-dafe636e7b9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62ef5b8a2b614632a7bc720b19be4cd3', 'request_id': 'req-9c7543ce-42ff-4dca-bca1-dafe636e7b9d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:12.126147 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9c7543ce-42ff-4dca-bca1-dafe636e7b9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62ef5b8a2b614632a7bc720b19be4cd3', 'request_id': 'req-9c7543ce-42ff-4dca-bca1-dafe636e7b9d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:12.137478 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9c7543ce-42ff-4dca-bca1-dafe636e7b9d admin admin] The token cache is being invalidate because project 62ef5b8a2b614632a7bc720b19be4cd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:12.137763 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9c7543ce-42ff-4dca-bca1-dafe636e7b9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:12.138498 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9c7543ce-42ff-4dca-bca1-dafe636e7b9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:12.140735 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1059/2093] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:11 2022] DELETE /identity/v3/projects/62ef5b8a2b614632a7bc720b19be4cd3 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:12.145608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7543ce-42ff-4dca-bca1-dafe636e7b9d admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:12.147287 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-9c7543ce-42ff-4dca-bca1-dafe636e7b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:12.169742 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440427e-ede3-4d00-803e-23c6e78f1e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:12.170426 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440427e-ede3-4d00-803e-23c6e78f1e44 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:12.170715 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440427e-ede3-4d00-803e-23c6e78f1e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:12.170998 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440427e-ede3-4d00-803e-23c6e78f1e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:12.171708 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440427e-ede3-4d00-803e-23c6e78f1e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:12.173678 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440427e-ede3-4d00-803e-23c6e78f1e44 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:12.183891 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7543ce-42ff-4dca-bca1-dafe636e7b9d admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:12.190612 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14dde2-4fb5-4d15-ad72-d75f6ecb31a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:12.191520 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14dde2-4fb5-4d15-ad72-d75f6ecb31a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:12.191806 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14dde2-4fb5-4d15-ad72-d75f6ecb31a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:12.192082 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14dde2-4fb5-4d15-ad72-d75f6ecb31a3 admin admin] PATH_INFO: `/v3/users/c302d698765e4bd19b57ca5d07f62bc6` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:12.194167 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14dde2-4fb5-4d15-ad72-d75f6ecb31a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c302d698765e4bd19b57ca5d07f62bc6)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:12.196082 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14dde2-4fb5-4d15-ad72-d75f6ecb31a3 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:12.261589 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1035/2094] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:12 2022] POST /identity/v3/projects => generated 377 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:12.262813 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec31835-dace-4f30-bef6-ec0bf9ae5dc6 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:12.263107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec31835-dace-4f30-bef6-ec0bf9ae5dc6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:12.263388 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec31835-dace-4f30-bef6-ec0bf9ae5dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:12.287762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-aec31835-dace-4f30-bef6-ec0bf9ae5dc6 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:12.289014 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-aec31835-dace-4f30-bef6-ec0bf9ae5dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:12.355676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1036/2095] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:12.355676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec31835-dace-4f30-bef6-ec0bf9ae5dc6 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:12.355676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-aec31835-dace-4f30-bef6-ec0bf9ae5dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:12.362002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec31835-dace-4f30-bef6-ec0bf9ae5dc6 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:12.366585 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f727d-d809-4ad4-b6f6-3fe425115221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:12.367234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f727d-d809-4ad4-b6f6-3fe425115221 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:12.367522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f727d-d809-4ad4-b6f6-3fe425115221 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:12.367799 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f727d-d809-4ad4-b6f6-3fe425115221 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:12.368501 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f727d-d809-4ad4-b6f6-3fe425115221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:12.370963 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f727d-d809-4ad4-b6f6-3fe425115221 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:12.409479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-dd14dde2-4fb5-4d15-ad72-d75f6ecb31a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c302d698765e4bd19b57ca5d07f62bc6'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:12.410142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-dd14dde2-4fb5-4d15-ad72-d75f6ecb31a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c302d698765e4bd19b57ca5d07f62bc6'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:12.474681 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1037/2096] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:12 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:12.476121 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7319ed1-df3b-4822-89dc-691b53844d96 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:12.476481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7319ed1-df3b-4822-89dc-691b53844d96 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:12.476770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7319ed1-df3b-4822-89dc-691b53844d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:12.496927 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d7319ed1-df3b-4822-89dc-691b53844d96 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:12.498155 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d7319ed1-df3b-4822-89dc-691b53844d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:12.503381 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-dd14dde2-4fb5-4d15-ad72-d75f6ecb31a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c302d698765e4bd19b57ca5d07f62bc6'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:12.506522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1038/2097] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:12.507384 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7319ed1-df3b-4822-89dc-691b53844d96 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:12.509033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d7319ed1-df3b-4822-89dc-691b53844d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:12.511715 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-dd14dde2-4fb5-4d15-ad72-d75f6ecb31a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c302d698765e4bd19b57ca5d07f62bc6'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:12.513172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-dd14dde2-4fb5-4d15-ad72-d75f6ecb31a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c302d698765e4bd19b57ca5d07f62bc6'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:12.520973 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7319ed1-df3b-4822-89dc-691b53844d96 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:12.525725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90dd55-5f44-49af-b6c9-6885d2f0264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:12.526889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90dd55-5f44-49af-b6c9-6885d2f0264b admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:12.527181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90dd55-5f44-49af-b6c9-6885d2f0264b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:12.527462 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90dd55-5f44-49af-b6c9-6885d2f0264b admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:12.528197 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90dd55-5f44-49af-b6c9-6885d2f0264b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:12.529843 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90dd55-5f44-49af-b6c9-6885d2f0264b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:12.532050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1060/2098] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:12 2022] DELETE /identity/v3/users/c302d698765e4bd19b57ca5d07f62bc6 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:12.533030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14dde2-4fb5-4d15-ad72-d75f6ecb31a3 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:12.543574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1039/2099] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:12.545603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90dd55-5f44-49af-b6c9-6885d2f0264b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:12.556513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90dd55-5f44-49af-b6c9-6885d2f0264b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:12.611981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14dde2-4fb5-4d15-ad72-d75f6ecb31a3 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:12.615514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:12.617992 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76f531-2e8e-4f90-a86d-84d40383e7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:12.618990 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76f531-2e8e-4f90-a86d-84d40383e7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:12.619104 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76f531-2e8e-4f90-a86d-84d40383e7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:12.620469 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76f531-2e8e-4f90-a86d-84d40383e7a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:12.620469 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76f531-2e8e-4f90-a86d-84d40383e7a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:58:12.620469 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76f531-2e8e-4f90-a86d-84d40383e7a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:12.622243 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76f531-2e8e-4f90-a86d-84d40383e7a5 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:12.628522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c4056-9fb7-4c29-ad1f-50ea48561c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:12.629203 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c4056-9fb7-4c29-ad1f-50ea48561c1e admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:12.629497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c4056-9fb7-4c29-ad1f-50ea48561c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:12.630181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c4056-9fb7-4c29-ad1f-50ea48561c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:12.630508 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c4056-9fb7-4c29-ad1f-50ea48561c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:12.632178 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c4056-9fb7-4c29-ad1f-50ea48561c1e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:12.638634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1061/2100] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:58:12.640050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76f531-2e8e-4f90-a86d-84d40383e7a5 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:12.643997 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1040/2101] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:12.650352 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76f531-2e8e-4f90-a86d-84d40383e7a5 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:12.650695 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c4056-9fb7-4c29-ad1f-50ea48561c1e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:12.655653 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630da20e-450f-4620-a648-88b192a8a9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:12.656314 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630da20e-450f-4620-a648-88b192a8a9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:12.657079 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630da20e-450f-4620-a648-88b192a8a9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:12.657079 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630da20e-450f-4620-a648-88b192a8a9d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:12.657597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630da20e-450f-4620-a648-88b192a8a9d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:12.659501 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630da20e-450f-4620-a648-88b192a8a9d5 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:12.661077 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c4056-9fb7-4c29-ad1f-50ea48561c1e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:12.666216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a8303-cd06-42e6-ae38-3347c15b3596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:12.667718 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a8303-cd06-42e6-ae38-3347c15b3596 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:12.668012 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a8303-cd06-42e6-ae38-3347c15b3596 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:12.668294 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a8303-cd06-42e6-ae38-3347c15b3596 admin admin] PATH_INFO: `/v3/projects/d0927e4c434749f6a1642da9e90c2a8c/users/748f65a1d94d4608a0545d1286584a3d/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:12.683714 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a8303-cd06-42e6-ae38-3347c15b3596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0927e4c434749f6a1642da9e90c2a8c, user_id=748f65a1d94d4608a0545d1286584a3d, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:12.686413 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a8303-cd06-42e6-ae38-3347c15b3596 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:12.778262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1062/2102] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:12 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:58:12.779174 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630da20e-450f-4620-a648-88b192a8a9d5 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:12.782278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1041/2103] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:12 2022] PUT /identity/v3/projects/d0927e4c434749f6a1642da9e90c2a8c/users/748f65a1d94d4608a0545d1286584a3d/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:12.794006 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4fbca-1ff7-4c83-95de-89b8d5654d6e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:12.794631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4fbca-1ff7-4c83-95de-89b8d5654d6e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:12.794631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4fbca-1ff7-4c83-95de-89b8d5654d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:12.866143 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-03a4fbca-1ff7-4c83-95de-89b8d5654d6e None None] MFA Rules not processed for user `748f65a1d94d4608a0545d1286584a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:12.868157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-03a4fbca-1ff7-4c83-95de-89b8d5654d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:12.868275 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630da20e-450f-4620-a648-88b192a8a9d5 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:12.948927 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00df33-2ae0-4d03-8ce6-ebf5390a532e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:12.949626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00df33-2ae0-4d03-8ce6-ebf5390a532e admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:12.949915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00df33-2ae0-4d03-8ce6-ebf5390a532e admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:12.950201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00df33-2ae0-4d03-8ce6-ebf5390a532e admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:12.950933 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00df33-2ae0-4d03-8ce6-ebf5390a532e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:12.952934 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1042/2104] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:12.953056 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00df33-2ae0-4d03-8ce6-ebf5390a532e admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:12.958310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4fbca-1ff7-4c83-95de-89b8d5654d6e None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:12.973104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4fbca-1ff7-4c83-95de-89b8d5654d6e None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:12.977931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaece8c-78f4-42de-9625-785c72b11854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:12.979054 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaece8c-78f4-42de-9625-785c72b11854 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:12.979054 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaece8c-78f4-42de-9625-785c72b11854 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:12.979977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaece8c-78f4-42de-9625-785c72b11854 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:12.980701 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaece8c-78f4-42de-9625-785c72b11854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:12.982988 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaece8c-78f4-42de-9625-785c72b11854 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:13.037221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1063/2105] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:12 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:13.038354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00df33-2ae0-4d03-8ce6-ebf5390a532e admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:13.040271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5f00df33-2ae0-4d03-8ce6-ebf5390a532e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:13.053715 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00df33-2ae0-4d03-8ce6-ebf5390a532e admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:13.062656 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1043/2106] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:12 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:13.062839 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95709bbb-f1c0-4537-b8c4-1c795207be78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:13.063144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaece8c-78f4-42de-9625-785c72b11854 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:13.063244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95709bbb-f1c0-4537-b8c4-1c795207be78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:13.063244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95709bbb-f1c0-4537-b8c4-1c795207be78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:13.063244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95709bbb-f1c0-4537-b8c4-1c795207be78 admin admin] PATH_INFO: `/v3/projects/02ddb0ec037545e5b6fae23d91288d3c` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:13.063728 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95709bbb-f1c0-4537-b8c4-1c795207be78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02ddb0ec037545e5b6fae23d91288d3c)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:13.065703 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95709bbb-f1c0-4537-b8c4-1c795207be78 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:13.133573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaece8c-78f4-42de-9625-785c72b11854 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:13.138872 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb421524-0113-4d8f-866f-98aa7f0c5eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:13.139562 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb421524-0113-4d8f-866f-98aa7f0c5eee admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:13.139852 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb421524-0113-4d8f-866f-98aa7f0c5eee admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:13.140129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb421524-0113-4d8f-866f-98aa7f0c5eee admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:13.140901 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb421524-0113-4d8f-866f-98aa7f0c5eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:13.142489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb421524-0113-4d8f-866f-98aa7f0c5eee admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:13.154060 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1044/2107] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:13.155290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb421524-0113-4d8f-866f-98aa7f0c5eee admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:13.173912 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb421524-0113-4d8f-866f-98aa7f0c5eee admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:13.175702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-95709bbb-f1c0-4537-b8c4-1c795207be78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02ddb0ec037545e5b6fae23d91288d3c', 'request_id': 'req-95709bbb-f1c0-4537-b8c4-1c795207be78'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:13.237315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741327fd-69fc-4b86-8f03-3f95fcd477fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:13.237991 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741327fd-69fc-4b86-8f03-3f95fcd477fc admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:13.238296 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741327fd-69fc-4b86-8f03-3f95fcd477fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:13.238573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741327fd-69fc-4b86-8f03-3f95fcd477fc admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:13.239266 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741327fd-69fc-4b86-8f03-3f95fcd477fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:13.241266 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741327fd-69fc-4b86-8f03-3f95fcd477fc admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:13.241683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-95709bbb-f1c0-4537-b8c4-1c795207be78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02ddb0ec037545e5b6fae23d91288d3c', 'request_id': 'req-95709bbb-f1c0-4537-b8c4-1c795207be78'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:13.250867 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-95709bbb-f1c0-4537-b8c4-1c795207be78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02ddb0ec037545e5b6fae23d91288d3c', 'request_id': 'req-95709bbb-f1c0-4537-b8c4-1c795207be78'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:13.265463 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-95709bbb-f1c0-4537-b8c4-1c795207be78 admin admin] The token cache is being invalidate because project 02ddb0ec037545e5b6fae23d91288d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:13.266205 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-95709bbb-f1c0-4537-b8c4-1c795207be78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:13.267085 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-95709bbb-f1c0-4537-b8c4-1c795207be78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:13.274482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1064/2108] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:13 2022] DELETE /identity/v3/projects/02ddb0ec037545e5b6fae23d91288d3c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:13.274482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95709bbb-f1c0-4537-b8c4-1c795207be78 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:13.274482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-95709bbb-f1c0-4537-b8c4-1c795207be78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:13.295011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95709bbb-f1c0-4537-b8c4-1c795207be78 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:13.299760 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d51cfc-b7de-4d4c-9d23-e1c60b4aba70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:13.300861 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d51cfc-b7de-4d4c-9d23-e1c60b4aba70 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:13.300861 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d51cfc-b7de-4d4c-9d23-e1c60b4aba70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:13.301036 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d51cfc-b7de-4d4c-9d23-e1c60b4aba70 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:13.301801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d51cfc-b7de-4d4c-9d23-e1c60b4aba70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:13.304126 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d51cfc-b7de-4d4c-9d23-e1c60b4aba70 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:13.314854 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1065/2109] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:13.316342 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6c6fb-f72e-4d70-a077-cd326bbe19bd None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:13.316653 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6c6fb-f72e-4d70-a077-cd326bbe19bd None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:13.316936 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6c6fb-f72e-4d70-a077-cd326bbe19bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:13.338169 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-aec6c6fb-f72e-4d70-a077-cd326bbe19bd None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:13.343122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-aec6c6fb-f72e-4d70-a077-cd326bbe19bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:13.343261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1045/2110] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:13 2022] POST /identity/v3/users => generated 296 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:13.343261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741327fd-69fc-4b86-8f03-3f95fcd477fc admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:13.349476 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1066/2111] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:13.355276 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6c6fb-f72e-4d70-a077-cd326bbe19bd None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:13.355276 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-aec6c6fb-f72e-4d70-a077-cd326bbe19bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:13.355455 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741327fd-69fc-4b86-8f03-3f95fcd477fc admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:13.359381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026ab4b-9d46-47d4-8868-9d8202c6fab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:13.360290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026ab4b-9d46-47d4-8868-9d8202c6fab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:13.360629 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026ab4b-9d46-47d4-8868-9d8202c6fab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:13.361631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026ab4b-9d46-47d4-8868-9d8202c6fab4 admin admin] PATH_INFO: `/v3/projects/556f39d061844c89a3a29664bcea98b6/users/4e921c95b9864dd19812ee070f1d1653/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:13.369029 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6c6fb-f72e-4d70-a077-cd326bbe19bd None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:13.374268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153760b-544f-4e22-9e60-629073398c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:13.374943 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153760b-544f-4e22-9e60-629073398c02 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:13.375231 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153760b-544f-4e22-9e60-629073398c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:13.375513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153760b-544f-4e22-9e60-629073398c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:13.376245 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153760b-544f-4e22-9e60-629073398c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:13.377973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153760b-544f-4e22-9e60-629073398c02 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:13.381671 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:13.397611 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026ab4b-9d46-47d4-8868-9d8202c6fab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=556f39d061844c89a3a29664bcea98b6, user_id=4e921c95b9864dd19812ee070f1d1653, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:13.400847 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026ab4b-9d46-47d4-8868-9d8202c6fab4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:13.412993 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1067/2112] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:13.426235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3191626-331c-432d-80ca-5e40ceea58a9 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:13.426235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3191626-331c-432d-80ca-5e40ceea58a9 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:13.426235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3191626-331c-432d-80ca-5e40ceea58a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:13.442349 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-a3191626-331c-432d-80ca-5e40ceea58a9 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:13.444888 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-a3191626-331c-432d-80ca-5e40ceea58a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:13.457635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1068/2113] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:13.458457 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3191626-331c-432d-80ca-5e40ceea58a9 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:13.470886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3191626-331c-432d-80ca-5e40ceea58a9 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:13.476008 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cfbbb-a247-4d7f-9dea-147d85290109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:13.476943 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cfbbb-a247-4d7f-9dea-147d85290109 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:13.477256 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cfbbb-a247-4d7f-9dea-147d85290109 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:13.477585 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cfbbb-a247-4d7f-9dea-147d85290109 admin admin] PATH_INFO: `/v3/projects/8ca093f9cb7845c997766c996bf4d715/users/d25d743a96fc4b08aebc71ca1e61d985/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:13.494616 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1046/2114] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:13 2022] PUT /identity/v3/projects/556f39d061844c89a3a29664bcea98b6/users/4e921c95b9864dd19812ee070f1d1653/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:13.495495 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026ab4b-9d46-47d4-8868-9d8202c6fab4 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:13.510034 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cfbbb-a247-4d7f-9dea-147d85290109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca093f9cb7845c997766c996bf4d715, user_id=d25d743a96fc4b08aebc71ca1e61d985, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:13.510034 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cfbbb-a247-4d7f-9dea-147d85290109 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:13.574374 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026ab4b-9d46-47d4-8868-9d8202c6fab4 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:13.579188 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad49e1e-9460-4a1b-bb30-fe2078857c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:13.579855 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad49e1e-9460-4a1b-bb30-fe2078857c87 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:13.580137 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad49e1e-9460-4a1b-bb30-fe2078857c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:13.585102 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad49e1e-9460-4a1b-bb30-fe2078857c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:13.585102 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad49e1e-9460-4a1b-bb30-fe2078857c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:58:13.585102 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad49e1e-9460-4a1b-bb30-fe2078857c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:13.585366 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1069/2115] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:13 2022] PUT /identity/v3/projects/8ca093f9cb7845c997766c996bf4d715/users/d25d743a96fc4b08aebc71ca1e61d985/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:13.585449 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad49e1e-9460-4a1b-bb30-fe2078857c87 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:13.585531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd7676-5555-4fff-be5e-ce4d1bbe4b20 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:13.585531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd7676-5555-4fff-be5e-ce4d1bbe4b20 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:13.585531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd7676-5555-4fff-be5e-ce4d1bbe4b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:13.599673 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1047/2116] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:58:13.599673 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad49e1e-9460-4a1b-bb30-fe2078857c87 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:13.607314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad49e1e-9460-4a1b-bb30-fe2078857c87 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:13.618732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-8bfd7676-5555-4fff-be5e-ce4d1bbe4b20 None None] MFA Rules not processed for user `4e921c95b9864dd19812ee070f1d1653`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:13.620541 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-8bfd7676-5555-4fff-be5e-ce4d1bbe4b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:13.683361 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da9b15-6c3f-47cd-9466-e1d97b4beae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:13.684126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da9b15-6c3f-47cd-9466-e1d97b4beae3 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:13.684421 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da9b15-6c3f-47cd-9466-e1d97b4beae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:13.684735 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da9b15-6c3f-47cd-9466-e1d97b4beae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:13.685475 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da9b15-6c3f-47cd-9466-e1d97b4beae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:13.687074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da9b15-6c3f-47cd-9466-e1d97b4beae3 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:13.688579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1070/2117] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:13.689689 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd7676-5555-4fff-be5e-ce4d1bbe4b20 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:13.701870 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1048/2118] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:13.701870 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da9b15-6c3f-47cd-9466-e1d97b4beae3 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:13.702149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-52da9b15-6c3f-47cd-9466-e1d97b4beae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:13.703278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd7676-5555-4fff-be5e-ce4d1bbe4b20 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:13.711418 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e978514-e45b-4df9-8471-0e453f8fb264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:13.711418 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e978514-e45b-4df9-8471-0e453f8fb264 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:13.711418 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e978514-e45b-4df9-8471-0e453f8fb264 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:13.711418 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e978514-e45b-4df9-8471-0e453f8fb264 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:13.712080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e978514-e45b-4df9-8471-0e453f8fb264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:13.714302 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e978514-e45b-4df9-8471-0e453f8fb264 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:13.759465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da9b15-6c3f-47cd-9466-e1d97b4beae3 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:13.763274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c792a7-8f9d-41ad-8634-92be40bcae24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:13.763923 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c792a7-8f9d-41ad-8634-92be40bcae24 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:13.764209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c792a7-8f9d-41ad-8634-92be40bcae24 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:13.764527 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c792a7-8f9d-41ad-8634-92be40bcae24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:13.773237 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c792a7-8f9d-41ad-8634-92be40bcae24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:13.774705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c792a7-8f9d-41ad-8634-92be40bcae24 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:13.783919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1049/2119] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:58:13.784811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c792a7-8f9d-41ad-8634-92be40bcae24 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:13.795221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c792a7-8f9d-41ad-8634-92be40bcae24 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:13.800222 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88917795-411d-400d-b40b-5b712b5fdcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:13.801125 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88917795-411d-400d-b40b-5b712b5fdcf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:13.801415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88917795-411d-400d-b40b-5b712b5fdcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:13.801693 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88917795-411d-400d-b40b-5b712b5fdcf8 admin admin] PATH_INFO: `/v3/projects/8ca093f9cb7845c997766c996bf4d715/users/d25d743a96fc4b08aebc71ca1e61d985/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:13.803677 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88917795-411d-400d-b40b-5b712b5fdcf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca093f9cb7845c997766c996bf4d715, user_id=d25d743a96fc4b08aebc71ca1e61d985, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:13.806371 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88917795-411d-400d-b40b-5b712b5fdcf8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:13.817711 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1050/2120] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:13 2022] PUT /identity/v3/projects/8ca093f9cb7845c997766c996bf4d715/users/d25d743a96fc4b08aebc71ca1e61d985/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:13.830784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1994eb7-7dc5-4e99-a547-54edba641dd9 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:13.830784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1994eb7-7dc5-4e99-a547-54edba641dd9 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:13.830784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1994eb7-7dc5-4e99-a547-54edba641dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:13.835264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1071/2121] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:13 2022] POST /identity/v3/projects => generated 369 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:13.839618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e978514-e45b-4df9-8471-0e453f8fb264 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:13.859699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b1994eb7-7dc5-4e99-a547-54edba641dd9 None None] MFA Rules not processed for user `d25d743a96fc4b08aebc71ca1e61d985`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:13.861531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b1994eb7-7dc5-4e99-a547-54edba641dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:13.911634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e978514-e45b-4df9-8471-0e453f8fb264 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:13.921661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce1c1a-9253-440f-8259-e2120c37cd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:13.922369 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce1c1a-9253-440f-8259-e2120c37cd65 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:13.922634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce1c1a-9253-440f-8259-e2120c37cd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:13.924772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce1c1a-9253-440f-8259-e2120c37cd65 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:13.924772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce1c1a-9253-440f-8259-e2120c37cd65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:13.926664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce1c1a-9253-440f-8259-e2120c37cd65 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:13.951404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1051/2122] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:58:13.969807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1994eb7-7dc5-4e99-a547-54edba641dd9 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:13.971709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b1994eb7-7dc5-4e99-a547-54edba641dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:14.036039 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1072/2123] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:13 2022] POST /identity/v3/users => generated 285 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:58:14.041530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce1c1a-9253-440f-8259-e2120c37cd65 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:14.047234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1994eb7-7dc5-4e99-a547-54edba641dd9 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:14.051158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65348ea-b66e-4709-8143-bfdb5c8e1e5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:14.051816 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65348ea-b66e-4709-8143-bfdb5c8e1e5d service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:14.052096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65348ea-b66e-4709-8143-bfdb5c8e1e5d service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:14.052378 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65348ea-b66e-4709-8143-bfdb5c8e1e5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:14.053981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce1c1a-9253-440f-8259-e2120c37cd65 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:14.054289 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c65348ea-b66e-4709-8143-bfdb5c8e1e5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:14.059406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779938d2-a451-44f4-924f-4d5cd177860d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:14.060627 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779938d2-a451-44f4-924f-4d5cd177860d admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:14.060924 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779938d2-a451-44f4-924f-4d5cd177860d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:14.061208 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779938d2-a451-44f4-924f-4d5cd177860d admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:14.061952 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779938d2-a451-44f4-924f-4d5cd177860d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:14.063638 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779938d2-a451-44f4-924f-4d5cd177860d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:14.077684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1073/2124] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:14.078994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779938d2-a451-44f4-924f-4d5cd177860d admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:14.091505 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779938d2-a451-44f4-924f-4d5cd177860d admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:14.096973 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5f779-73cc-4daf-9031-22ca36415066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:14.097976 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5f779-73cc-4daf-9031-22ca36415066 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:14.098122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5f779-73cc-4daf-9031-22ca36415066 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:14.098294 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5f779-73cc-4daf-9031-22ca36415066 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:14.099069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5f779-73cc-4daf-9031-22ca36415066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:14.100718 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5f779-73cc-4daf-9031-22ca36415066 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:14.112042 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1074/2125] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:58:14.116556 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5f779-73cc-4daf-9031-22ca36415066 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:14.119246 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65348ea-b66e-4709-8143-bfdb5c8e1e5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:14.121362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65348ea-b66e-4709-8143-bfdb5c8e1e5d service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:14.127537 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5f779-73cc-4daf-9031-22ca36415066 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:14.130920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1052/2126] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:14.137933 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e682c73-7939-488a-b159-c1f13e8d57f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:14.137933 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e682c73-7939-488a-b159-c1f13e8d57f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:14.137933 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e682c73-7939-488a-b159-c1f13e8d57f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:14.137933 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e682c73-7939-488a-b159-c1f13e8d57f4 admin admin] PATH_INFO: `/v3/projects/480d915e35db434bbb0763ee2718466d/users/adaea084816644ba92e365fce64881ca/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:14.156393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:14.158349 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e682c73-7939-488a-b159-c1f13e8d57f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=480d915e35db434bbb0763ee2718466d, user_id=adaea084816644ba92e365fce64881ca, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:14.161357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e682c73-7939-488a-b159-c1f13e8d57f4 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:14.267505 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1075/2127] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:14 2022] PUT /identity/v3/projects/480d915e35db434bbb0763ee2718466d/users/adaea084816644ba92e365fce64881ca/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:14.274346 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cddd4-7e6d-47b2-9c43-c9e667ffea53 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:14.274346 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cddd4-7e6d-47b2-9c43-c9e667ffea53 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:14.274757 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cddd4-7e6d-47b2-9c43-c9e667ffea53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:14.296498 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-830cddd4-7e6d-47b2-9c43-c9e667ffea53 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:14.297779 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-830cddd4-7e6d-47b2-9c43-c9e667ffea53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:14.361730 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1053/2128] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:14.372141 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e682c73-7939-488a-b159-c1f13e8d57f4 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:14.374123 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2e682c73-7939-488a-b159-c1f13e8d57f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:14.436049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e682c73-7939-488a-b159-c1f13e8d57f4 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:14.439972 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2bcb1-a95e-42ea-958c-3f52a6e28923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:14.441084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2bcb1-a95e-42ea-958c-3f52a6e28923 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:14.441398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2bcb1-a95e-42ea-958c-3f52a6e28923 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:14.441674 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2bcb1-a95e-42ea-958c-3f52a6e28923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:14.451404 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2bcb1-a95e-42ea-958c-3f52a6e28923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:14.452874 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2bcb1-a95e-42ea-958c-3f52a6e28923 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:14.473457 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1076/2129] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:14.792160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:14.965726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:15.887354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cddd4-7e6d-47b2-9c43-c9e667ffea53 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:15.948694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cddd4-7e6d-47b2-9c43-c9e667ffea53 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:15.952541 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868a3a2-9959-469e-a4da-6ed913dedb26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:15.953332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868a3a2-9959-469e-a4da-6ed913dedb26 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:15.953691 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868a3a2-9959-469e-a4da-6ed913dedb26 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:15.954045 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868a3a2-9959-469e-a4da-6ed913dedb26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:16.020658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868a3a2-9959-469e-a4da-6ed913dedb26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:16.022292 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868a3a2-9959-469e-a4da-6ed913dedb26 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:16.032895 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1054/2130] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:16.048570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb2a74-412a-42e4-9af6-e4b77d2e12cc None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:16.048980 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb2a74-412a-42e4-9af6-e4b77d2e12cc None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:16.049178 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb2a74-412a-42e4-9af6-e4b77d2e12cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:16.079261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-d7fb2a74-412a-42e4-9af6-e4b77d2e12cc None None] MFA Rules not processed for user `adaea084816644ba92e365fce64881ca`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:16.080497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-d7fb2a74-412a-42e4-9af6-e4b77d2e12cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:16.167493 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1077/2131] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:16.220940 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868a3a2-9959-469e-a4da-6ed913dedb26 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:16.231808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868a3a2-9959-469e-a4da-6ed913dedb26 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:16.236760 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7668fa5-ded5-4935-aa78-b81fc54bb330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:16.237430 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7668fa5-ded5-4935-aa78-b81fc54bb330 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:16.237715 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7668fa5-ded5-4935-aa78-b81fc54bb330 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:16.238035 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7668fa5-ded5-4935-aa78-b81fc54bb330 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:16.238732 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7668fa5-ded5-4935-aa78-b81fc54bb330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:16.243114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7668fa5-ded5-4935-aa78-b81fc54bb330 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:16.339896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1055/2132] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:16 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:16.340573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb2a74-412a-42e4-9af6-e4b77d2e12cc None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:16.358145 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb2a74-412a-42e4-9af6-e4b77d2e12cc None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:16.454718 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bb9ca-9025-45ea-9ff7-44cd6fbc6a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:16.455707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bb9ca-9025-45ea-9ff7-44cd6fbc6a50 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:16.456409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bb9ca-9025-45ea-9ff7-44cd6fbc6a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:16.456729 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bb9ca-9025-45ea-9ff7-44cd6fbc6a50 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:16.457786 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bb9ca-9025-45ea-9ff7-44cd6fbc6a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:16.459795 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bb9ca-9025-45ea-9ff7-44cd6fbc6a50 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:16.550443 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1078/2133] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:16 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:58:16.554436 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7668fa5-ded5-4935-aa78-b81fc54bb330 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:16.565646 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7668fa5-ded5-4935-aa78-b81fc54bb330 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:16.570633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ff4fa-0b6d-4e46-bc69-fc94006e937b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:16.571303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ff4fa-0b6d-4e46-bc69-fc94006e937b admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:16.571628 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ff4fa-0b6d-4e46-bc69-fc94006e937b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:16.571915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ff4fa-0b6d-4e46-bc69-fc94006e937b admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:16.572802 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ff4fa-0b6d-4e46-bc69-fc94006e937b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:16.575017 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ff4fa-0b6d-4e46-bc69-fc94006e937b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:16.585942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1056/2134] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:16.590475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bb9ca-9025-45ea-9ff7-44cd6fbc6a50 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:16.600722 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bb9ca-9025-45ea-9ff7-44cd6fbc6a50 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:16.605868 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bffbc5-de22-48e4-9b34-15dc2c7c1a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:16.606823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bffbc5-de22-48e4-9b34-15dc2c7c1a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:16.607246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bffbc5-de22-48e4-9b34-15dc2c7c1a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:16.607535 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bffbc5-de22-48e4-9b34-15dc2c7c1a1f admin admin] PATH_INFO: `/v3/projects/bf7156cb0e4b4168af3d10b9b7a07a65/users/68afd5fe042643b88d57715bf2c09bb7/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:16.628076 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bffbc5-de22-48e4-9b34-15dc2c7c1a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7156cb0e4b4168af3d10b9b7a07a65, user_id=68afd5fe042643b88d57715bf2c09bb7, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:16.631322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bffbc5-de22-48e4-9b34-15dc2c7c1a1f admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:16.789626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1079/2135] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:16 2022] PUT /identity/v3/projects/bf7156cb0e4b4168af3d10b9b7a07a65/users/68afd5fe042643b88d57715bf2c09bb7/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:16.794290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ff4fa-0b6d-4e46-bc69-fc94006e937b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:16.808081 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ff4fa-0b6d-4e46-bc69-fc94006e937b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:16.863861 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ea11b-fc99-43de-a6ff-c879029195e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:16.864568 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ea11b-fc99-43de-a6ff-c879029195e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:16.864855 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ea11b-fc99-43de-a6ff-c879029195e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:16.865132 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ea11b-fc99-43de-a6ff-c879029195e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:16.865861 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ea11b-fc99-43de-a6ff-c879029195e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:16.867467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ea11b-fc99-43de-a6ff-c879029195e4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:16.877758 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1057/2136] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:16.881877 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bffbc5-de22-48e4-9b34-15dc2c7c1a1f admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:16.892674 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bffbc5-de22-48e4-9b34-15dc2c7c1a1f admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:16.897432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366e9b4-2985-432c-b403-ce8249a9fac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:16.898366 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366e9b4-2985-432c-b403-ce8249a9fac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:16.898656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366e9b4-2985-432c-b403-ce8249a9fac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:16.898930 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366e9b4-2985-432c-b403-ce8249a9fac4 admin admin] PATH_INFO: `/v3/projects/bf7156cb0e4b4168af3d10b9b7a07a65/users/68afd5fe042643b88d57715bf2c09bb7/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:16.900957 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366e9b4-2985-432c-b403-ce8249a9fac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7156cb0e4b4168af3d10b9b7a07a65, user_id=68afd5fe042643b88d57715bf2c09bb7, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:16.903541 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366e9b4-2985-432c-b403-ce8249a9fac4 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:16.913587 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1080/2137] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:16 2022] PUT /identity/v3/projects/bf7156cb0e4b4168af3d10b9b7a07a65/users/68afd5fe042643b88d57715bf2c09bb7/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:18.266843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:18.381348 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d81da-5cd9-4596-ac2e-f670742af99f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:18.381348 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d81da-5cd9-4596-ac2e-f670742af99f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:18.381902 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d81da-5cd9-4596-ac2e-f670742af99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:18.410297 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-ba9d81da-5cd9-4596-ac2e-f670742af99f None None] MFA Rules not processed for user `68afd5fe042643b88d57715bf2c09bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:18.411834 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ba9d81da-5cd9-4596-ac2e-f670742af99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:18.488595 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1058/2138] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:18.496247 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307d393-a84b-494c-a8d8-f0898e3500de None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:18.496659 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307d393-a84b-494c-a8d8-f0898e3500de None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:18.497026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307d393-a84b-494c-a8d8-f0898e3500de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:18.515766 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-e307d393-a84b-494c-a8d8-f0898e3500de None None] MFA Rules not processed for user `adaea084816644ba92e365fce64881ca`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:18.517020 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-e307d393-a84b-494c-a8d8-f0898e3500de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:18.581341 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1081/2139] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:18.597805 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d81da-5cd9-4596-ac2e-f670742af99f None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:18.599257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ba9d81da-5cd9-4596-ac2e-f670742af99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:18.683653 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d81da-5cd9-4596-ac2e-f670742af99f None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:18.690171 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea529f15-3491-4242-a603-fa9bc6f705ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:18.690901 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea529f15-3491-4242-a603-fa9bc6f705ed service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:18.691182 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea529f15-3491-4242-a603-fa9bc6f705ed service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:18.691456 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea529f15-3491-4242-a603-fa9bc6f705ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:18.699756 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea529f15-3491-4242-a603-fa9bc6f705ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:18.701383 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea529f15-3491-4242-a603-fa9bc6f705ed service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:18.710613 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1059/2140] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:18 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:18.750027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:20.884015 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307d393-a84b-494c-a8d8-f0898e3500de None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:20.963801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307d393-a84b-494c-a8d8-f0898e3500de None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:20.969491 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1b053-4d8b-49b2-8a72-cda5a2317092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:20.970475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1b053-4d8b-49b2-8a72-cda5a2317092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:20.970763 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1b053-4d8b-49b2-8a72-cda5a2317092 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:20.971040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1b053-4d8b-49b2-8a72-cda5a2317092 admin admin] PATH_INFO: `/v3/users/748f65a1d94d4608a0545d1286584a3d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:20.972797 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1b053-4d8b-49b2-8a72-cda5a2317092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=748f65a1d94d4608a0545d1286584a3d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:20.974363 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1b053-4d8b-49b2-8a72-cda5a2317092 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:21.391856 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4ee1b053-4d8b-49b2-8a72-cda5a2317092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '748f65a1d94d4608a0545d1286584a3d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:21.392471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4ee1b053-4d8b-49b2-8a72-cda5a2317092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '748f65a1d94d4608a0545d1286584a3d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:21.521333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4ee1b053-4d8b-49b2-8a72-cda5a2317092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '748f65a1d94d4608a0545d1286584a3d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:21.530127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4ee1b053-4d8b-49b2-8a72-cda5a2317092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '748f65a1d94d4608a0545d1286584a3d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:21.530848 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4ee1b053-4d8b-49b2-8a72-cda5a2317092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '748f65a1d94d4608a0545d1286584a3d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:21.551143 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1082/2141] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:20 2022] DELETE /identity/v3/users/748f65a1d94d4608a0545d1286584a3d => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:21.555690 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f275f-0a84-4c2d-af12-dfbedb549acd None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:21.556152 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f275f-0a84-4c2d-af12-dfbedb549acd None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:21.556267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f275f-0a84-4c2d-af12-dfbedb549acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:21.572478 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:21.602077 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6d8f275f-0a84-4c2d-af12-dfbedb549acd None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:21.604039 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6d8f275f-0a84-4c2d-af12-dfbedb549acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:21.678704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1060/2142] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:21.688249 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1b053-4d8b-49b2-8a72-cda5a2317092 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:21.689866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-4ee1b053-4d8b-49b2-8a72-cda5a2317092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:21.770560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1b053-4d8b-49b2-8a72-cda5a2317092 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:21.774484 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae486f-4b05-4761-9acf-8951d0597f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:21.775207 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae486f-4b05-4761-9acf-8951d0597f90 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:21.775549 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae486f-4b05-4761-9acf-8951d0597f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:21.776327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae486f-4b05-4761-9acf-8951d0597f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:21.795450 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae486f-4b05-4761-9acf-8951d0597f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:21.795450 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae486f-4b05-4761-9acf-8951d0597f90 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:21.800080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1083/2143] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:22.127529 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:22.288537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f275f-0a84-4c2d-af12-dfbedb549acd None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:22.289998 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6d8f275f-0a84-4c2d-af12-dfbedb549acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:22.304991 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f275f-0a84-4c2d-af12-dfbedb549acd None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:22.318663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c5c72-b687-49fd-ae4f-7724a696192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:22.321347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c5c72-b687-49fd-ae4f-7724a696192c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:22.321347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c5c72-b687-49fd-ae4f-7724a696192c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:22.321347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c5c72-b687-49fd-ae4f-7724a696192c admin admin] PATH_INFO: `/v3/projects/d0927e4c434749f6a1642da9e90c2a8c` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:22.321580 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c5c72-b687-49fd-ae4f-7724a696192c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0927e4c434749f6a1642da9e90c2a8c)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:22.324192 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c5c72-b687-49fd-ae4f-7724a696192c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:22.454087 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7f7c5c72-b687-49fd-ae4f-7724a696192c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0927e4c434749f6a1642da9e90c2a8c', 'request_id': 'req-7f7c5c72-b687-49fd-ae4f-7724a696192c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:22.459902 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7f7c5c72-b687-49fd-ae4f-7724a696192c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0927e4c434749f6a1642da9e90c2a8c', 'request_id': 'req-7f7c5c72-b687-49fd-ae4f-7724a696192c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:22.467180 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7f7c5c72-b687-49fd-ae4f-7724a696192c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0927e4c434749f6a1642da9e90c2a8c', 'request_id': 'req-7f7c5c72-b687-49fd-ae4f-7724a696192c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:22.674993 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7f7c5c72-b687-49fd-ae4f-7724a696192c admin admin] The token cache is being invalidate because project d0927e4c434749f6a1642da9e90c2a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:22.675659 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7f7c5c72-b687-49fd-ae4f-7724a696192c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:22.676174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7f7c5c72-b687-49fd-ae4f-7724a696192c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:22.677831 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1061/2144] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:22 2022] DELETE /identity/v3/projects/d0927e4c434749f6a1642da9e90c2a8c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:22.682021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae486f-4b05-4761-9acf-8951d0597f90 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:22.696148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae486f-4b05-4761-9acf-8951d0597f90 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:22.907947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd59a33-485b-49f0-bd9c-7929b9ff0010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:22.907947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd59a33-485b-49f0-bd9c-7929b9ff0010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:22.907947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd59a33-485b-49f0-bd9c-7929b9ff0010 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:22.907947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd59a33-485b-49f0-bd9c-7929b9ff0010 admin admin] PATH_INFO: `/v3/users/d25d743a96fc4b08aebc71ca1e61d985` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:22.908912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd59a33-485b-49f0-bd9c-7929b9ff0010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d25d743a96fc4b08aebc71ca1e61d985)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:22.908912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd59a33-485b-49f0-bd9c-7929b9ff0010 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:23.047235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c5c72-b687-49fd-ae4f-7724a696192c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:23.048671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7f7c5c72-b687-49fd-ae4f-7724a696192c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:23.062207 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c5c72-b687-49fd-ae4f-7724a696192c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:23.066896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c3dde-79a0-4494-9565-db95d89ebf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:23.067761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c3dde-79a0-4494-9565-db95d89ebf5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:23.068047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c3dde-79a0-4494-9565-db95d89ebf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:23.068363 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c3dde-79a0-4494-9565-db95d89ebf5a admin admin] PATH_INFO: `/v3/users/126a7ce19656451d98d024b61ef5a8b7` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:23.069627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c3dde-79a0-4494-9565-db95d89ebf5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=126a7ce19656451d98d024b61ef5a8b7)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:23.071548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c3dde-79a0-4494-9565-db95d89ebf5a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:23.134123 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-5cd59a33-485b-49f0-bd9c-7929b9ff0010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd25d743a96fc4b08aebc71ca1e61d985'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:23.135856 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-5cd59a33-485b-49f0-bd9c-7929b9ff0010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd25d743a96fc4b08aebc71ca1e61d985'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:23.252422 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-5cd59a33-485b-49f0-bd9c-7929b9ff0010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd25d743a96fc4b08aebc71ca1e61d985'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:23.265154 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-5cd59a33-485b-49f0-bd9c-7929b9ff0010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd25d743a96fc4b08aebc71ca1e61d985'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:23.265931 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-5cd59a33-485b-49f0-bd9c-7929b9ff0010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd25d743a96fc4b08aebc71ca1e61d985'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:23.286802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1084/2145] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:22 2022] DELETE /identity/v3/users/d25d743a96fc4b08aebc71ca1e61d985 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:23.337553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a62c3dde-79a0-4494-9565-db95d89ebf5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '126a7ce19656451d98d024b61ef5a8b7'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:23.337553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a62c3dde-79a0-4494-9565-db95d89ebf5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '126a7ce19656451d98d024b61ef5a8b7'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:23.429682 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a62c3dde-79a0-4494-9565-db95d89ebf5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '126a7ce19656451d98d024b61ef5a8b7'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:23.438655 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a62c3dde-79a0-4494-9565-db95d89ebf5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '126a7ce19656451d98d024b61ef5a8b7'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:23.452989 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a62c3dde-79a0-4494-9565-db95d89ebf5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '126a7ce19656451d98d024b61ef5a8b7'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:23.460462 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1062/2146] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:23 2022] DELETE /identity/v3/users/126a7ce19656451d98d024b61ef5a8b7 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:23.464751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887f979-7ac1-446c-846b-6afdd7ba8e57 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:23.465047 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887f979-7ac1-446c-846b-6afdd7ba8e57 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:23.465327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887f979-7ac1-446c-846b-6afdd7ba8e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:23.504902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-5887f979-7ac1-446c-846b-6afdd7ba8e57 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:23.504902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5887f979-7ac1-446c-846b-6afdd7ba8e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:23.705293 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1085/2147] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:23.720133 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c3dde-79a0-4494-9565-db95d89ebf5a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:23.721634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a62c3dde-79a0-4494-9565-db95d89ebf5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:23.778217 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c3dde-79a0-4494-9565-db95d89ebf5a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:23.781842 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ae81c-2560-4c8d-b148-d2459203c196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:23.782519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ae81c-2560-4c8d-b148-d2459203c196 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:23.782909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ae81c-2560-4c8d-b148-d2459203c196 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:23.783220 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ae81c-2560-4c8d-b148-d2459203c196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:23.792451 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ae81c-2560-4c8d-b148-d2459203c196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:23.793914 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ae81c-2560-4c8d-b148-d2459203c196 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:23.804324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1063/2148] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:23.836344 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887f979-7ac1-446c-846b-6afdd7ba8e57 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:23.837552 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5887f979-7ac1-446c-846b-6afdd7ba8e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:23.851394 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887f979-7ac1-446c-846b-6afdd7ba8e57 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:23.889114 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008733d8-b67e-4c68-b66c-8b45985c2db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:23.890028 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008733d8-b67e-4c68-b66c-8b45985c2db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:23.892594 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008733d8-b67e-4c68-b66c-8b45985c2db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:23.892892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008733d8-b67e-4c68-b66c-8b45985c2db9 admin admin] PATH_INFO: `/v3/projects/8ca093f9cb7845c997766c996bf4d715` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:23.895195 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008733d8-b67e-4c68-b66c-8b45985c2db9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca093f9cb7845c997766c996bf4d715)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:23.903855 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008733d8-b67e-4c68-b66c-8b45985c2db9 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:24.096146 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-008733d8-b67e-4c68-b66c-8b45985c2db9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca093f9cb7845c997766c996bf4d715', 'request_id': 'req-008733d8-b67e-4c68-b66c-8b45985c2db9'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:24.252844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-008733d8-b67e-4c68-b66c-8b45985c2db9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca093f9cb7845c997766c996bf4d715', 'request_id': 'req-008733d8-b67e-4c68-b66c-8b45985c2db9'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:24.254802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-008733d8-b67e-4c68-b66c-8b45985c2db9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca093f9cb7845c997766c996bf4d715', 'request_id': 'req-008733d8-b67e-4c68-b66c-8b45985c2db9'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:24.272682 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-008733d8-b67e-4c68-b66c-8b45985c2db9 admin admin] The token cache is being invalidate because project 8ca093f9cb7845c997766c996bf4d715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:24.273465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-008733d8-b67e-4c68-b66c-8b45985c2db9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:24.279315 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-008733d8-b67e-4c68-b66c-8b45985c2db9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:24.279315 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1086/2149] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:23 2022] DELETE /identity/v3/projects/8ca093f9cb7845c997766c996bf4d715 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:24.284092 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423e5a9-43a0-491e-90d2-39a41e4848a9 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:24.284398 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423e5a9-43a0-491e-90d2-39a41e4848a9 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:24.284979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423e5a9-43a0-491e-90d2-39a41e4848a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:24.305447 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b423e5a9-43a0-491e-90d2-39a41e4848a9 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:24.307891 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b423e5a9-43a0-491e-90d2-39a41e4848a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:24.372599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1064/2150] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:58:24.379704 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b57844-bb32-4ccc-9df5-171a0f96915b None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:24.380549 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b57844-bb32-4ccc-9df5-171a0f96915b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:24.380837 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b57844-bb32-4ccc-9df5-171a0f96915b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:24.416172 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-f1b57844-bb32-4ccc-9df5-171a0f96915b None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:24.417635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f1b57844-bb32-4ccc-9df5-171a0f96915b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:24.427638 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1087/2151] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:24.432026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423e5a9-43a0-491e-90d2-39a41e4848a9 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:24.442429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423e5a9-43a0-491e-90d2-39a41e4848a9 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:24.447362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7a5fb-c492-4fba-bf4d-a57750ca4ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:24.448707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7a5fb-c492-4fba-bf4d-a57750ca4ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:24.449182 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7a5fb-c492-4fba-bf4d-a57750ca4ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:24.449530 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7a5fb-c492-4fba-bf4d-a57750ca4ba2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:24.450278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7a5fb-c492-4fba-bf4d-a57750ca4ba2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:58:24.450645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7a5fb-c492-4fba-bf4d-a57750ca4ba2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:24.452264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7a5fb-c492-4fba-bf4d-a57750ca4ba2 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:24.466121 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1065/2152] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:58:24.473919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b57844-bb32-4ccc-9df5-171a0f96915b None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:24.480911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b57844-bb32-4ccc-9df5-171a0f96915b None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:24.485779 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d91227-9224-43cf-9f23-7441ef57c017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:24.486450 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d91227-9224-43cf-9f23-7441ef57c017 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:24.486741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d91227-9224-43cf-9f23-7441ef57c017 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:24.487029 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d91227-9224-43cf-9f23-7441ef57c017 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:24.487759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d91227-9224-43cf-9f23-7441ef57c017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:24.489746 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d91227-9224-43cf-9f23-7441ef57c017 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:24.533076 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7a5fb-c492-4fba-bf4d-a57750ca4ba2 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:24.534834 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fae7a5fb-c492-4fba-bf4d-a57750ca4ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:24.548299 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7a5fb-c492-4fba-bf4d-a57750ca4ba2 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:24.554142 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d50bd-c271-408c-9bc8-453aa947a2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:24.554555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d50bd-c271-408c-9bc8-453aa947a2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:24.554768 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d50bd-c271-408c-9bc8-453aa947a2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:24.555041 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d50bd-c271-408c-9bc8-453aa947a2d1 admin admin] PATH_INFO: `/v3/projects/0d2afac1ef3b4d4bb0e4c0cd2de51370` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:24.556593 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d50bd-c271-408c-9bc8-453aa947a2d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d2afac1ef3b4d4bb0e4c0cd2de51370)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:24.558800 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d50bd-c271-408c-9bc8-453aa947a2d1 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:24.665873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1088/2153] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:24 2022] POST /identity/v3/projects => generated 407 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:24.670128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d91227-9224-43cf-9f23-7441ef57c017 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:24.740738 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d91227-9224-43cf-9f23-7441ef57c017 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:24.768708 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9e8d50bd-c271-408c-9bc8-453aa947a2d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d2afac1ef3b4d4bb0e4c0cd2de51370', 'request_id': 'req-9e8d50bd-c271-408c-9bc8-453aa947a2d1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:24.799866 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9e8d50bd-c271-408c-9bc8-453aa947a2d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d2afac1ef3b4d4bb0e4c0cd2de51370', 'request_id': 'req-9e8d50bd-c271-408c-9bc8-453aa947a2d1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:24.812027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9e8d50bd-c271-408c-9bc8-453aa947a2d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d2afac1ef3b4d4bb0e4c0cd2de51370', 'request_id': 'req-9e8d50bd-c271-408c-9bc8-453aa947a2d1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:24.828826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb0cad-6ef5-44ed-a094-8ea8669425f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:24.829520 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb0cad-6ef5-44ed-a094-8ea8669425f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:24.829809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb0cad-6ef5-44ed-a094-8ea8669425f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:24.830199 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb0cad-6ef5-44ed-a094-8ea8669425f1 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:24.830796 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb0cad-6ef5-44ed-a094-8ea8669425f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:24.832777 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb0cad-6ef5-44ed-a094-8ea8669425f1 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:24.940611 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1089/2154] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:24 2022] POST /identity/v3/users => generated 304 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:58:24.944394 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb0cad-6ef5-44ed-a094-8ea8669425f1 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:24.944637 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9e8d50bd-c271-408c-9bc8-453aa947a2d1 admin admin] The token cache is being invalidate because project 0d2afac1ef3b4d4bb0e4c0cd2de51370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:24.944942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9e8d50bd-c271-408c-9bc8-453aa947a2d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:24.945711 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9e8d50bd-c271-408c-9bc8-453aa947a2d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:24.947344 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1066/2155] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:24 2022] DELETE /identity/v3/projects/0d2afac1ef3b4d4bb0e4c0cd2de51370 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:24.950931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d50bd-c271-408c-9bc8-453aa947a2d1 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:24.952373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9e8d50bd-c271-408c-9bc8-453aa947a2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:24.955716 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb0cad-6ef5-44ed-a094-8ea8669425f1 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:24.961932 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a47327-bab4-4592-97e6-f47e4ae92385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:24.962875 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a47327-bab4-4592-97e6-f47e4ae92385 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:24.963309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a47327-bab4-4592-97e6-f47e4ae92385 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:24.963592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a47327-bab4-4592-97e6-f47e4ae92385 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:24.964337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a47327-bab4-4592-97e6-f47e4ae92385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:24.965668 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d50bd-c271-408c-9bc8-453aa947a2d1 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:24.966320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a47327-bab4-4592-97e6-f47e4ae92385 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:24.971371 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78e551-abc1-45f2-b1f1-afb8403ae19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:24.972534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78e551-abc1-45f2-b1f1-afb8403ae19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:24.972885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78e551-abc1-45f2-b1f1-afb8403ae19a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:24.973175 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78e551-abc1-45f2-b1f1-afb8403ae19a admin admin] PATH_INFO: `/v3/users/c49310c3198d4bf2baa978f0f83d8f23` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:24.974410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78e551-abc1-45f2-b1f1-afb8403ae19a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c49310c3198d4bf2baa978f0f83d8f23)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:24.976532 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78e551-abc1-45f2-b1f1-afb8403ae19a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:24.977776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1090/2156] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:58:24.990487 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a47327-bab4-4592-97e6-f47e4ae92385 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:24.992116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-30a47327-bab4-4592-97e6-f47e4ae92385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:25.006874 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a47327-bab4-4592-97e6-f47e4ae92385 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:25.013732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab31ced-1716-4af8-85e6-6839afd24e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:25.016116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab31ced-1716-4af8-85e6-6839afd24e6b admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:25.016116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab31ced-1716-4af8-85e6-6839afd24e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:25.016116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab31ced-1716-4af8-85e6-6839afd24e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:25.016116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab31ced-1716-4af8-85e6-6839afd24e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:25.018240 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab31ced-1716-4af8-85e6-6839afd24e6b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:25.035031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1091/2157] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:58:25.038520 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab31ced-1716-4af8-85e6-6839afd24e6b admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:25.050122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab31ced-1716-4af8-85e6-6839afd24e6b admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:25.055741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815cb58-9587-4ae0-9fef-c1bf588f969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:25.056826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815cb58-9587-4ae0-9fef-c1bf588f969a admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:25.057735 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815cb58-9587-4ae0-9fef-c1bf588f969a admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:25.058571 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815cb58-9587-4ae0-9fef-c1bf588f969a admin admin] PATH_INFO: `/v3/projects/3d1d1483894f457f9ef8d3731925fb4b/users/564fcdb2233d469691645814a74630f8/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:25.075130 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815cb58-9587-4ae0-9fef-c1bf588f969a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1d1483894f457f9ef8d3731925fb4b, user_id=564fcdb2233d469691645814a74630f8, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:25.078277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815cb58-9587-4ae0-9fef-c1bf588f969a admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:25.155913 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0f78e551-abc1-45f2-b1f1-afb8403ae19a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c49310c3198d4bf2baa978f0f83d8f23'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:25.156684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0f78e551-abc1-45f2-b1f1-afb8403ae19a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c49310c3198d4bf2baa978f0f83d8f23'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:25.213067 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1092/2158] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:25 2022] PUT /identity/v3/projects/3d1d1483894f457f9ef8d3731925fb4b/users/564fcdb2233d469691645814a74630f8/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:25.227093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdc955-0493-4315-952f-7d7a1f6972f7 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:25.227389 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdc955-0493-4315-952f-7d7a1f6972f7 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:25.227672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdc955-0493-4315-952f-7d7a1f6972f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:25.243893 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0f78e551-abc1-45f2-b1f1-afb8403ae19a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c49310c3198d4bf2baa978f0f83d8f23'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:25.261559 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0f78e551-abc1-45f2-b1f1-afb8403ae19a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c49310c3198d4bf2baa978f0f83d8f23'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:25.287659 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0f78e551-abc1-45f2-b1f1-afb8403ae19a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c49310c3198d4bf2baa978f0f83d8f23'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:25.301087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-97bdc955-0493-4315-952f-7d7a1f6972f7 None None] MFA Rules not processed for user `564fcdb2233d469691645814a74630f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:25.305256 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-97bdc955-0493-4315-952f-7d7a1f6972f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:25.305471 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1067/2159] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:24 2022] DELETE /identity/v3/users/c49310c3198d4bf2baa978f0f83d8f23 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:25.317161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:25.408767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1093/2160] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:25 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:25.412699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78e551-abc1-45f2-b1f1-afb8403ae19a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:25.414225 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0f78e551-abc1-45f2-b1f1-afb8403ae19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:25.516219 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78e551-abc1-45f2-b1f1-afb8403ae19a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:25.521753 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6e7e5-219c-4b4f-8d8a-a330ea0e2177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:25.522436 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6e7e5-219c-4b4f-8d8a-a330ea0e2177 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:25.522727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6e7e5-219c-4b4f-8d8a-a330ea0e2177 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:25.523143 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6e7e5-219c-4b4f-8d8a-a330ea0e2177 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:25.523890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6e7e5-219c-4b4f-8d8a-a330ea0e2177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:25.526469 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6e7e5-219c-4b4f-8d8a-a330ea0e2177 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:25.715510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1068/2161] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:25 2022] POST /identity/v3/projects => generated 407 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:25.716675 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdc955-0493-4315-952f-7d7a1f6972f7 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:25.727739 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdc955-0493-4315-952f-7d7a1f6972f7 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:25.788640 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08763204-82bf-4318-a8c6-c21fd8d4a4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:25.796170 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08763204-82bf-4318-a8c6-c21fd8d4a4e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:25.796170 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08763204-82bf-4318-a8c6-c21fd8d4a4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:25.796170 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08763204-82bf-4318-a8c6-c21fd8d4a4e3 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:25.796170 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08763204-82bf-4318-a8c6-c21fd8d4a4e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:25.796170 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08763204-82bf-4318-a8c6-c21fd8d4a4e3 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:25.984223 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:26.166536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6e7e5-219c-4b4f-8d8a-a330ea0e2177 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:26.166536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-75c6e7e5-219c-4b4f-8d8a-a330ea0e2177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:26.179402 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6e7e5-219c-4b4f-8d8a-a330ea0e2177 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:26.186105 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dffeae-88a9-4eb8-b6dc-38a65da19570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:26.186987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dffeae-88a9-4eb8-b6dc-38a65da19570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:26.187452 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dffeae-88a9-4eb8-b6dc-38a65da19570 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:26.187730 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dffeae-88a9-4eb8-b6dc-38a65da19570 admin admin] PATH_INFO: `/v3/projects/6b64ea68e8914a0fa60ebe794ecf2f4c` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:26.189243 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dffeae-88a9-4eb8-b6dc-38a65da19570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b64ea68e8914a0fa60ebe794ecf2f4c)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:26.191379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dffeae-88a9-4eb8-b6dc-38a65da19570 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:26.191593 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1094/2162] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:25 2022] POST /identity/v3/users => generated 310 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:58:26.195287 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08763204-82bf-4318-a8c6-c21fd8d4a4e3 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:26.214273 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08763204-82bf-4318-a8c6-c21fd8d4a4e3 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:26.221295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e547436-067b-4e17-8e61-0bb7f9fea504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:26.221295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e547436-067b-4e17-8e61-0bb7f9fea504 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:26.221295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e547436-067b-4e17-8e61-0bb7f9fea504 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:26.221759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e547436-067b-4e17-8e61-0bb7f9fea504 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:26.222280 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e547436-067b-4e17-8e61-0bb7f9fea504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:26.224055 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e547436-067b-4e17-8e61-0bb7f9fea504 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:26.236377 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1095/2163] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:58:26.240919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e547436-067b-4e17-8e61-0bb7f9fea504 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:26.255626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e547436-067b-4e17-8e61-0bb7f9fea504 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:26.262056 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ed021-21e5-4aff-bda8-3053dab307d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:26.263113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ed021-21e5-4aff-bda8-3053dab307d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:26.263590 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ed021-21e5-4aff-bda8-3053dab307d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:26.264088 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ed021-21e5-4aff-bda8-3053dab307d3 admin admin] PATH_INFO: `/v3/projects/3f4eb4726c364f0da5d820dcc3e79baa/users/f49af68d025b4440863998c6ecb5f6d3/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:26.289930 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ed021-21e5-4aff-bda8-3053dab307d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4eb4726c364f0da5d820dcc3e79baa, user_id=f49af68d025b4440863998c6ecb5f6d3, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:26.301030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ed021-21e5-4aff-bda8-3053dab307d3 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:26.321287 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-54dffeae-88a9-4eb8-b6dc-38a65da19570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b64ea68e8914a0fa60ebe794ecf2f4c', 'request_id': 'req-54dffeae-88a9-4eb8-b6dc-38a65da19570'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:26.328626 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-54dffeae-88a9-4eb8-b6dc-38a65da19570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b64ea68e8914a0fa60ebe794ecf2f4c', 'request_id': 'req-54dffeae-88a9-4eb8-b6dc-38a65da19570'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:26.340261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-54dffeae-88a9-4eb8-b6dc-38a65da19570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b64ea68e8914a0fa60ebe794ecf2f4c', 'request_id': 'req-54dffeae-88a9-4eb8-b6dc-38a65da19570'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:26.393088 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1096/2164] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:26 2022] PUT /identity/v3/projects/3f4eb4726c364f0da5d820dcc3e79baa/users/f49af68d025b4440863998c6ecb5f6d3/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:26.418521 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ed021-21e5-4aff-bda8-3053dab307d3 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:26.447255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-54dffeae-88a9-4eb8-b6dc-38a65da19570 admin admin] The token cache is being invalidate because project 6b64ea68e8914a0fa60ebe794ecf2f4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:26.447754 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-54dffeae-88a9-4eb8-b6dc-38a65da19570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:26.449599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-54dffeae-88a9-4eb8-b6dc-38a65da19570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:26.451266 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1069/2165] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:26 2022] DELETE /identity/v3/projects/6b64ea68e8914a0fa60ebe794ecf2f4c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:26.456186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888ef58-5bec-4ffa-b59c-f7f7e0933336 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:26.456399 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888ef58-5bec-4ffa-b59c-f7f7e0933336 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:26.456709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888ef58-5bec-4ffa-b59c-f7f7e0933336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:26.506569 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4888ef58-5bec-4ffa-b59c-f7f7e0933336 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:26.506569 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4888ef58-5bec-4ffa-b59c-f7f7e0933336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:26.509506 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ed021-21e5-4aff-bda8-3053dab307d3 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:26.510720 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1070/2166] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:26.512804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519eb79f-381c-48a5-8d64-00ae89c27832 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:26.513356 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519eb79f-381c-48a5-8d64-00ae89c27832 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:26.513796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519eb79f-381c-48a5-8d64-00ae89c27832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:26.517218 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1bd84-213d-4d8c-a441-ab7bc877e0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:26.518286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1bd84-213d-4d8c-a441-ab7bc877e0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:26.518677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1bd84-213d-4d8c-a441-ab7bc877e0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:26.521512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1bd84-213d-4d8c-a441-ab7bc877e0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:26.522470 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1bd84-213d-4d8c-a441-ab7bc877e0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:26.524368 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1bd84-213d-4d8c-a441-ab7bc877e0b2 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:26.533928 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-519eb79f-381c-48a5-8d64-00ae89c27832 None None] MFA Rules not processed for user `e3818b63658b4c7588db8b4c4a25f16c`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:26.535156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-519eb79f-381c-48a5-8d64-00ae89c27832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:26.535518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1097/2167] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:26.537193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e550704-1e72-4ade-947a-058dbe387556 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:26.537633 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e550704-1e72-4ade-947a-058dbe387556 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:26.538013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e550704-1e72-4ade-947a-058dbe387556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:26.561417 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-5e550704-1e72-4ade-947a-058dbe387556 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:26.561722 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5e550704-1e72-4ade-947a-058dbe387556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:26.575450 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1098/2168] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:26.576751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e550704-1e72-4ade-947a-058dbe387556 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:26.578305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5e550704-1e72-4ade-947a-058dbe387556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:26.592633 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e550704-1e72-4ade-947a-058dbe387556 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:26.598951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad9bc2-ef98-4dea-b16a-e1e3bff798ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:26.600399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad9bc2-ef98-4dea-b16a-e1e3bff798ae admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:26.600828 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad9bc2-ef98-4dea-b16a-e1e3bff798ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:26.601116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad9bc2-ef98-4dea-b16a-e1e3bff798ae admin admin] PATH_INFO: `/v3/projects/3f4eb4726c364f0da5d820dcc3e79baa/users/f49af68d025b4440863998c6ecb5f6d3/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:26.605257 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad9bc2-ef98-4dea-b16a-e1e3bff798ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4eb4726c364f0da5d820dcc3e79baa, user_id=f49af68d025b4440863998c6ecb5f6d3, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:26.608972 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad9bc2-ef98-4dea-b16a-e1e3bff798ae admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:26.624915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1099/2169] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:26 2022] PUT /identity/v3/projects/3f4eb4726c364f0da5d820dcc3e79baa/users/f49af68d025b4440863998c6ecb5f6d3/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:26.633180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad9bc2-ef98-4dea-b16a-e1e3bff798ae admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:26.639162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1071/2170] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:26.640732 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8bf15-9469-4355-9670-7a3e8b9f322c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:26.641110 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8bf15-9469-4355-9670-7a3e8b9f322c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:26.641501 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8bf15-9469-4355-9670-7a3e8b9f322c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:26.688152 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-04f8bf15-9469-4355-9670-7a3e8b9f322c None None] MFA Rules not processed for user `f49af68d025b4440863998c6ecb5f6d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:26.689446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-04f8bf15-9469-4355-9670-7a3e8b9f322c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:26.787548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1072/2171] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:26 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:26.789764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad9bc2-ef98-4dea-b16a-e1e3bff798ae admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:26.796208 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776894ae-e91f-43ed-8527-d2ba50ec4653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:26.797454 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776894ae-e91f-43ed-8527-d2ba50ec4653 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:26.798200 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776894ae-e91f-43ed-8527-d2ba50ec4653 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:26.798637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776894ae-e91f-43ed-8527-d2ba50ec4653 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:26.799542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776894ae-e91f-43ed-8527-d2ba50ec4653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:58:26.800019 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776894ae-e91f-43ed-8527-d2ba50ec4653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:26.802249 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776894ae-e91f-43ed-8527-d2ba50ec4653 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:26.813351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8bf15-9469-4355-9670-7a3e8b9f322c None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:26.816763 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1100/2172] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:58:26.820963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776894ae-e91f-43ed-8527-d2ba50ec4653 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:26.821115 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-04f8bf15-9469-4355-9670-7a3e8b9f322c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:26.833045 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776894ae-e91f-43ed-8527-d2ba50ec4653 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:26.844730 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b54834-537a-4b4e-95b5-f146e361526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:26.845929 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b54834-537a-4b4e-95b5-f146e361526b admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:26.846415 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b54834-537a-4b4e-95b5-f146e361526b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:26.846887 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b54834-537a-4b4e-95b5-f146e361526b admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:26.847959 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b54834-537a-4b4e-95b5-f146e361526b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:26.850614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b54834-537a-4b4e-95b5-f146e361526b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:26.899463 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8bf15-9469-4355-9670-7a3e8b9f322c None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:26.903993 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35625da5-73ae-4c97-8543-3df06aa6c994 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:26.904892 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35625da5-73ae-4c97-8543-3df06aa6c994 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:26.905289 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35625da5-73ae-4c97-8543-3df06aa6c994 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:26.905675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35625da5-73ae-4c97-8543-3df06aa6c994 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:26.915908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35625da5-73ae-4c97-8543-3df06aa6c994 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:26.918116 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35625da5-73ae-4c97-8543-3df06aa6c994 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:26.928694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1073/2173] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:26 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:26.962166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1101/2174] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:26 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:58:26.967001 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35625da5-73ae-4c97-8543-3df06aa6c994 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:26.980492 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35625da5-73ae-4c97-8543-3df06aa6c994 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:27.046644 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d4777-6327-407d-a38c-1bce2541cf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:27.047515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d4777-6327-407d-a38c-1bce2541cf82 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:27.047810 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d4777-6327-407d-a38c-1bce2541cf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:27.048231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d4777-6327-407d-a38c-1bce2541cf82 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:27.048989 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d4777-6327-407d-a38c-1bce2541cf82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:27.051088 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d4777-6327-407d-a38c-1bce2541cf82 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:27.192474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1074/2175] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:26 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:58:27.196195 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b54834-537a-4b4e-95b5-f146e361526b admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:27.207677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b54834-537a-4b4e-95b5-f146e361526b admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:27.217647 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a61261-7a03-4575-928c-3d8b7de9f114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:27.218334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a61261-7a03-4575-928c-3d8b7de9f114 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:27.218810 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a61261-7a03-4575-928c-3d8b7de9f114 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:27.219253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a61261-7a03-4575-928c-3d8b7de9f114 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:27.220115 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a61261-7a03-4575-928c-3d8b7de9f114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:27.221842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a61261-7a03-4575-928c-3d8b7de9f114 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:27.232844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1102/2176] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:27.236860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d4777-6327-407d-a38c-1bce2541cf82 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:27.248836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d4777-6327-407d-a38c-1bce2541cf82 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:27.254834 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5989c-8f51-439b-a3c0-e427edf5fbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:27.255584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5989c-8f51-439b-a3c0-e427edf5fbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:27.255933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5989c-8f51-439b-a3c0-e427edf5fbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:27.256292 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5989c-8f51-439b-a3c0-e427edf5fbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:27.257191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5989c-8f51-439b-a3c0-e427edf5fbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:27.259117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5989c-8f51-439b-a3c0-e427edf5fbc9 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:27.272661 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1075/2177] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:27.277527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a61261-7a03-4575-928c-3d8b7de9f114 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:27.284705 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a61261-7a03-4575-928c-3d8b7de9f114 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:27.289235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c069ff-e79a-44a9-9ee8-241aab73e888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:27.290101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c069ff-e79a-44a9-9ee8-241aab73e888 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:27.290384 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c069ff-e79a-44a9-9ee8-241aab73e888 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:27.290658 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c069ff-e79a-44a9-9ee8-241aab73e888 admin admin] PATH_INFO: `/v3/projects/33d70a2028df4e7f9ea4cea606ffc8db/users/30e585beb23e4c6b8c6c3c5a236d251f/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:27.306613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c069ff-e79a-44a9-9ee8-241aab73e888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d70a2028df4e7f9ea4cea606ffc8db, user_id=30e585beb23e4c6b8c6c3c5a236d251f, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:27.311823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c069ff-e79a-44a9-9ee8-241aab73e888 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:27.394040 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5989c-8f51-439b-a3c0-e427edf5fbc9 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:27.397799 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a9e5989c-8f51-439b-a3c0-e427edf5fbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:27.403072 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1103/2178] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:27 2022] PUT /identity/v3/projects/33d70a2028df4e7f9ea4cea606ffc8db/users/30e585beb23e4c6b8c6c3c5a236d251f/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:27.414597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc815f9e-2480-4e2c-be01-c7da5e3754ae None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:27.414938 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc815f9e-2480-4e2c-be01-c7da5e3754ae None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:27.415201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc815f9e-2480-4e2c-be01-c7da5e3754ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:27.458918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-bc815f9e-2480-4e2c-be01-c7da5e3754ae None None] MFA Rules not processed for user `30e585beb23e4c6b8c6c3c5a236d251f`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:27.458918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-bc815f9e-2480-4e2c-be01-c7da5e3754ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:27.487427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5989c-8f51-439b-a3c0-e427edf5fbc9 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:27.554239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f991a92-9e73-4327-adaa-a7f8b0561a26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:27.554997 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f991a92-9e73-4327-adaa-a7f8b0561a26 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:27.555289 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f991a92-9e73-4327-adaa-a7f8b0561a26 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:27.555570 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f991a92-9e73-4327-adaa-a7f8b0561a26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:27.557465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2f991a92-9e73-4327-adaa-a7f8b0561a26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:27.563829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1104/2179] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:27.569519 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc815f9e-2480-4e2c-be01-c7da5e3754ae None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:27.613440 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:27.638653 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f991a92-9e73-4327-adaa-a7f8b0561a26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:27.640267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f991a92-9e73-4327-adaa-a7f8b0561a26 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:27.643732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc815f9e-2480-4e2c-be01-c7da5e3754ae None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:27.648567 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cc28a-c26b-4e85-9674-8bc96c26661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:27.649279 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cc28a-c26b-4e85-9674-8bc96c26661e admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:27.649482 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1076/2180] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:27 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:58:27.649586 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cc28a-c26b-4e85-9674-8bc96c26661e admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:27.649794 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cc28a-c26b-4e85-9674-8bc96c26661e admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:27.650510 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cc28a-c26b-4e85-9674-8bc96c26661e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:27.652989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cc28a-c26b-4e85-9674-8bc96c26661e admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:27.752596 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1105/2181] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:27 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:27.753797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f991a92-9e73-4327-adaa-a7f8b0561a26 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:27.764983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f991a92-9e73-4327-adaa-a7f8b0561a26 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:27.831503 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518da8b1-7265-41dd-b6df-27ba0ebfcbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:27.833084 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518da8b1-7265-41dd-b6df-27ba0ebfcbb2 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:27.833084 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518da8b1-7265-41dd-b6df-27ba0ebfcbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:27.835211 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518da8b1-7265-41dd-b6df-27ba0ebfcbb2 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:27.835211 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518da8b1-7265-41dd-b6df-27ba0ebfcbb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:27.838637 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518da8b1-7265-41dd-b6df-27ba0ebfcbb2 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:27.969334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1077/2182] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:27 2022] POST /identity/v3/users => generated 290 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:27.979932 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cc28a-c26b-4e85-9674-8bc96c26661e admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:27.990629 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cc28a-c26b-4e85-9674-8bc96c26661e admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:27.995186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d98d77-46fc-428c-a773-0f1d3c17faf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:27.996009 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d98d77-46fc-428c-a773-0f1d3c17faf2 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:27.996165 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d98d77-46fc-428c-a773-0f1d3c17faf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:27.996485 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d98d77-46fc-428c-a773-0f1d3c17faf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:27.997216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d98d77-46fc-428c-a773-0f1d3c17faf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:27.998803 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d98d77-46fc-428c-a773-0f1d3c17faf2 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:28.009576 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1106/2183] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:28.014182 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518da8b1-7265-41dd-b6df-27ba0ebfcbb2 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:28.024139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518da8b1-7265-41dd-b6df-27ba0ebfcbb2 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:28.029545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5ff7d-8177-495a-9ecc-eac198ff9820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:28.030197 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5ff7d-8177-495a-9ecc-eac198ff9820 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:28.030498 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5ff7d-8177-495a-9ecc-eac198ff9820 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:28.030773 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5ff7d-8177-495a-9ecc-eac198ff9820 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:28.031524 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5ff7d-8177-495a-9ecc-eac198ff9820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:28.033308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5ff7d-8177-495a-9ecc-eac198ff9820 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:28.043140 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1078/2184] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:28.047644 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d98d77-46fc-428c-a773-0f1d3c17faf2 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:28.057679 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d98d77-46fc-428c-a773-0f1d3c17faf2 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:28.062407 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070187c0-2f4e-475c-90ff-4539eab3cae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:28.063284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070187c0-2f4e-475c-90ff-4539eab3cae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:28.063573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070187c0-2f4e-475c-90ff-4539eab3cae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:28.063855 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070187c0-2f4e-475c-90ff-4539eab3cae8 admin admin] PATH_INFO: `/v3/projects/9098aadd4b2d454d8ab88d2a1deec3dd/users/78f7e29a79284a779312bf2c14325622/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:28.080091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070187c0-2f4e-475c-90ff-4539eab3cae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9098aadd4b2d454d8ab88d2a1deec3dd, user_id=78f7e29a79284a779312bf2c14325622, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:28.084303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070187c0-2f4e-475c-90ff-4539eab3cae8 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:28.103918 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:28.209345 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1107/2185] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:28 2022] PUT /identity/v3/projects/9098aadd4b2d454d8ab88d2a1deec3dd/users/78f7e29a79284a779312bf2c14325622/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:28.220646 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40962f21-d302-4f42-9701-9ef223738f64 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:28.221189 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40962f21-d302-4f42-9701-9ef223738f64 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:28.221189 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40962f21-d302-4f42-9701-9ef223738f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:28.253502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-40962f21-d302-4f42-9701-9ef223738f64 None None] MFA Rules not processed for user `78f7e29a79284a779312bf2c14325622`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:28.254917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-40962f21-d302-4f42-9701-9ef223738f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:28.329264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1079/2186] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:28.333529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070187c0-2f4e-475c-90ff-4539eab3cae8 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:28.405275 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070187c0-2f4e-475c-90ff-4539eab3cae8 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:28.410439 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c049d-831b-4df5-b74d-71fad34f0964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:28.411133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c049d-831b-4df5-b74d-71fad34f0964 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:28.411416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c049d-831b-4df5-b74d-71fad34f0964 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:28.411669 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c049d-831b-4df5-b74d-71fad34f0964 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:28.412426 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c049d-831b-4df5-b74d-71fad34f0964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:28.414529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c049d-831b-4df5-b74d-71fad34f0964 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:28.523210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1108/2187] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:28 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:58:28.527514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40962f21-d302-4f42-9701-9ef223738f64 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:28.544410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40962f21-d302-4f42-9701-9ef223738f64 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:28.600175 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b6cbf-fde1-4a64-ad8a-780b54e21d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:28.600877 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b6cbf-fde1-4a64-ad8a-780b54e21d38 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:28.601166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b6cbf-fde1-4a64-ad8a-780b54e21d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:28.601440 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b6cbf-fde1-4a64-ad8a-780b54e21d38 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:28.602154 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b6cbf-fde1-4a64-ad8a-780b54e21d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:28.604085 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b6cbf-fde1-4a64-ad8a-780b54e21d38 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:28.772306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1080/2188] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:28 2022] POST /identity/v3/users => generated 295 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:28.778645 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c049d-831b-4df5-b74d-71fad34f0964 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:28.789448 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c049d-831b-4df5-b74d-71fad34f0964 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:28.795446 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6bbe8-337b-4cce-b54d-2d8c32b68b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:28.796221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6bbe8-337b-4cce-b54d-2d8c32b68b0f admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:28.796535 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6bbe8-337b-4cce-b54d-2d8c32b68b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:28.796830 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6bbe8-337b-4cce-b54d-2d8c32b68b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:28.797561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6bbe8-337b-4cce-b54d-2d8c32b68b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:28.799187 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6bbe8-337b-4cce-b54d-2d8c32b68b0f admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:28.810996 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1109/2189] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:28.815345 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b6cbf-fde1-4a64-ad8a-780b54e21d38 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:28.825490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b6cbf-fde1-4a64-ad8a-780b54e21d38 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:28.830411 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5cb00-72a0-4df6-8c15-1ccaaca39465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:28.831296 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5cb00-72a0-4df6-8c15-1ccaaca39465 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:28.831584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5cb00-72a0-4df6-8c15-1ccaaca39465 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:28.831867 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5cb00-72a0-4df6-8c15-1ccaaca39465 admin admin] PATH_INFO: `/v3/projects/fab3a408d91843ff85cde0f03ddc064e/users/d908438daeba46889e2a6d309ddf46fd/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:28.847505 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5cb00-72a0-4df6-8c15-1ccaaca39465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fab3a408d91843ff85cde0f03ddc064e, user_id=d908438daeba46889e2a6d309ddf46fd, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:28.850231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5cb00-72a0-4df6-8c15-1ccaaca39465 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:28.979602 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1081/2190] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:28 2022] PUT /identity/v3/projects/fab3a408d91843ff85cde0f03ddc064e/users/d908438daeba46889e2a6d309ddf46fd/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:28.983079 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6bbe8-337b-4cce-b54d-2d8c32b68b0f admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:29.003838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6bbe8-337b-4cce-b54d-2d8c32b68b0f admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:29.065624 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead55174-a09c-4f93-bb59-b2545612f8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:29.066342 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead55174-a09c-4f93-bb59-b2545612f8ca admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:29.066654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead55174-a09c-4f93-bb59-b2545612f8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:29.066942 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead55174-a09c-4f93-bb59-b2545612f8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:29.067762 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead55174-a09c-4f93-bb59-b2545612f8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:29.069504 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead55174-a09c-4f93-bb59-b2545612f8ca admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:29.083043 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1110/2191] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:29.084368 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5cb00-72a0-4df6-8c15-1ccaaca39465 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:29.095485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5cb00-72a0-4df6-8c15-1ccaaca39465 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:29.100922 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6bdbf-631f-4724-b71c-d337be465ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:29.101817 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6bdbf-631f-4724-b71c-d337be465ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:29.102337 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6bdbf-631f-4724-b71c-d337be465ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:29.102627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6bdbf-631f-4724-b71c-d337be465ea8 admin admin] PATH_INFO: `/v3/projects/fab3a408d91843ff85cde0f03ddc064e/users/d908438daeba46889e2a6d309ddf46fd/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:29.105205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6bdbf-631f-4724-b71c-d337be465ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fab3a408d91843ff85cde0f03ddc064e, user_id=d908438daeba46889e2a6d309ddf46fd, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:29.108072 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6bdbf-631f-4724-b71c-d337be465ea8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:29.119081 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1082/2192] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:29 2022] PUT /identity/v3/projects/fab3a408d91843ff85cde0f03ddc064e/users/d908438daeba46889e2a6d309ddf46fd/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:29.129314 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfd381-9c95-423e-9493-eaaf44ce0249 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:29.129752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfd381-9c95-423e-9493-eaaf44ce0249 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:29.129888 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfd381-9c95-423e-9493-eaaf44ce0249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:29.152541 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:29.163489 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-6bcfd381-9c95-423e-9493-eaaf44ce0249 None None] MFA Rules not processed for user `d908438daeba46889e2a6d309ddf46fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:29.164737 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6bcfd381-9c95-423e-9493-eaaf44ce0249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:29.237091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1111/2193] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:29.249851 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6bdbf-631f-4724-b71c-d337be465ea8 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:29.311535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6bdbf-631f-4724-b71c-d337be465ea8 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:29.315378 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838c75b-995e-474b-a12b-8e4cd132cf1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:29.316061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838c75b-995e-474b-a12b-8e4cd132cf1a service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:29.319205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838c75b-995e-474b-a12b-8e4cd132cf1a service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:29.319205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838c75b-995e-474b-a12b-8e4cd132cf1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:29.326806 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838c75b-995e-474b-a12b-8e4cd132cf1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:29.328226 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838c75b-995e-474b-a12b-8e4cd132cf1a service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:29.348332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1083/2194] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:58:29.491930 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfd381-9c95-423e-9493-eaaf44ce0249 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:29.501245 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfd381-9c95-423e-9493-eaaf44ce0249 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:29.505015 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7511c84-0d0e-462b-92ff-e390b8c9e3ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:29.505662 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7511c84-0d0e-462b-92ff-e390b8c9e3ab service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:29.505956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7511c84-0d0e-462b-92ff-e390b8c9e3ab service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:29.506226 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7511c84-0d0e-462b-92ff-e390b8c9e3ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:29.581393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7511c84-0d0e-462b-92ff-e390b8c9e3ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:29.583091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7511c84-0d0e-462b-92ff-e390b8c9e3ab service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:29.594630 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1112/2195] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:30.239776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:31.184404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:31.904259 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:32.301065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838c75b-995e-474b-a12b-8e4cd132cf1a service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:32.303539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e838c75b-995e-474b-a12b-8e4cd132cf1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:32.398978 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838c75b-995e-474b-a12b-8e4cd132cf1a service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:32.404966 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317daeb-db7e-47ff-b489-7da73ecd7b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:32.406692 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317daeb-db7e-47ff-b489-7da73ecd7b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:32.407144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317daeb-db7e-47ff-b489-7da73ecd7b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:32.407604 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317daeb-db7e-47ff-b489-7da73ecd7b68 admin admin] PATH_INFO: `/v3/users/4e921c95b9864dd19812ee070f1d1653` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:32.410090 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317daeb-db7e-47ff-b489-7da73ecd7b68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e921c95b9864dd19812ee070f1d1653)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:32.412421 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317daeb-db7e-47ff-b489-7da73ecd7b68 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:32.672749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a317daeb-db7e-47ff-b489-7da73ecd7b68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e921c95b9864dd19812ee070f1d1653'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:32.673461 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a317daeb-db7e-47ff-b489-7da73ecd7b68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e921c95b9864dd19812ee070f1d1653'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:32.787606 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a317daeb-db7e-47ff-b489-7da73ecd7b68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e921c95b9864dd19812ee070f1d1653'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:32.796735 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a317daeb-db7e-47ff-b489-7da73ecd7b68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e921c95b9864dd19812ee070f1d1653'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:32.818552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-a317daeb-db7e-47ff-b489-7da73ecd7b68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e921c95b9864dd19812ee070f1d1653'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:32.824814 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1084/2196] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:32 2022] DELETE /identity/v3/users/4e921c95b9864dd19812ee070f1d1653 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:32.829796 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ebbc4-8d2d-408b-b03a-fd118ad0d63f None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:32.830098 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ebbc4-8d2d-408b-b03a-fd118ad0d63f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:32.830436 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ebbc4-8d2d-408b-b03a-fd118ad0d63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:32.848743 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-1c0ebbc4-8d2d-408b-b03a-fd118ad0d63f None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:32.849967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-1c0ebbc4-8d2d-408b-b03a-fd118ad0d63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:32.908865 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1113/2197] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:32.918911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317daeb-db7e-47ff-b489-7da73ecd7b68 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:32.920400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a317daeb-db7e-47ff-b489-7da73ecd7b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:32.981352 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317daeb-db7e-47ff-b489-7da73ecd7b68 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:32.985354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a8339-639e-478d-a7ea-af2dd8443c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:32.986014 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a8339-639e-478d-a7ea-af2dd8443c2a service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:32.986301 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a8339-639e-478d-a7ea-af2dd8443c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:32.986580 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a8339-639e-478d-a7ea-af2dd8443c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:32.998061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a8339-639e-478d-a7ea-af2dd8443c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:32.999574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a8339-639e-478d-a7ea-af2dd8443c2a service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:33.010733 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1085/2198] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:58:33.483798 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ebbc4-8d2d-408b-b03a-fd118ad0d63f None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:33.485490 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-1c0ebbc4-8d2d-408b-b03a-fd118ad0d63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:33.501699 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ebbc4-8d2d-408b-b03a-fd118ad0d63f None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:33.508771 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac273d-1831-499c-87b0-ba4aafc964f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:33.510662 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac273d-1831-499c-87b0-ba4aafc964f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:33.511050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac273d-1831-499c-87b0-ba4aafc964f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:33.511659 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac273d-1831-499c-87b0-ba4aafc964f4 admin admin] PATH_INFO: `/v3/projects/556f39d061844c89a3a29664bcea98b6` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:33.513373 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac273d-1831-499c-87b0-ba4aafc964f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=556f39d061844c89a3a29664bcea98b6)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:33.515788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac273d-1831-499c-87b0-ba4aafc964f4 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:33.663761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-dbac273d-1831-499c-87b0-ba4aafc964f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '556f39d061844c89a3a29664bcea98b6', 'request_id': 'req-dbac273d-1831-499c-87b0-ba4aafc964f4'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:33.920504 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-dbac273d-1831-499c-87b0-ba4aafc964f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '556f39d061844c89a3a29664bcea98b6', 'request_id': 'req-dbac273d-1831-499c-87b0-ba4aafc964f4'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:33.927213 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-dbac273d-1831-499c-87b0-ba4aafc964f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '556f39d061844c89a3a29664bcea98b6', 'request_id': 'req-dbac273d-1831-499c-87b0-ba4aafc964f4'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:33.937998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-dbac273d-1831-499c-87b0-ba4aafc964f4 admin admin] The token cache is being invalidate because project 556f39d061844c89a3a29664bcea98b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:33.938512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-dbac273d-1831-499c-87b0-ba4aafc964f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:33.939174 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-dbac273d-1831-499c-87b0-ba4aafc964f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:33.940791 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1114/2199] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:33 2022] DELETE /identity/v3/projects/556f39d061844c89a3a29664bcea98b6 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:33.946110 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de054b-f7c0-4105-ae6c-bfecb9154ba0 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:33.946599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de054b-f7c0-4105-ae6c-bfecb9154ba0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:33.946714 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de054b-f7c0-4105-ae6c-bfecb9154ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:33.964476 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-34de054b-f7c0-4105-ae6c-bfecb9154ba0 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:33.965682 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-34de054b-f7c0-4105-ae6c-bfecb9154ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:34.024876 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1086/2200] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:58:34.032805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6933f5-d47b-40e3-8d6c-425a4938c99c None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:34.036838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6933f5-d47b-40e3-8d6c-425a4938c99c None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:34.036838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6933f5-d47b-40e3-8d6c-425a4938c99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:34.054204 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-4c6933f5-d47b-40e3-8d6c-425a4938c99c None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:34.055454 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-4c6933f5-d47b-40e3-8d6c-425a4938c99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:34.055883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de054b-f7c0-4105-ae6c-bfecb9154ba0 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:34.057901 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-34de054b-f7c0-4105-ae6c-bfecb9154ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:34.064555 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1115/2201] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:34.068620 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6933f5-d47b-40e3-8d6c-425a4938c99c None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:34.070297 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de054b-f7c0-4105-ae6c-bfecb9154ba0 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:34.076044 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bdb3d-1a5b-41ab-a0df-6f6af0971332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:34.077346 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bdb3d-1a5b-41ab-a0df-6f6af0971332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:34.077346 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bdb3d-1a5b-41ab-a0df-6f6af0971332 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:34.077585 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bdb3d-1a5b-41ab-a0df-6f6af0971332 admin admin] PATH_INFO: `/v3/users/30e585beb23e4c6b8c6c3c5a236d251f` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:34.078202 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6933f5-d47b-40e3-8d6c-425a4938c99c None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:34.078743 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bdb3d-1a5b-41ab-a0df-6f6af0971332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e585beb23e4c6b8c6c3c5a236d251f)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:34.080701 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bdb3d-1a5b-41ab-a0df-6f6af0971332 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:34.082849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85501dce-43a7-4f78-b32b-7d44a9a60fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:34.083835 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85501dce-43a7-4f78-b32b-7d44a9a60fec admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:34.083835 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85501dce-43a7-4f78-b32b-7d44a9a60fec admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:34.084153 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85501dce-43a7-4f78-b32b-7d44a9a60fec admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:34.084943 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85501dce-43a7-4f78-b32b-7d44a9a60fec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:58:34.085257 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85501dce-43a7-4f78-b32b-7d44a9a60fec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:34.086916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85501dce-43a7-4f78-b32b-7d44a9a60fec admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:34.087918 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:34.098835 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1116/2202] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:58:34.103099 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85501dce-43a7-4f78-b32b-7d44a9a60fec admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:34.113559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85501dce-43a7-4f78-b32b-7d44a9a60fec admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:34.118305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137e066-3016-482a-a33b-25b2cc252c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:34.118992 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137e066-3016-482a-a33b-25b2cc252c6f admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:34.120473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137e066-3016-482a-a33b-25b2cc252c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:34.120761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137e066-3016-482a-a33b-25b2cc252c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:34.121518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137e066-3016-482a-a33b-25b2cc252c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:34.123377 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137e066-3016-482a-a33b-25b2cc252c6f admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:34.242559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1117/2203] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:34 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:58:34.247357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137e066-3016-482a-a33b-25b2cc252c6f admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:34.288324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-488bdb3d-1a5b-41ab-a0df-6f6af0971332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e585beb23e4c6b8c6c3c5a236d251f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:34.289047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-488bdb3d-1a5b-41ab-a0df-6f6af0971332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e585beb23e4c6b8c6c3c5a236d251f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:34.333868 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137e066-3016-482a-a33b-25b2cc252c6f admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:34.339897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b6934-db3a-44e1-9c5a-6fb61fa9ac44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:34.340671 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b6934-db3a-44e1-9c5a-6fb61fa9ac44 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:34.340957 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b6934-db3a-44e1-9c5a-6fb61fa9ac44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:34.341234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b6934-db3a-44e1-9c5a-6fb61fa9ac44 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:34.344905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b6934-db3a-44e1-9c5a-6fb61fa9ac44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:34.344905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b6934-db3a-44e1-9c5a-6fb61fa9ac44 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:34.364879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-488bdb3d-1a5b-41ab-a0df-6f6af0971332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e585beb23e4c6b8c6c3c5a236d251f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:34.373147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-488bdb3d-1a5b-41ab-a0df-6f6af0971332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e585beb23e4c6b8c6c3c5a236d251f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:34.385466 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-488bdb3d-1a5b-41ab-a0df-6f6af0971332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e585beb23e4c6b8c6c3c5a236d251f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:34.391435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1087/2204] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:34 2022] DELETE /identity/v3/users/30e585beb23e4c6b8c6c3c5a236d251f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:34.395836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e8a36-b2b9-44ea-9109-de94c5da388d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:34.396526 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e8a36-b2b9-44ea-9109-de94c5da388d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:34.396526 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e8a36-b2b9-44ea-9109-de94c5da388d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:34.414237 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-bd5e8a36-b2b9-44ea-9109-de94c5da388d None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:34.415455 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bd5e8a36-b2b9-44ea-9109-de94c5da388d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:34.451220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1118/2205] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:34 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:34.455219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b6934-db3a-44e1-9c5a-6fb61fa9ac44 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:34.456912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-7f6b6934-db3a-44e1-9c5a-6fb61fa9ac44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:34.469488 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b6934-db3a-44e1-9c5a-6fb61fa9ac44 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:34.480479 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1088/2206] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:58:34.488569 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e8a36-b2b9-44ea-9109-de94c5da388d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:34.489905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bd5e8a36-b2b9-44ea-9109-de94c5da388d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:34.532996 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1a659-7513-4a67-a611-11cc03ad7077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:34.533678 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1a659-7513-4a67-a611-11cc03ad7077 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:34.534138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1a659-7513-4a67-a611-11cc03ad7077 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:34.534452 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1a659-7513-4a67-a611-11cc03ad7077 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:34.535223 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1a659-7513-4a67-a611-11cc03ad7077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:34.536956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1a659-7513-4a67-a611-11cc03ad7077 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:34.547513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1119/2207] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:58:34.552738 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1a659-7513-4a67-a611-11cc03ad7077 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:34.554917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e8a36-b2b9-44ea-9109-de94c5da388d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:34.558961 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4a5a9-ffa5-493e-be7a-aa3e2b985db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:34.559661 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4a5a9-ffa5-493e-be7a-aa3e2b985db3 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:34.559892 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4a5a9-ffa5-493e-be7a-aa3e2b985db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:34.560169 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4a5a9-ffa5-493e-be7a-aa3e2b985db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:34.564234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1a659-7513-4a67-a611-11cc03ad7077 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:34.570505 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4ee6f-be1b-4948-b0b7-4633a831f938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:34.570733 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4a5a9-ffa5-493e-be7a-aa3e2b985db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:34.572579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4ee6f-be1b-4948-b0b7-4633a831f938 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:34.572579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4ee6f-be1b-4948-b0b7-4633a831f938 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:34.572579 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4ee6f-be1b-4948-b0b7-4633a831f938 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:34.572839 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4a5a9-ffa5-493e-be7a-aa3e2b985db3 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:34.572917 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4ee6f-be1b-4948-b0b7-4633a831f938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:34.574528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4ee6f-be1b-4948-b0b7-4633a831f938 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:34.584080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1089/2208] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:58:34.591387 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1120/2209] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:58:34.592622 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4a5a9-ffa5-493e-be7a-aa3e2b985db3 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:34.602887 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4a5a9-ffa5-493e-be7a-aa3e2b985db3 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:34.608694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d3401-bf81-4432-9caf-e3c7d13a1491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:34.609665 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d3401-bf81-4432-9caf-e3c7d13a1491 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:34.616120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d3401-bf81-4432-9caf-e3c7d13a1491 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:34.616120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d3401-bf81-4432-9caf-e3c7d13a1491 admin admin] PATH_INFO: `/v3/projects/901e7ccce46d4f4a961ecc1cf33093ac/users/4e36d6a0be344bac9b202e17f9993580/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:34.633967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d3401-bf81-4432-9caf-e3c7d13a1491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=901e7ccce46d4f4a961ecc1cf33093ac, user_id=4e36d6a0be344bac9b202e17f9993580, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:34.638341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d3401-bf81-4432-9caf-e3c7d13a1491 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:34.710114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1090/2210] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:34 2022] PUT /identity/v3/projects/901e7ccce46d4f4a961ecc1cf33093ac/users/4e36d6a0be344bac9b202e17f9993580/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:34.724506 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476df7c-636a-46d0-b8cd-cbe1a2e48f3d None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:34.724506 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476df7c-636a-46d0-b8cd-cbe1a2e48f3d None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:34.724506 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476df7c-636a-46d0-b8cd-cbe1a2e48f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:34.754857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-c476df7c-636a-46d0-b8cd-cbe1a2e48f3d None None] MFA Rules not processed for user `4e36d6a0be344bac9b202e17f9993580`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:34.757023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c476df7c-636a-46d0-b8cd-cbe1a2e48f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:34.852487 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1121/2211] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:34.865832 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d3401-bf81-4432-9caf-e3c7d13a1491 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:34.930440 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d3401-bf81-4432-9caf-e3c7d13a1491 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:34.936774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:34.938187 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788231e-4f86-4c4e-a705-de491bc30c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:34.938860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788231e-4f86-4c4e-a705-de491bc30c3e admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:34.939144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788231e-4f86-4c4e-a705-de491bc30c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:34.939422 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788231e-4f86-4c4e-a705-de491bc30c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:34.940132 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788231e-4f86-4c4e-a705-de491bc30c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:34.943245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788231e-4f86-4c4e-a705-de491bc30c3e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:35.071052 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1091/2212] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:34 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:35.077745 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476df7c-636a-46d0-b8cd-cbe1a2e48f3d None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:35.091622 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476df7c-636a-46d0-b8cd-cbe1a2e48f3d None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:35.169997 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dd71a-f98a-4e2c-9aa2-621270170ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:35.171105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dd71a-f98a-4e2c-9aa2-621270170ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:35.171391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dd71a-f98a-4e2c-9aa2-621270170ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:35.171671 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dd71a-f98a-4e2c-9aa2-621270170ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:35.172387 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23dd71a-f98a-4e2c-9aa2-621270170ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:35.174409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23dd71a-f98a-4e2c-9aa2-621270170ee9 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:35.210481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788231e-4f86-4c4e-a705-de491bc30c3e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:35.212244 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4788231e-4f86-4c4e-a705-de491bc30c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:35.224899 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788231e-4f86-4c4e-a705-de491bc30c3e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:35.229909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2406d-4c19-4a78-b76e-8f9ae49ad4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:35.230794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2406d-4c19-4a78-b76e-8f9ae49ad4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:35.231167 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2406d-4c19-4a78-b76e-8f9ae49ad4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:35.231465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2406d-4c19-4a78-b76e-8f9ae49ad4fd admin admin] PATH_INFO: `/v3/users/564fcdb2233d469691645814a74630f8` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:35.232711 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2406d-4c19-4a78-b76e-8f9ae49ad4fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=564fcdb2233d469691645814a74630f8)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:35.236217 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2406d-4c19-4a78-b76e-8f9ae49ad4fd admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:35.274619 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1122/2213] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:35 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:58:35.275528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dd71a-f98a-4e2c-9aa2-621270170ee9 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:35.277096 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-e23dd71a-f98a-4e2c-9aa2-621270170ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:35.288559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dd71a-f98a-4e2c-9aa2-621270170ee9 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:35.293339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4cd71-42b0-4d4a-8157-b33c31f357d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:35.294198 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4cd71-42b0-4d4a-8157-b33c31f357d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:35.294519 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4cd71-42b0-4d4a-8157-b33c31f357d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:35.294801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4cd71-42b0-4d4a-8157-b33c31f357d2 admin admin] PATH_INFO: `/v3/projects/33d70a2028df4e7f9ea4cea606ffc8db` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:35.296024 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4cd71-42b0-4d4a-8157-b33c31f357d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33d70a2028df4e7f9ea4cea606ffc8db)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:35.297981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4cd71-42b0-4d4a-8157-b33c31f357d2 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:35.460000 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-25b2406d-4c19-4a78-b76e-8f9ae49ad4fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564fcdb2233d469691645814a74630f8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:35.460718 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-25b2406d-4c19-4a78-b76e-8f9ae49ad4fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564fcdb2233d469691645814a74630f8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:35.465195 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-57d4cd71-42b0-4d4a-8157-b33c31f357d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33d70a2028df4e7f9ea4cea606ffc8db', 'request_id': 'req-57d4cd71-42b0-4d4a-8157-b33c31f357d2'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:35.526428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-25b2406d-4c19-4a78-b76e-8f9ae49ad4fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564fcdb2233d469691645814a74630f8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:35.535140 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-25b2406d-4c19-4a78-b76e-8f9ae49ad4fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564fcdb2233d469691645814a74630f8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:35.547411 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-25b2406d-4c19-4a78-b76e-8f9ae49ad4fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564fcdb2233d469691645814a74630f8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:35.553524 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1092/2214] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:35 2022] DELETE /identity/v3/users/564fcdb2233d469691645814a74630f8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:35.554380 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2406d-4c19-4a78-b76e-8f9ae49ad4fd admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:35.555719 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-25b2406d-4c19-4a78-b76e-8f9ae49ad4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:35.594806 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-57d4cd71-42b0-4d4a-8157-b33c31f357d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33d70a2028df4e7f9ea4cea606ffc8db', 'request_id': 'req-57d4cd71-42b0-4d4a-8157-b33c31f357d2'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:35.603257 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-57d4cd71-42b0-4d4a-8157-b33c31f357d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33d70a2028df4e7f9ea4cea606ffc8db', 'request_id': 'req-57d4cd71-42b0-4d4a-8157-b33c31f357d2'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:35.614633 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-57d4cd71-42b0-4d4a-8157-b33c31f357d2 admin admin] The token cache is being invalidate because project 33d70a2028df4e7f9ea4cea606ffc8db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:35.614928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-57d4cd71-42b0-4d4a-8157-b33c31f357d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:35.615590 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-57d4cd71-42b0-4d4a-8157-b33c31f357d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:35.617189 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1123/2215] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:35 2022] DELETE /identity/v3/projects/33d70a2028df4e7f9ea4cea606ffc8db => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:35.618419 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfce0d-13f3-43ac-a48e-f48660c752dc None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:35.618709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfce0d-13f3-43ac-a48e-f48660c752dc None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:35.619702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfce0d-13f3-43ac-a48e-f48660c752dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:35.620578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2406d-4c19-4a78-b76e-8f9ae49ad4fd admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:35.625210 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaca86-6277-450c-99d6-b3803c5f5dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:35.625883 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaca86-6277-450c-99d6-b3803c5f5dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:35.626188 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaca86-6277-450c-99d6-b3803c5f5dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:35.626472 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaca86-6277-450c-99d6-b3803c5f5dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:35.627208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaaca86-6277-450c-99d6-b3803c5f5dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:35.628878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaaca86-6277-450c-99d6-b3803c5f5dc1 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:35.637645 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-5bcfce0d-13f3-43ac-a48e-f48660c752dc None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:35.638862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5bcfce0d-13f3-43ac-a48e-f48660c752dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:35.639403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1093/2216] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:35.640218 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaca86-6277-450c-99d6-b3803c5f5dc1 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:35.641880 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-eeaaca86-6277-450c-99d6-b3803c5f5dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:35.646897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1124/2217] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:35.647670 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfce0d-13f3-43ac-a48e-f48660c752dc None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:35.649121 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5bcfce0d-13f3-43ac-a48e-f48660c752dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:35.654468 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaca86-6277-450c-99d6-b3803c5f5dc1 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:35.660357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf95ed8-be57-4eef-bcd6-d0a7cda11a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:35.666270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf95ed8-be57-4eef-bcd6-d0a7cda11a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:35.666270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf95ed8-be57-4eef-bcd6-d0a7cda11a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:35.666548 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfce0d-13f3-43ac-a48e-f48660c752dc None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:35.666667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf95ed8-be57-4eef-bcd6-d0a7cda11a80 admin admin] PATH_INFO: `/v3/users/78f7e29a79284a779312bf2c14325622` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:35.666667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf95ed8-be57-4eef-bcd6-d0a7cda11a80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f7e29a79284a779312bf2c14325622)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:35.666667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf95ed8-be57-4eef-bcd6-d0a7cda11a80 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:35.667304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471caf1-bbb7-4d76-8f82-da9220e4fcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:35.668171 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471caf1-bbb7-4d76-8f82-da9220e4fcb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:35.668487 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471caf1-bbb7-4d76-8f82-da9220e4fcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:35.668773 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471caf1-bbb7-4d76-8f82-da9220e4fcb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:35.669494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471caf1-bbb7-4d76-8f82-da9220e4fcb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:35.671101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471caf1-bbb7-4d76-8f82-da9220e4fcb3 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:35.681266 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1125/2218] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:35.683249 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471caf1-bbb7-4d76-8f82-da9220e4fcb3 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:35.684923 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-3471caf1-bbb7-4d76-8f82-da9220e4fcb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:35.741988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471caf1-bbb7-4d76-8f82-da9220e4fcb3 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:35.746308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d858d8-dd91-4e64-9a35-ae601423c5bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:35.746954 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d858d8-dd91-4e64-9a35-ae601423c5bd service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:35.747242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d858d8-dd91-4e64-9a35-ae601423c5bd service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:35.747520 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d858d8-dd91-4e64-9a35-ae601423c5bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:35.756754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d858d8-dd91-4e64-9a35-ae601423c5bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:35.758506 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d858d8-dd91-4e64-9a35-ae601423c5bd service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:35.768394 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1126/2219] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:35.769085 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d858d8-dd91-4e64-9a35-ae601423c5bd service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:35.778709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d858d8-dd91-4e64-9a35-ae601423c5bd service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:35.783765 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8841ca-5616-4dee-a8aa-8e4756b251de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:35.784889 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8841ca-5616-4dee-a8aa-8e4756b251de admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:35.785224 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8841ca-5616-4dee-a8aa-8e4756b251de admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:35.785520 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8841ca-5616-4dee-a8aa-8e4756b251de admin admin] PATH_INFO: `/v3/projects/86f89a8c85774a8d96776d72681d4db6/users/e2bb8d8d4161401a9a302262f567822d/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:35.804549 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8841ca-5616-4dee-a8aa-8e4756b251de admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f89a8c85774a8d96776d72681d4db6, user_id=e2bb8d8d4161401a9a302262f567822d, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:35.807490 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8841ca-5616-4dee-a8aa-8e4756b251de admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:35.825811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9cf95ed8-be57-4eef-bcd6-d0a7cda11a80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f7e29a79284a779312bf2c14325622'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:35.826757 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9cf95ed8-be57-4eef-bcd6-d0a7cda11a80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f7e29a79284a779312bf2c14325622'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:35.887605 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1127/2220] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:35 2022] PUT /identity/v3/projects/86f89a8c85774a8d96776d72681d4db6/users/e2bb8d8d4161401a9a302262f567822d/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:35.898980 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44715fe6-ff13-4291-b8f2-e5a8204fa5d4 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:35.899486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44715fe6-ff13-4291-b8f2-e5a8204fa5d4 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:35.899961 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44715fe6-ff13-4291-b8f2-e5a8204fa5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:35.929538 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-44715fe6-ff13-4291-b8f2-e5a8204fa5d4 None None] MFA Rules not processed for user `e2bb8d8d4161401a9a302262f567822d`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:35.930900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-44715fe6-ff13-4291-b8f2-e5a8204fa5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:35.932730 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9cf95ed8-be57-4eef-bcd6-d0a7cda11a80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f7e29a79284a779312bf2c14325622'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:35.943117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9cf95ed8-be57-4eef-bcd6-d0a7cda11a80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f7e29a79284a779312bf2c14325622'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:35.963381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-9cf95ed8-be57-4eef-bcd6-d0a7cda11a80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f7e29a79284a779312bf2c14325622'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:35.974513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1094/2221] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:35 2022] DELETE /identity/v3/users/78f7e29a79284a779312bf2c14325622 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:36.042210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1128/2222] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:58:36.046624 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf95ed8-be57-4eef-bcd6-d0a7cda11a80 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:36.048086 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9cf95ed8-be57-4eef-bcd6-d0a7cda11a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:36.111137 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:36.141316 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf95ed8-be57-4eef-bcd6-d0a7cda11a80 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:36.155694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5d095-74e9-4802-a67e-ce0d263dbc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:36.155694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5d095-74e9-4802-a67e-ce0d263dbc5a admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:36.155694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5d095-74e9-4802-a67e-ce0d263dbc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:36.155694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5d095-74e9-4802-a67e-ce0d263dbc5a admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:36.156346 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5d095-74e9-4802-a67e-ce0d263dbc5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:36.156346 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5d095-74e9-4802-a67e-ce0d263dbc5a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:36.276036 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1095/2223] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:36 2022] POST /identity/v3/projects => generated 377 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:36.279888 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44715fe6-ff13-4291-b8f2-e5a8204fa5d4 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:36.374347 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44715fe6-ff13-4291-b8f2-e5a8204fa5d4 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:36.446900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25273eef-2d11-40db-bf1e-e77a40185af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:36.447629 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25273eef-2d11-40db-bf1e-e77a40185af2 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:36.447921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25273eef-2d11-40db-bf1e-e77a40185af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:36.448198 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25273eef-2d11-40db-bf1e-e77a40185af2 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:36.449129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25273eef-2d11-40db-bf1e-e77a40185af2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:36.451111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25273eef-2d11-40db-bf1e-e77a40185af2 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:36.467075 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5d095-74e9-4802-a67e-ce0d263dbc5a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:36.468968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-75d5d095-74e9-4802-a67e-ce0d263dbc5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:36.488566 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5d095-74e9-4802-a67e-ce0d263dbc5a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:36.493630 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe911ab7-bb98-44ba-84ee-4d0fcb2d0bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:36.495194 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe911ab7-bb98-44ba-84ee-4d0fcb2d0bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:36.495480 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe911ab7-bb98-44ba-84ee-4d0fcb2d0bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:36.495757 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe911ab7-bb98-44ba-84ee-4d0fcb2d0bc2 admin admin] PATH_INFO: `/v3/projects/3d1d1483894f457f9ef8d3731925fb4b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:36.497035 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe911ab7-bb98-44ba-84ee-4d0fcb2d0bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d1d1483894f457f9ef8d3731925fb4b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:36.498971 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe911ab7-bb98-44ba-84ee-4d0fcb2d0bc2 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:36.581208 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:36.589087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1129/2224] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:36 2022] POST /identity/v3/users => generated 295 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:36.589087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25273eef-2d11-40db-bf1e-e77a40185af2 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:36.593718 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-25273eef-2d11-40db-bf1e-e77a40185af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:36.612827 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25273eef-2d11-40db-bf1e-e77a40185af2 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:36.618677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55885d-f555-4aae-aa1a-080d8dfa4605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:36.619566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55885d-f555-4aae-aa1a-080d8dfa4605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:36.619837 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55885d-f555-4aae-aa1a-080d8dfa4605 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:36.620343 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55885d-f555-4aae-aa1a-080d8dfa4605 admin admin] PATH_INFO: `/v3/projects/9098aadd4b2d454d8ab88d2a1deec3dd` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:36.621451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55885d-f555-4aae-aa1a-080d8dfa4605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9098aadd4b2d454d8ab88d2a1deec3dd)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:36.623410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55885d-f555-4aae-aa1a-080d8dfa4605 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:36.690711 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fe911ab7-bb98-44ba-84ee-4d0fcb2d0bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d1d1483894f457f9ef8d3731925fb4b', 'request_id': 'req-fe911ab7-bb98-44ba-84ee-4d0fcb2d0bc2'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:36.697856 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fe911ab7-bb98-44ba-84ee-4d0fcb2d0bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d1d1483894f457f9ef8d3731925fb4b', 'request_id': 'req-fe911ab7-bb98-44ba-84ee-4d0fcb2d0bc2'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:36.705775 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fe911ab7-bb98-44ba-84ee-4d0fcb2d0bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d1d1483894f457f9ef8d3731925fb4b', 'request_id': 'req-fe911ab7-bb98-44ba-84ee-4d0fcb2d0bc2'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:36.744567 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-5d55885d-f555-4aae-aa1a-080d8dfa4605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9098aadd4b2d454d8ab88d2a1deec3dd', 'request_id': 'req-5d55885d-f555-4aae-aa1a-080d8dfa4605'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:36.815846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fe911ab7-bb98-44ba-84ee-4d0fcb2d0bc2 admin admin] The token cache is being invalidate because project 3d1d1483894f457f9ef8d3731925fb4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:36.816215 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fe911ab7-bb98-44ba-84ee-4d0fcb2d0bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:36.816975 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-fe911ab7-bb98-44ba-84ee-4d0fcb2d0bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:36.819785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1096/2225] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:36 2022] DELETE /identity/v3/projects/3d1d1483894f457f9ef8d3731925fb4b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:36.819785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe911ab7-bb98-44ba-84ee-4d0fcb2d0bc2 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:36.820970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fe911ab7-bb98-44ba-84ee-4d0fcb2d0bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:36.863390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-5d55885d-f555-4aae-aa1a-080d8dfa4605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9098aadd4b2d454d8ab88d2a1deec3dd', 'request_id': 'req-5d55885d-f555-4aae-aa1a-080d8dfa4605'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:36.872767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-5d55885d-f555-4aae-aa1a-080d8dfa4605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9098aadd4b2d454d8ab88d2a1deec3dd', 'request_id': 'req-5d55885d-f555-4aae-aa1a-080d8dfa4605'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:36.883505 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-5d55885d-f555-4aae-aa1a-080d8dfa4605 admin admin] The token cache is being invalidate because project 9098aadd4b2d454d8ab88d2a1deec3dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:36.883800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-5d55885d-f555-4aae-aa1a-080d8dfa4605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:36.883934 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe911ab7-bb98-44ba-84ee-4d0fcb2d0bc2 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:36.884514 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-5d55885d-f555-4aae-aa1a-080d8dfa4605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:36.886193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1130/2226] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:36 2022] DELETE /identity/v3/projects/9098aadd4b2d454d8ab88d2a1deec3dd => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:36.887039 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55885d-f555-4aae-aa1a-080d8dfa4605 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:36.888366 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5d55885d-f555-4aae-aa1a-080d8dfa4605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:36.962321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24250b88-c71d-42e2-8eea-0241ec58f2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:36.962321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24250b88-c71d-42e2-8eea-0241ec58f2bd admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:36.962321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24250b88-c71d-42e2-8eea-0241ec58f2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:36.962321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24250b88-c71d-42e2-8eea-0241ec58f2bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:36.963253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24250b88-c71d-42e2-8eea-0241ec58f2bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:36.963253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24250b88-c71d-42e2-8eea-0241ec58f2bd admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:36.970258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55885d-f555-4aae-aa1a-080d8dfa4605 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:36.973975 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1097/2227] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:36.974840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24250b88-c71d-42e2-8eea-0241ec58f2bd admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:36.976967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-24250b88-c71d-42e2-8eea-0241ec58f2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:36.978799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab942d5-fb0c-4934-bf99-ff57e834b11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:36.979997 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab942d5-fb0c-4934-bf99-ff57e834b11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:36.980418 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab942d5-fb0c-4934-bf99-ff57e834b11b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:36.980791 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab942d5-fb0c-4934-bf99-ff57e834b11b admin admin] PATH_INFO: `/v3/users/f49af68d025b4440863998c6ecb5f6d3` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:36.982449 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab942d5-fb0c-4934-bf99-ff57e834b11b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f49af68d025b4440863998c6ecb5f6d3)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:36.986129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab942d5-fb0c-4934-bf99-ff57e834b11b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:36.990903 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24250b88-c71d-42e2-8eea-0241ec58f2bd admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:36.996213 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e251f-7bc5-4b86-806f-39bc9c7799c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:36.997414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e251f-7bc5-4b86-806f-39bc9c7799c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:36.997843 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e251f-7bc5-4b86-806f-39bc9c7799c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:36.998350 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e251f-7bc5-4b86-806f-39bc9c7799c5 admin admin] PATH_INFO: `/v3/users/d908438daeba46889e2a6d309ddf46fd` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:37.000075 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e251f-7bc5-4b86-806f-39bc9c7799c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d908438daeba46889e2a6d309ddf46fd)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:37.004755 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e251f-7bc5-4b86-806f-39bc9c7799c5 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:37.180406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-bab942d5-fb0c-4934-bf99-ff57e834b11b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f49af68d025b4440863998c6ecb5f6d3'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:37.182292 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-bab942d5-fb0c-4934-bf99-ff57e834b11b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f49af68d025b4440863998c6ecb5f6d3'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:37.202642 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-442e251f-7bc5-4b86-806f-39bc9c7799c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd908438daeba46889e2a6d309ddf46fd'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:37.203232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-442e251f-7bc5-4b86-806f-39bc9c7799c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd908438daeba46889e2a6d309ddf46fd'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:37.267231 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-bab942d5-fb0c-4934-bf99-ff57e834b11b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f49af68d025b4440863998c6ecb5f6d3'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:37.274909 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-bab942d5-fb0c-4934-bf99-ff57e834b11b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f49af68d025b4440863998c6ecb5f6d3'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:37.276132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-bab942d5-fb0c-4934-bf99-ff57e834b11b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f49af68d025b4440863998c6ecb5f6d3'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:37.293140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1131/2228] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:36 2022] DELETE /identity/v3/users/f49af68d025b4440863998c6ecb5f6d3 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:37.294054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab942d5-fb0c-4934-bf99-ff57e834b11b admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:37.295406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-bab942d5-fb0c-4934-bf99-ff57e834b11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:37.365100 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-442e251f-7bc5-4b86-806f-39bc9c7799c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd908438daeba46889e2a6d309ddf46fd'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:37.365340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab942d5-fb0c-4934-bf99-ff57e834b11b admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:37.370930 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cd2d6-d427-4fad-9a4e-0966703394e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:37.371832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cd2d6-d427-4fad-9a4e-0966703394e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:37.372418 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cd2d6-d427-4fad-9a4e-0966703394e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:37.372418 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cd2d6-d427-4fad-9a4e-0966703394e0 admin admin] PATH_INFO: `/v3/projects/889ec5e473d040c081b8149c5eab5b10/users/6afb7d6aa3e94137ab84ec2546020370/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:37.374782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-442e251f-7bc5-4b86-806f-39bc9c7799c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd908438daeba46889e2a6d309ddf46fd'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:37.401137 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cd2d6-d427-4fad-9a4e-0966703394e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=889ec5e473d040c081b8149c5eab5b10, user_id=6afb7d6aa3e94137ab84ec2546020370, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:37.401783 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-442e251f-7bc5-4b86-806f-39bc9c7799c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd908438daeba46889e2a6d309ddf46fd'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:37.406420 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cd2d6-d427-4fad-9a4e-0966703394e0 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:37.412138 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1098/2229] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:36 2022] DELETE /identity/v3/users/d908438daeba46889e2a6d309ddf46fd => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:37.540371 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1132/2230] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:37 2022] PUT /identity/v3/projects/889ec5e473d040c081b8149c5eab5b10/users/6afb7d6aa3e94137ab84ec2546020370/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:37.544308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e251f-7bc5-4b86-806f-39bc9c7799c5 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:37.545837 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-442e251f-7bc5-4b86-806f-39bc9c7799c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:37.611788 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e251f-7bc5-4b86-806f-39bc9c7799c5 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:37.677366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6ea5a-17e1-4792-92bf-385780743f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:37.678085 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6ea5a-17e1-4792-92bf-385780743f73 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:37.678372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6ea5a-17e1-4792-92bf-385780743f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:37.678932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6ea5a-17e1-4792-92bf-385780743f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:37.680133 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6ea5a-17e1-4792-92bf-385780743f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:37.682311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6ea5a-17e1-4792-92bf-385780743f73 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:37.696465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1099/2231] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:37.699552 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cd2d6-d427-4fad-9a4e-0966703394e0 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:37.712095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cd2d6-d427-4fad-9a4e-0966703394e0 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:37.719496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733e110-1c44-461b-b738-8e4bc5e45d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:37.720640 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733e110-1c44-461b-b738-8e4bc5e45d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:37.720978 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733e110-1c44-461b-b738-8e4bc5e45d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:37.721256 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733e110-1c44-461b-b738-8e4bc5e45d44 admin admin] PATH_INFO: `/v3/projects/889ec5e473d040c081b8149c5eab5b10/users/6afb7d6aa3e94137ab84ec2546020370/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:37.725182 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733e110-1c44-461b-b738-8e4bc5e45d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=889ec5e473d040c081b8149c5eab5b10, user_id=6afb7d6aa3e94137ab84ec2546020370, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:37.728003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733e110-1c44-461b-b738-8e4bc5e45d44 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:37.741240 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1133/2232] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:37 2022] PUT /identity/v3/projects/889ec5e473d040c081b8149c5eab5b10/users/6afb7d6aa3e94137ab84ec2546020370/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:37.753433 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a53318-a32b-4382-9175-51105ac9d081 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:37.755218 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a53318-a32b-4382-9175-51105ac9d081 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:37.755218 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a53318-a32b-4382-9175-51105ac9d081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:37.790042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-20a53318-a32b-4382-9175-51105ac9d081 None None] MFA Rules not processed for user `6afb7d6aa3e94137ab84ec2546020370`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:37.790042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-20a53318-a32b-4382-9175-51105ac9d081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:37.870413 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1100/2233] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:37.882110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733e110-1c44-461b-b738-8e4bc5e45d44 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:37.884210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5733e110-1c44-461b-b738-8e4bc5e45d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:37.908867 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a53318-a32b-4382-9175-51105ac9d081 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:37.910283 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-20a53318-a32b-4382-9175-51105ac9d081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:37.953527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733e110-1c44-461b-b738-8e4bc5e45d44 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:37.957214 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa6cfd-e955-4e64-b2b4-acb8fb35ddd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:37.957918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa6cfd-e955-4e64-b2b4-acb8fb35ddd5 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:37.958199 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa6cfd-e955-4e64-b2b4-acb8fb35ddd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:37.958473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa6cfd-e955-4e64-b2b4-acb8fb35ddd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:37.960307 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-11aa6cfd-e955-4e64-b2b4-acb8fb35ddd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:37.996423 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a53318-a32b-4382-9175-51105ac9d081 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:38.001386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa5ee3-3465-4e75-86b8-f265b1c98ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:38.002261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa5ee3-3465-4e75-86b8-f265b1c98ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:38.002548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa5ee3-3465-4e75-86b8-f265b1c98ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:38.002830 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa5ee3-3465-4e75-86b8-f265b1c98ff1 admin admin] PATH_INFO: `/v3/projects/3f4eb4726c364f0da5d820dcc3e79baa` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:38.004041 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa5ee3-3465-4e75-86b8-f265b1c98ff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f4eb4726c364f0da5d820dcc3e79baa)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:38.006094 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa5ee3-3465-4e75-86b8-f265b1c98ff1 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:38.029113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa6cfd-e955-4e64-b2b4-acb8fb35ddd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:38.030601 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa6cfd-e955-4e64-b2b4-acb8fb35ddd5 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:38.040560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1134/2234] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:38.116759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa6cfd-e955-4e64-b2b4-acb8fb35ddd5 service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:38.117552 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-11aa6cfd-e955-4e64-b2b4-acb8fb35ddd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:38.132190 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa6cfd-e955-4e64-b2b4-acb8fb35ddd5 service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:38.145758 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35166e-1fa7-46cd-a916-a34979165ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:38.146999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35166e-1fa7-46cd-a916-a34979165ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:38.147234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35166e-1fa7-46cd-a916-a34979165ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:38.147516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35166e-1fa7-46cd-a916-a34979165ec2 admin admin] PATH_INFO: `/v3/projects/fab3a408d91843ff85cde0f03ddc064e` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:38.148816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35166e-1fa7-46cd-a916-a34979165ec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fab3a408d91843ff85cde0f03ddc064e)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:38.151291 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35166e-1fa7-46cd-a916-a34979165ec2 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:38.172064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5bfa5ee3-3465-4e75-86b8-f265b1c98ff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4eb4726c364f0da5d820dcc3e79baa', 'request_id': 'req-5bfa5ee3-3465-4e75-86b8-f265b1c98ff1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:38.180104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5bfa5ee3-3465-4e75-86b8-f265b1c98ff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4eb4726c364f0da5d820dcc3e79baa', 'request_id': 'req-5bfa5ee3-3465-4e75-86b8-f265b1c98ff1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:38.188657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5bfa5ee3-3465-4e75-86b8-f265b1c98ff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4eb4726c364f0da5d820dcc3e79baa', 'request_id': 'req-5bfa5ee3-3465-4e75-86b8-f265b1c98ff1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:38.302153 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5bfa5ee3-3465-4e75-86b8-f265b1c98ff1 admin admin] The token cache is being invalidate because project 3f4eb4726c364f0da5d820dcc3e79baa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:38.302780 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5bfa5ee3-3465-4e75-86b8-f265b1c98ff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:38.304094 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5bfa5ee3-3465-4e75-86b8-f265b1c98ff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:38.308190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1101/2235] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:37 2022] DELETE /identity/v3/projects/3f4eb4726c364f0da5d820dcc3e79baa => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:38.312277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ed35166e-1fa7-46cd-a916-a34979165ec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fab3a408d91843ff85cde0f03ddc064e', 'request_id': 'req-ed35166e-1fa7-46cd-a916-a34979165ec2'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:38.312793 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b340e7-b77e-4267-a28b-79fdfdfae1b7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:38.313072 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b340e7-b77e-4267-a28b-79fdfdfae1b7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:38.313369 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b340e7-b77e-4267-a28b-79fdfdfae1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:38.332731 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c8b340e7-b77e-4267-a28b-79fdfdfae1b7 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:38.334975 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c8b340e7-b77e-4267-a28b-79fdfdfae1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:38.396552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1102/2236] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:58:38.401806 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:38.404427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9954e-3410-4f1d-81bd-654147920307 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:38.405804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9954e-3410-4f1d-81bd-654147920307 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:38.405804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9954e-3410-4f1d-81bd-654147920307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:38.406113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ed35166e-1fa7-46cd-a916-a34979165ec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fab3a408d91843ff85cde0f03ddc064e', 'request_id': 'req-ed35166e-1fa7-46cd-a916-a34979165ec2'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:38.416980 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ed35166e-1fa7-46cd-a916-a34979165ec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fab3a408d91843ff85cde0f03ddc064e', 'request_id': 'req-ed35166e-1fa7-46cd-a916-a34979165ec2'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:38.434040 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-96f9954e-3410-4f1d-81bd-654147920307 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:38.435284 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-96f9954e-3410-4f1d-81bd-654147920307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:38.442750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ed35166e-1fa7-46cd-a916-a34979165ec2 admin admin] The token cache is being invalidate because project fab3a408d91843ff85cde0f03ddc064e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:38.443253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ed35166e-1fa7-46cd-a916-a34979165ec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:38.445261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ed35166e-1fa7-46cd-a916-a34979165ec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:38.448207 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1135/2237] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:38 2022] DELETE /identity/v3/projects/fab3a408d91843ff85cde0f03ddc064e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:38.454702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1103/2238] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:58:38.455754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6e80f-21fb-4ae7-954f-7237dbfe02f0 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:38.456915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6e80f-21fb-4ae7-954f-7237dbfe02f0 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:38.457588 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6e80f-21fb-4ae7-954f-7237dbfe02f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:38.458710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9954e-3410-4f1d-81bd-654147920307 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:38.468691 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9954e-3410-4f1d-81bd-654147920307 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:38.475434 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfcbe6-affe-4600-94dd-7ab29f57b8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:38.476138 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfcbe6-affe-4600-94dd-7ab29f57b8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:38.476464 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfcbe6-affe-4600-94dd-7ab29f57b8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:38.476749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfcbe6-affe-4600-94dd-7ab29f57b8a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:38.477538 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfcbe6-affe-4600-94dd-7ab29f57b8a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:58:38.477849 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfcbe6-affe-4600-94dd-7ab29f57b8a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:38.480019 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfcbe6-affe-4600-94dd-7ab29f57b8a1 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:38.489080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-ffc6e80f-21fb-4ae7-954f-7237dbfe02f0 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:38.490876 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-ffc6e80f-21fb-4ae7-954f-7237dbfe02f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:38.497877 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1104/2239] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:58:38.498767 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfcbe6-affe-4600-94dd-7ab29f57b8a1 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:38.500860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-93dfcbe6-affe-4600-94dd-7ab29f57b8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:38.507669 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1136/2240] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:38.515561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfcbe6-affe-4600-94dd-7ab29f57b8a1 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:38.517274 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c80fb5-3142-4356-b631-31bc820616ed None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:38.517735 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c80fb5-3142-4356-b631-31bc820616ed None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:38.518052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c80fb5-3142-4356-b631-31bc820616ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:38.533873 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305243ee-eb14-482f-b522-6ca3ee891387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:38.536340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305243ee-eb14-482f-b522-6ca3ee891387 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:38.538776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305243ee-eb14-482f-b522-6ca3ee891387 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:38.545865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305243ee-eb14-482f-b522-6ca3ee891387 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:38.552477 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-51c80fb5-3142-4356-b631-31bc820616ed None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:38.555607 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305243ee-eb14-482f-b522-6ca3ee891387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:38.556685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-51c80fb5-3142-4356-b631-31bc820616ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:38.561423 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305243ee-eb14-482f-b522-6ca3ee891387 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:38.571627 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1137/2241] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:38.578119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c80fb5-3142-4356-b631-31bc820616ed None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:38.589843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c80fb5-3142-4356-b631-31bc820616ed None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:38.596480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480c104-0b87-4946-b87a-ca6e0726144d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:38.597084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480c104-0b87-4946-b87a-ca6e0726144d admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:38.597370 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480c104-0b87-4946-b87a-ca6e0726144d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:38.597647 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480c104-0b87-4946-b87a-ca6e0726144d admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:38.598375 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480c104-0b87-4946-b87a-ca6e0726144d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:58:38.598682 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480c104-0b87-4946-b87a-ca6e0726144d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:38.600330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480c104-0b87-4946-b87a-ca6e0726144d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:38.618327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1138/2242] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:58:38.622831 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480c104-0b87-4946-b87a-ca6e0726144d admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:38.634293 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480c104-0b87-4946-b87a-ca6e0726144d admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:38.643676 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c39c5-9443-4d25-9d35-81ce8fe0b103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:38.643676 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c39c5-9443-4d25-9d35-81ce8fe0b103 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:38.643676 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c39c5-9443-4d25-9d35-81ce8fe0b103 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:38.643676 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c39c5-9443-4d25-9d35-81ce8fe0b103 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:38.643989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c39c5-9443-4d25-9d35-81ce8fe0b103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:38.644399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c39c5-9443-4d25-9d35-81ce8fe0b103 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:38.683641 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1105/2243] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:38 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:38.688006 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305243ee-eb14-482f-b522-6ca3ee891387 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:38.755281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1139/2244] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:38 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:58:38.760528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c39c5-9443-4d25-9d35-81ce8fe0b103 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:38.783537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305243ee-eb14-482f-b522-6ca3ee891387 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:38.907928 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7f098-96ff-460a-b8f1-8003f64cca1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:38.909796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7f098-96ff-460a-b8f1-8003f64cca1a admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:38.909930 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7f098-96ff-460a-b8f1-8003f64cca1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:38.910208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7f098-96ff-460a-b8f1-8003f64cca1a admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:38.911008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7f098-96ff-460a-b8f1-8003f64cca1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:38.913417 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7f098-96ff-460a-b8f1-8003f64cca1a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:38.917913 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c39c5-9443-4d25-9d35-81ce8fe0b103 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:38.926126 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7d8d4-2035-4039-8c07-e0d97acb3d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:38.926126 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7d8d4-2035-4039-8c07-e0d97acb3d3b admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:38.926126 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7d8d4-2035-4039-8c07-e0d97acb3d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:38.926126 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7d8d4-2035-4039-8c07-e0d97acb3d3b admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:38.926549 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7d8d4-2035-4039-8c07-e0d97acb3d3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:38.927634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7d8d4-2035-4039-8c07-e0d97acb3d3b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:38.984281 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:39.030164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1106/2245] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:38 2022] POST /identity/v3/users => generated 293 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:39.032310 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1140/2246] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:38 2022] POST /identity/v3/users => generated 290 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:39.033668 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7f098-96ff-460a-b8f1-8003f64cca1a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:39.036163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7d8d4-2035-4039-8c07-e0d97acb3d3b admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:39.048143 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7d8d4-2035-4039-8c07-e0d97acb3d3b admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:39.048906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7f098-96ff-460a-b8f1-8003f64cca1a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:39.054585 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129fca4-71c0-4ba6-ba84-344848dae8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:39.054774 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba794c57-fb34-47e7-9fa8-72a8188de473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:39.055271 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba794c57-fb34-47e7-9fa8-72a8188de473 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:39.055561 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba794c57-fb34-47e7-9fa8-72a8188de473 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:39.055843 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba794c57-fb34-47e7-9fa8-72a8188de473 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:39.056994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129fca4-71c0-4ba6-ba84-344848dae8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:39.057215 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba794c57-fb34-47e7-9fa8-72a8188de473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:39.057682 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129fca4-71c0-4ba6-ba84-344848dae8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:39.058152 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129fca4-71c0-4ba6-ba84-344848dae8f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:39.058834 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba794c57-fb34-47e7-9fa8-72a8188de473 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:39.059799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129fca4-71c0-4ba6-ba84-344848dae8f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:39.062390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129fca4-71c0-4ba6-ba84-344848dae8f5 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:39.073809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1107/2247] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:39.074738 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba794c57-fb34-47e7-9fa8-72a8188de473 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:39.076741 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ba794c57-fb34-47e7-9fa8-72a8188de473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:39.080388 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1141/2248] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:39.080388 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129fca4-71c0-4ba6-ba84-344848dae8f5 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:39.095893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129fca4-71c0-4ba6-ba84-344848dae8f5 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:39.103293 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2fb58-5670-4ea8-9fa5-3a4ec4091516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:39.104575 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2fb58-5670-4ea8-9fa5-3a4ec4091516 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:39.104941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2fb58-5670-4ea8-9fa5-3a4ec4091516 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:39.106198 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2fb58-5670-4ea8-9fa5-3a4ec4091516 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:39.106856 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2fb58-5670-4ea8-9fa5-3a4ec4091516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:39.108383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2fb58-5670-4ea8-9fa5-3a4ec4091516 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:39.120578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1142/2249] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:39.121682 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2fb58-5670-4ea8-9fa5-3a4ec4091516 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:39.131462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2fb58-5670-4ea8-9fa5-3a4ec4091516 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:39.137139 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346e110-60fd-4a1a-b1f4-b591b0652646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:39.137803 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346e110-60fd-4a1a-b1f4-b591b0652646 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:39.138092 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346e110-60fd-4a1a-b1f4-b591b0652646 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:39.138375 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346e110-60fd-4a1a-b1f4-b591b0652646 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:39.139105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346e110-60fd-4a1a-b1f4-b591b0652646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:39.140769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346e110-60fd-4a1a-b1f4-b591b0652646 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:39.150416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba794c57-fb34-47e7-9fa8-72a8188de473 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:39.159089 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1143/2250] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:39.159089 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346e110-60fd-4a1a-b1f4-b591b0652646 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:39.159530 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c48cfa-326b-438b-ab0f-2134867dccb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:39.160280 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c48cfa-326b-438b-ab0f-2134867dccb0 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:39.160715 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c48cfa-326b-438b-ab0f-2134867dccb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:39.161183 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c48cfa-326b-438b-ab0f-2134867dccb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:39.163260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a6c48cfa-326b-438b-ab0f-2134867dccb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:39.171058 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346e110-60fd-4a1a-b1f4-b591b0652646 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:39.178008 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac6510-aabe-4f59-96c0-c03d105f12b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:39.179011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac6510-aabe-4f59-96c0-c03d105f12b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:39.179308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac6510-aabe-4f59-96c0-c03d105f12b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:39.179788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac6510-aabe-4f59-96c0-c03d105f12b7 admin admin] PATH_INFO: `/v3/projects/a0e4eeeec5aa4195ae6e43d5c267c45a/users/6d19ae3b2fb84342b522b2b9dd3f9a91/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:39.196798 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac6510-aabe-4f59-96c0-c03d105f12b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e4eeeec5aa4195ae6e43d5c267c45a, user_id=6d19ae3b2fb84342b522b2b9dd3f9a91, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:39.199551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac6510-aabe-4f59-96c0-c03d105f12b7 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:39.232855 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c48cfa-326b-438b-ab0f-2134867dccb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:39.234377 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c48cfa-326b-438b-ab0f-2134867dccb0 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:39.246145 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1108/2251] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:39.246949 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c48cfa-326b-438b-ab0f-2134867dccb0 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:39.272223 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c48cfa-326b-438b-ab0f-2134867dccb0 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:39.276846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1144/2252] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:39 2022] PUT /identity/v3/projects/a0e4eeeec5aa4195ae6e43d5c267c45a/users/6d19ae3b2fb84342b522b2b9dd3f9a91/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:39.288248 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45400adb-b407-410e-95b7-8403872e3085 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:39.288602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45400adb-b407-410e-95b7-8403872e3085 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:39.289180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45400adb-b407-410e-95b7-8403872e3085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:39.324177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-45400adb-b407-410e-95b7-8403872e3085 None None] MFA Rules not processed for user `6d19ae3b2fb84342b522b2b9dd3f9a91`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:39.325501 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-45400adb-b407-410e-95b7-8403872e3085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:39.351404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961f501-d8bb-44e8-9c0f-a4e08b989635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:39.352330 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961f501-d8bb-44e8-9c0f-a4e08b989635 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:39.352657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961f501-d8bb-44e8-9c0f-a4e08b989635 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:39.352943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961f501-d8bb-44e8-9c0f-a4e08b989635 admin admin] PATH_INFO: `/v3/projects/036268b2a1d84ca68e16da79e02c895b/users/3edaaac81aaf4fdda7679456294daf06/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:39.375783 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961f501-d8bb-44e8-9c0f-a4e08b989635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=036268b2a1d84ca68e16da79e02c895b, user_id=3edaaac81aaf4fdda7679456294daf06, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:39.381972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961f501-d8bb-44e8-9c0f-a4e08b989635 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:39.403510 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1145/2253] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:58:39.411783 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45400adb-b407-410e-95b7-8403872e3085 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:39.440924 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45400adb-b407-410e-95b7-8403872e3085 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:39.456232 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dacb35-f985-4e28-8b7f-26d68119e0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:39.456232 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dacb35-f985-4e28-8b7f-26d68119e0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:39.456232 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dacb35-f985-4e28-8b7f-26d68119e0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:39.456232 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dacb35-f985-4e28-8b7f-26d68119e0c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:39.456941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dacb35-f985-4e28-8b7f-26d68119e0c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:39.456941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dacb35-f985-4e28-8b7f-26d68119e0c5 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:39.520049 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1109/2254] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:39 2022] PUT /identity/v3/projects/036268b2a1d84ca68e16da79e02c895b/users/3edaaac81aaf4fdda7679456294daf06/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:39.521684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9de40-1b2b-43da-93e2-935d4a678204 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:39.521982 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9de40-1b2b-43da-93e2-935d4a678204 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:39.522263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9de40-1b2b-43da-93e2-935d4a678204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:39.550570 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-65d9de40-1b2b-43da-93e2-935d4a678204 None None] MFA Rules not processed for user `3edaaac81aaf4fdda7679456294daf06`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:39.551865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-65d9de40-1b2b-43da-93e2-935d4a678204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:39.601982 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1146/2255] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:39 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:58:39.607161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dacb35-f985-4e28-8b7f-26d68119e0c5 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:39.625988 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1110/2256] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:39.631609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9de40-1b2b-43da-93e2-935d4a678204 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:39.683389 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dacb35-f985-4e28-8b7f-26d68119e0c5 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:39.688398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da4c0e-6a6b-4715-a959-7e865ffa08b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:39.689234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da4c0e-6a6b-4715-a959-7e865ffa08b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:39.689610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da4c0e-6a6b-4715-a959-7e865ffa08b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:39.689892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da4c0e-6a6b-4715-a959-7e865ffa08b9 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:39.690585 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da4c0e-6a6b-4715-a959-7e865ffa08b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:39.692526 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da4c0e-6a6b-4715-a959-7e865ffa08b9 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:39.706414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9de40-1b2b-43da-93e2-935d4a678204 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:39.713376 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a3d75-cf28-41c1-9869-cc5e844bee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:39.714122 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a3d75-cf28-41c1-9869-cc5e844bee33 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:39.714410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a3d75-cf28-41c1-9869-cc5e844bee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:39.714692 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a3d75-cf28-41c1-9869-cc5e844bee33 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:39.715408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a3d75-cf28-41c1-9869-cc5e844bee33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:39.717390 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a3d75-cf28-41c1-9869-cc5e844bee33 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:39.819390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1147/2257] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:39 2022] POST /identity/v3/users => generated 299 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:39.823730 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da4c0e-6a6b-4715-a959-7e865ffa08b9 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:39.833733 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da4c0e-6a6b-4715-a959-7e865ffa08b9 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:39.839371 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027120cb-5f3b-402c-a0e5-f08b337d39b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:39.840070 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027120cb-5f3b-402c-a0e5-f08b337d39b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:39.840397 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027120cb-5f3b-402c-a0e5-f08b337d39b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:39.840703 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027120cb-5f3b-402c-a0e5-f08b337d39b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:39.841434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027120cb-5f3b-402c-a0e5-f08b337d39b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:39.843060 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027120cb-5f3b-402c-a0e5-f08b337d39b3 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:39.853988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1148/2258] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:58:39.858108 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027120cb-5f3b-402c-a0e5-f08b337d39b3 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:39.868089 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027120cb-5f3b-402c-a0e5-f08b337d39b3 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:39.872865 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90fb96-2156-41f7-9f77-5ad600673880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:39.874451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90fb96-2156-41f7-9f77-5ad600673880 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:39.874451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90fb96-2156-41f7-9f77-5ad600673880 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:39.874451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90fb96-2156-41f7-9f77-5ad600673880 admin admin] PATH_INFO: `/v3/projects/3cbc023b2d8748c5b495e6ae4874fc92/users/884b095427ac44e29a870dfacb451885/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:39.889829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90fb96-2156-41f7-9f77-5ad600673880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cbc023b2d8748c5b495e6ae4874fc92, user_id=884b095427ac44e29a870dfacb451885, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:39.892507 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90fb96-2156-41f7-9f77-5ad600673880 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:39.955761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1111/2259] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:39 2022] POST /identity/v3/projects => generated 381 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:58:39.956783 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a3d75-cf28-41c1-9869-cc5e844bee33 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:39.996639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1149/2260] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:39 2022] PUT /identity/v3/projects/3cbc023b2d8748c5b495e6ae4874fc92/users/884b095427ac44e29a870dfacb451885/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:40.012105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90fb96-2156-41f7-9f77-5ad600673880 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:40.055985 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a3d75-cf28-41c1-9869-cc5e844bee33 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:40.126192 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90fb96-2156-41f7-9f77-5ad600673880 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:40.138199 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb95f5c-b787-436c-ae1a-9478f0a7be9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:40.138894 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb95f5c-b787-436c-ae1a-9478f0a7be9c admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:40.139175 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb95f5c-b787-436c-ae1a-9478f0a7be9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:40.139618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb95f5c-b787-436c-ae1a-9478f0a7be9c admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:40.140466 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb95f5c-b787-436c-ae1a-9478f0a7be9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:40.144189 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb95f5c-b787-436c-ae1a-9478f0a7be9c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:40.154927 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1fa99-c5f6-4d58-bd70-094c5dcac3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:40.155713 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1fa99-c5f6-4d58-bd70-094c5dcac3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:40.156584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1fa99-c5f6-4d58-bd70-094c5dcac3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:40.156943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1fa99-c5f6-4d58-bd70-094c5dcac3a6 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:40.158079 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1fa99-c5f6-4d58-bd70-094c5dcac3a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:40.160592 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1fa99-c5f6-4d58-bd70-094c5dcac3a6 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:40.164583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1150/2261] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:40.165630 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb95f5c-b787-436c-ae1a-9478f0a7be9c admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:40.176844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb95f5c-b787-436c-ae1a-9478f0a7be9c admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:40.182144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24936e-afba-4544-aaa7-046f15fe4a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:40.183095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24936e-afba-4544-aaa7-046f15fe4a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:40.183386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24936e-afba-4544-aaa7-046f15fe4a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:40.183670 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24936e-afba-4544-aaa7-046f15fe4a7b admin admin] PATH_INFO: `/v3/projects/3cbc023b2d8748c5b495e6ae4874fc92/users/884b095427ac44e29a870dfacb451885/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:40.193936 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24936e-afba-4544-aaa7-046f15fe4a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cbc023b2d8748c5b495e6ae4874fc92, user_id=884b095427ac44e29a870dfacb451885, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:40.193936 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24936e-afba-4544-aaa7-046f15fe4a7b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:40.208254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1151/2262] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:40 2022] PUT /identity/v3/projects/3cbc023b2d8748c5b495e6ae4874fc92/users/884b095427ac44e29a870dfacb451885/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:40.219600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d0347-4886-4ca8-9bf2-d86ccf9e91cc None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:40.219913 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d0347-4886-4ca8-9bf2-d86ccf9e91cc None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:40.220199 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d0347-4886-4ca8-9bf2-d86ccf9e91cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:40.250054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-a04d0347-4886-4ca8-9bf2-d86ccf9e91cc None None] MFA Rules not processed for user `884b095427ac44e29a870dfacb451885`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:40.251419 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-a04d0347-4886-4ca8-9bf2-d86ccf9e91cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:40.305609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1112/2263] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:39 2022] POST /identity/v3/users => generated 297 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:58:40.310163 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1fa99-c5f6-4d58-bd70-094c5dcac3a6 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:40.320209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1fa99-c5f6-4d58-bd70-094c5dcac3a6 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:40.323719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1152/2264] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:58:40.368079 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d0347-4886-4ca8-9bf2-d86ccf9e91cc None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:40.397931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942c341-c316-4b6e-b9ea-40b61640efc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:40.398705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942c341-c316-4b6e-b9ea-40b61640efc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:40.398998 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942c341-c316-4b6e-b9ea-40b61640efc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:40.399953 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942c341-c316-4b6e-b9ea-40b61640efc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:40.400756 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942c341-c316-4b6e-b9ea-40b61640efc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:40.403842 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942c341-c316-4b6e-b9ea-40b61640efc9 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:40.428725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1113/2265] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:58:40.428725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942c341-c316-4b6e-b9ea-40b61640efc9 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:40.438909 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d0347-4886-4ca8-9bf2-d86ccf9e91cc None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:40.440025 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942c341-c316-4b6e-b9ea-40b61640efc9 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:40.445056 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831da43-adfc-454d-b80a-410827a4cf91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:40.445231 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831da43-adfc-454d-b80a-410827a4cf91 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:40.445494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831da43-adfc-454d-b80a-410827a4cf91 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:40.445714 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831da43-adfc-454d-b80a-410827a4cf91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:40.446137 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ed656-628c-47fc-93cd-8bc753f54a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:40.447613 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ed656-628c-47fc-93cd-8bc753f54a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:40.447898 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ed656-628c-47fc-93cd-8bc753f54a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:40.448175 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ed656-628c-47fc-93cd-8bc753f54a9a admin admin] PATH_INFO: `/v3/projects/dc25398640a94d9ab111dcd8e21149f2/users/3aeed32d7c264676a56316f01a7a7395/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:40.468125 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ed656-628c-47fc-93cd-8bc753f54a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc25398640a94d9ab111dcd8e21149f2, user_id=3aeed32d7c264676a56316f01a7a7395, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:40.470808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ed656-628c-47fc-93cd-8bc753f54a9a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:40.541040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831da43-adfc-454d-b80a-410827a4cf91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:40.542603 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831da43-adfc-454d-b80a-410827a4cf91 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:40.568072 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1153/2266] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:58:40.610986 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1114/2267] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:40 2022] PUT /identity/v3/projects/dc25398640a94d9ab111dcd8e21149f2/users/3aeed32d7c264676a56316f01a7a7395/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:40.612321 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831da43-adfc-454d-b80a-410827a4cf91 service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:40.627733 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ed656-628c-47fc-93cd-8bc753f54a9a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:40.629577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-131ed656-628c-47fc-93cd-8bc753f54a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:40.636173 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831da43-adfc-454d-b80a-410827a4cf91 service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:40.708892 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ed656-628c-47fc-93cd-8bc753f54a9a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:40.713557 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057abd2-4ebc-4748-af23-b4d35dc928e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:40.717516 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057abd2-4ebc-4748-af23-b4d35dc928e4 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:40.717516 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057abd2-4ebc-4748-af23-b4d35dc928e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:40.717516 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057abd2-4ebc-4748-af23-b4d35dc928e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:40.717516 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4057abd2-4ebc-4748-af23-b4d35dc928e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:40.727465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f134f9-a8ea-499f-84e2-a33c1024cf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:40.729157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f134f9-a8ea-499f-84e2-a33c1024cf92 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:40.729889 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f134f9-a8ea-499f-84e2-a33c1024cf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:40.730392 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f134f9-a8ea-499f-84e2-a33c1024cf92 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:40.732273 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f134f9-a8ea-499f-84e2-a33c1024cf92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:40.734971 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f134f9-a8ea-499f-84e2-a33c1024cf92 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:40.752246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1154/2268] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:40.759018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f134f9-a8ea-499f-84e2-a33c1024cf92 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:40.774438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f134f9-a8ea-499f-84e2-a33c1024cf92 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:40.780902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10de8a-4388-4b01-8304-741634d91acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:40.782140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10de8a-4388-4b01-8304-741634d91acf admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:40.782433 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10de8a-4388-4b01-8304-741634d91acf admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:40.782719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10de8a-4388-4b01-8304-741634d91acf admin admin] PATH_INFO: `/v3/projects/dc25398640a94d9ab111dcd8e21149f2/users/3aeed32d7c264676a56316f01a7a7395/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:40.785631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10de8a-4388-4b01-8304-741634d91acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc25398640a94d9ab111dcd8e21149f2, user_id=3aeed32d7c264676a56316f01a7a7395, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:40.790180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10de8a-4388-4b01-8304-741634d91acf admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:40.807673 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1155/2269] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:40 2022] PUT /identity/v3/projects/dc25398640a94d9ab111dcd8e21149f2/users/3aeed32d7c264676a56316f01a7a7395/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:40.821192 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4281e2-7a2c-4768-a810-c50e9eaafc9b None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:40.821486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4281e2-7a2c-4768-a810-c50e9eaafc9b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:40.821849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4281e2-7a2c-4768-a810-c50e9eaafc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:40.831539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057abd2-4ebc-4748-af23-b4d35dc928e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:40.833197 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057abd2-4ebc-4748-af23-b4d35dc928e4 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:40.852205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1115/2270] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:58:40.860627 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-6d4281e2-7a2c-4768-a810-c50e9eaafc9b None None] MFA Rules not processed for user `3aeed32d7c264676a56316f01a7a7395`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:40.861695 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6d4281e2-7a2c-4768-a810-c50e9eaafc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:40.946725 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1156/2271] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:58:41.400612 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057abd2-4ebc-4748-af23-b4d35dc928e4 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:41.415310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057abd2-4ebc-4748-af23-b4d35dc928e4 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:41.476814 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8060b94-5a6a-4cbc-85f2-4321caf40420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:41.477462 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8060b94-5a6a-4cbc-85f2-4321caf40420 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:41.477747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8060b94-5a6a-4cbc-85f2-4321caf40420 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:41.478073 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8060b94-5a6a-4cbc-85f2-4321caf40420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:41.487132 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8060b94-5a6a-4cbc-85f2-4321caf40420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:41.488594 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8060b94-5a6a-4cbc-85f2-4321caf40420 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:41.498100 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1116/2272] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:41.676103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:42.261345 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4281e2-7a2c-4768-a810-c50e9eaafc9b None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:42.332597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4281e2-7a2c-4768-a810-c50e9eaafc9b None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:42.337457 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9be32-2457-4aa4-92ab-af271fdbc719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:42.338331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9be32-2457-4aa4-92ab-af271fdbc719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:42.342561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9be32-2457-4aa4-92ab-af271fdbc719 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:42.342561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9be32-2457-4aa4-92ab-af271fdbc719 admin admin] PATH_INFO: `/v3/users/3edaaac81aaf4fdda7679456294daf06` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:42.342561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9be32-2457-4aa4-92ab-af271fdbc719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3edaaac81aaf4fdda7679456294daf06)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:42.342561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9be32-2457-4aa4-92ab-af271fdbc719 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:42.471761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8060b94-5a6a-4cbc-85f2-4321caf40420 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:42.481736 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8060b94-5a6a-4cbc-85f2-4321caf40420 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:42.485453 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62d734-3548-43fd-93c7-1f9cfd5bcf92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:42.486097 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62d734-3548-43fd-93c7-1f9cfd5bcf92 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:42.486438 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62d734-3548-43fd-93c7-1f9cfd5bcf92 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:42.495862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62d734-3548-43fd-93c7-1f9cfd5bcf92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:42.495862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7e62d734-3548-43fd-93c7-1f9cfd5bcf92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:42.496726 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:42.498270 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-72f9be32-2457-4aa4-92ab-af271fdbc719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3edaaac81aaf4fdda7679456294daf06'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:42.498938 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-72f9be32-2457-4aa4-92ab-af271fdbc719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3edaaac81aaf4fdda7679456294daf06'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:42.555733 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62d734-3548-43fd-93c7-1f9cfd5bcf92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:42.557244 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62d734-3548-43fd-93c7-1f9cfd5bcf92 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:42.567049 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1117/2273] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:58:42.612587 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-72f9be32-2457-4aa4-92ab-af271fdbc719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3edaaac81aaf4fdda7679456294daf06'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:42.620230 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-72f9be32-2457-4aa4-92ab-af271fdbc719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3edaaac81aaf4fdda7679456294daf06'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:42.621090 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-72f9be32-2457-4aa4-92ab-af271fdbc719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3edaaac81aaf4fdda7679456294daf06'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:42.639228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1157/2274] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:42 2022] DELETE /identity/v3/users/3edaaac81aaf4fdda7679456294daf06 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:42.643831 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972450-3544-48de-9b91-6a2e3de4cf98 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:42.644203 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972450-3544-48de-9b91-6a2e3de4cf98 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:42.644602 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972450-3544-48de-9b91-6a2e3de4cf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:42.662790 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d5972450-3544-48de-9b91-6a2e3de4cf98 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:42.663933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d5972450-3544-48de-9b91-6a2e3de4cf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:42.724970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1118/2275] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:58:42.735274 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9be32-2457-4aa4-92ab-af271fdbc719 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:42.736785 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-72f9be32-2457-4aa4-92ab-af271fdbc719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:42.796107 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9be32-2457-4aa4-92ab-af271fdbc719 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:42.807294 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9da43-fecd-4e9a-90ac-99a3e99dff4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:42.807294 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9da43-fecd-4e9a-90ac-99a3e99dff4f service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:42.807294 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9da43-fecd-4e9a-90ac-99a3e99dff4f service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:42.807294 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9da43-fecd-4e9a-90ac-99a3e99dff4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:42.811307 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9da43-fecd-4e9a-90ac-99a3e99dff4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:42.812784 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9da43-fecd-4e9a-90ac-99a3e99dff4f service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:42.823756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1158/2276] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:43.422170 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5972450-3544-48de-9b91-6a2e3de4cf98 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:43.425104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d5972450-3544-48de-9b91-6a2e3de4cf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:43.442639 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5972450-3544-48de-9b91-6a2e3de4cf98 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:43.474072 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650a453-9aaa-4aa5-9f92-05ba399d4ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:43.476733 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650a453-9aaa-4aa5-9f92-05ba399d4ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:43.477497 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650a453-9aaa-4aa5-9f92-05ba399d4ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:43.479143 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650a453-9aaa-4aa5-9f92-05ba399d4ff6 admin admin] PATH_INFO: `/v3/projects/036268b2a1d84ca68e16da79e02c895b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:43.481873 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650a453-9aaa-4aa5-9f92-05ba399d4ff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=036268b2a1d84ca68e16da79e02c895b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:43.485843 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650a453-9aaa-4aa5-9f92-05ba399d4ff6 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:43.691858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4650a453-9aaa-4aa5-9f92-05ba399d4ff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '036268b2a1d84ca68e16da79e02c895b', 'request_id': 'req-4650a453-9aaa-4aa5-9f92-05ba399d4ff6'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:43.699614 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4650a453-9aaa-4aa5-9f92-05ba399d4ff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '036268b2a1d84ca68e16da79e02c895b', 'request_id': 'req-4650a453-9aaa-4aa5-9f92-05ba399d4ff6'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:43.707202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4650a453-9aaa-4aa5-9f92-05ba399d4ff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '036268b2a1d84ca68e16da79e02c895b', 'request_id': 'req-4650a453-9aaa-4aa5-9f92-05ba399d4ff6'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:43.815796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4650a453-9aaa-4aa5-9f92-05ba399d4ff6 admin admin] The token cache is being invalidate because project 036268b2a1d84ca68e16da79e02c895b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:43.821388 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4650a453-9aaa-4aa5-9f92-05ba399d4ff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:43.821388 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-4650a453-9aaa-4aa5-9f92-05ba399d4ff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:43.821388 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1119/2277] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:43 2022] DELETE /identity/v3/projects/036268b2a1d84ca68e16da79e02c895b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:43.823115 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9da43-fecd-4e9a-90ac-99a3e99dff4f service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:43.833456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9da43-fecd-4e9a-90ac-99a3e99dff4f service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:43.897362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ecbf7-da17-46e3-9562-1019f2006adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:43.898416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ecbf7-da17-46e3-9562-1019f2006adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:43.898697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ecbf7-da17-46e3-9562-1019f2006adb admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:43.901221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ecbf7-da17-46e3-9562-1019f2006adb admin admin] PATH_INFO: `/v3/users/3aeed32d7c264676a56316f01a7a7395` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:43.901221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ecbf7-da17-46e3-9562-1019f2006adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aeed32d7c264676a56316f01a7a7395)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:43.902962 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ecbf7-da17-46e3-9562-1019f2006adb admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:44.058936 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:44.102574 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-c76ecbf7-da17-46e3-9562-1019f2006adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aeed32d7c264676a56316f01a7a7395'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:44.103544 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-c76ecbf7-da17-46e3-9562-1019f2006adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aeed32d7c264676a56316f01a7a7395'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:44.160503 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-c76ecbf7-da17-46e3-9562-1019f2006adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aeed32d7c264676a56316f01a7a7395'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:44.170577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-c76ecbf7-da17-46e3-9562-1019f2006adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aeed32d7c264676a56316f01a7a7395'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:44.171462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-c76ecbf7-da17-46e3-9562-1019f2006adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aeed32d7c264676a56316f01a7a7395'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:44.232478 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1159/2278] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:43 2022] DELETE /identity/v3/users/3aeed32d7c264676a56316f01a7a7395 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:44.932284 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650a453-9aaa-4aa5-9f92-05ba399d4ff6 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:44.933717 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4650a453-9aaa-4aa5-9f92-05ba399d4ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:44.948310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650a453-9aaa-4aa5-9f92-05ba399d4ff6 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:45.005989 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d0929-7fdb-4e43-ac1d-0484ea05a746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:45.006887 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d0929-7fdb-4e43-ac1d-0484ea05a746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:45.007173 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d0929-7fdb-4e43-ac1d-0484ea05a746 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:45.007717 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d0929-7fdb-4e43-ac1d-0484ea05a746 admin admin] PATH_INFO: `/v3/projects/dc25398640a94d9ab111dcd8e21149f2` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:45.009012 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d0929-7fdb-4e43-ac1d-0484ea05a746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc25398640a94d9ab111dcd8e21149f2)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:45.011596 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d0929-7fdb-4e43-ac1d-0484ea05a746 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:45.018782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:45.139494 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-129d0929-7fdb-4e43-ac1d-0484ea05a746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc25398640a94d9ab111dcd8e21149f2', 'request_id': 'req-129d0929-7fdb-4e43-ac1d-0484ea05a746'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:45.145903 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-129d0929-7fdb-4e43-ac1d-0484ea05a746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc25398640a94d9ab111dcd8e21149f2', 'request_id': 'req-129d0929-7fdb-4e43-ac1d-0484ea05a746'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:45.154337 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-129d0929-7fdb-4e43-ac1d-0484ea05a746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc25398640a94d9ab111dcd8e21149f2', 'request_id': 'req-129d0929-7fdb-4e43-ac1d-0484ea05a746'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:45.241293 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-129d0929-7fdb-4e43-ac1d-0484ea05a746 admin admin] The token cache is being invalidate because project dc25398640a94d9ab111dcd8e21149f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:45.250930 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-129d0929-7fdb-4e43-ac1d-0484ea05a746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:45.250930 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-129d0929-7fdb-4e43-ac1d-0484ea05a746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:45.250930 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1120/2279] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:44 2022] DELETE /identity/v3/projects/dc25398640a94d9ab111dcd8e21149f2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:45.251541 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d38372-6d0f-4d70-9d4d-9551dc97d7d1 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:45.251541 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d38372-6d0f-4d70-9d4d-9551dc97d7d1 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:45.251541 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d38372-6d0f-4d70-9d4d-9551dc97d7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:45.283991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-c8d38372-6d0f-4d70-9d4d-9551dc97d7d1 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:45.285247 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c8d38372-6d0f-4d70-9d4d-9551dc97d7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:45.345944 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1160/2280] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:45.354381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9b98c-20bc-492a-8859-a706648918d6 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:45.354682 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9b98c-20bc-492a-8859-a706648918d6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:45.354956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9b98c-20bc-492a-8859-a706648918d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:45.373610 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-60d9b98c-20bc-492a-8859-a706648918d6 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:45.374837 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-60d9b98c-20bc-492a-8859-a706648918d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:45.383446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1121/2281] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:45.388267 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d38372-6d0f-4d70-9d4d-9551dc97d7d1 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:45.398330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d38372-6d0f-4d70-9d4d-9551dc97d7d1 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:45.405473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc552b-7bb6-4d21-94a3-218cca9b81a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:45.406210 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc552b-7bb6-4d21-94a3-218cca9b81a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:45.406501 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc552b-7bb6-4d21-94a3-218cca9b81a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:45.406782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc552b-7bb6-4d21-94a3-218cca9b81a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:45.407525 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc552b-7bb6-4d21-94a3-218cca9b81a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:58:45.407839 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc552b-7bb6-4d21-94a3-218cca9b81a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:45.409570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc552b-7bb6-4d21-94a3-218cca9b81a4 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:45.422644 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1161/2282] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:58:45.426867 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9b98c-20bc-492a-8859-a706648918d6 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:45.437449 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9b98c-20bc-492a-8859-a706648918d6 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:45.442728 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a453ff-7c69-4846-b9f8-88490058b3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:45.443395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a453ff-7c69-4846-b9f8-88490058b3bf admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:45.443684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a453ff-7c69-4846-b9f8-88490058b3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:45.443972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a453ff-7c69-4846-b9f8-88490058b3bf admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:45.444725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a453ff-7c69-4846-b9f8-88490058b3bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:45.446678 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a453ff-7c69-4846-b9f8-88490058b3bf admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:45.565403 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1122/2283] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:45 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:45.566913 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc552b-7bb6-4d21-94a3-218cca9b81a4 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:45.576692 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc552b-7bb6-4d21-94a3-218cca9b81a4 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:45.601104 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:45.657658 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230d476-8f21-4a61-a03e-ab3b76f6655d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:45.658348 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230d476-8f21-4a61-a03e-ab3b76f6655d admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:45.658635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230d476-8f21-4a61-a03e-ab3b76f6655d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:45.658917 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230d476-8f21-4a61-a03e-ab3b76f6655d admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:45.659639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230d476-8f21-4a61-a03e-ab3b76f6655d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:45.661779 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230d476-8f21-4a61-a03e-ab3b76f6655d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:45.691614 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:45.742602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1162/2284] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:45 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:45.744419 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a453ff-7c69-4846-b9f8-88490058b3bf admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:45.755832 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a453ff-7c69-4846-b9f8-88490058b3bf admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:45.761245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3035cfa-fb1f-4c03-b03a-d4a3f3c9e89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:45.761923 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3035cfa-fb1f-4c03-b03a-d4a3f3c9e89c admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:45.762203 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3035cfa-fb1f-4c03-b03a-d4a3f3c9e89c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:45.762552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3035cfa-fb1f-4c03-b03a-d4a3f3c9e89c admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:45.763942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3035cfa-fb1f-4c03-b03a-d4a3f3c9e89c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:45.765597 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3035cfa-fb1f-4c03-b03a-d4a3f3c9e89c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:45.783520 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1123/2285] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:58:45.784420 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230d476-8f21-4a61-a03e-ab3b76f6655d admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:45.813627 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230d476-8f21-4a61-a03e-ab3b76f6655d admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:45.818751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f015b08-a960-4e67-b8ff-2fb7ed555071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:45.819472 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f015b08-a960-4e67-b8ff-2fb7ed555071 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:45.819759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f015b08-a960-4e67-b8ff-2fb7ed555071 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:45.824032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f015b08-a960-4e67-b8ff-2fb7ed555071 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:45.824032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f015b08-a960-4e67-b8ff-2fb7ed555071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:45.824032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f015b08-a960-4e67-b8ff-2fb7ed555071 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:45.836604 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1163/2286] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:45.840032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3035cfa-fb1f-4c03-b03a-d4a3f3c9e89c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:45.850603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3035cfa-fb1f-4c03-b03a-d4a3f3c9e89c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:45.855597 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d142e22-5a25-40b8-82f3-afd7f3d557c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:45.856661 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d142e22-5a25-40b8-82f3-afd7f3d557c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:45.856949 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d142e22-5a25-40b8-82f3-afd7f3d557c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:45.857446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d142e22-5a25-40b8-82f3-afd7f3d557c9 admin admin] PATH_INFO: `/v3/projects/551e7bc349714316851f7364d106b2c7/users/fe802598f6ee45c29a1f93ef49795ed7/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:45.881148 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d142e22-5a25-40b8-82f3-afd7f3d557c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=551e7bc349714316851f7364d106b2c7, user_id=fe802598f6ee45c29a1f93ef49795ed7, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:45.884292 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d142e22-5a25-40b8-82f3-afd7f3d557c9 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:45.954098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1124/2287] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:45 2022] PUT /identity/v3/projects/551e7bc349714316851f7364d106b2c7/users/fe802598f6ee45c29a1f93ef49795ed7/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:45.964726 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e22ef-63a5-43ea-9d69-5711026fbd44 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:45.965031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e22ef-63a5-43ea-9d69-5711026fbd44 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:45.965310 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e22ef-63a5-43ea-9d69-5711026fbd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:45.992247 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-b00e22ef-63a5-43ea-9d69-5711026fbd44 None None] MFA Rules not processed for user `fe802598f6ee45c29a1f93ef49795ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:45.993505 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b00e22ef-63a5-43ea-9d69-5711026fbd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:46.060639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1164/2288] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:46.073355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d142e22-5a25-40b8-82f3-afd7f3d557c9 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:46.074926 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0d142e22-5a25-40b8-82f3-afd7f3d557c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:46.133181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d142e22-5a25-40b8-82f3-afd7f3d557c9 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:46.137058 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c916e-dc99-45b3-ba1d-8e1f45b2c996 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00c13f10b14449cea284eb629a316d83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:46.137703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c916e-dc99-45b3-ba1d-8e1f45b2c996 service glance] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:46.137986 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c916e-dc99-45b3-ba1d-8e1f45b2c996 service glance] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:46.138261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c916e-dc99-45b3-ba1d-8e1f45b2c996 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:46.147236 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c916e-dc99-45b3-ba1d-8e1f45b2c996 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:46.148721 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c916e-dc99-45b3-ba1d-8e1f45b2c996 service glance] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:46.157949 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1125/2289] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:46.475601 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e22ef-63a5-43ea-9d69-5711026fbd44 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:46.477208 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b00e22ef-63a5-43ea-9d69-5711026fbd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:46.532752 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:46.546201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e22ef-63a5-43ea-9d69-5711026fbd44 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:46.559640 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d87dc9-2c17-4763-bfde-8c1864d29263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:46.560381 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d87dc9-2c17-4763-bfde-8c1864d29263 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:46.560708 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d87dc9-2c17-4763-bfde-8c1864d29263 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:46.560985 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d87dc9-2c17-4763-bfde-8c1864d29263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:46.562972 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-e2d87dc9-2c17-4763-bfde-8c1864d29263 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:46.633111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d87dc9-2c17-4763-bfde-8c1864d29263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:46.634571 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d87dc9-2c17-4763-bfde-8c1864d29263 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:46.644688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1165/2290] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:47.373391 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c916e-dc99-45b3-ba1d-8e1f45b2c996 service glance] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:47.374906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9b1c916e-dc99-45b3-ba1d-8e1f45b2c996 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:47.467698 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c916e-dc99-45b3-ba1d-8e1f45b2c996 service glance] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:47.474118 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1cf1f-1543-493a-905a-fb4f4836d0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:47.475093 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1cf1f-1543-493a-905a-fb4f4836d0d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:47.475373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1cf1f-1543-493a-905a-fb4f4836d0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:47.475646 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1cf1f-1543-493a-905a-fb4f4836d0d8 admin admin] PATH_INFO: `/v3/users/4e36d6a0be344bac9b202e17f9993580` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:47.476911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1cf1f-1543-493a-905a-fb4f4836d0d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e36d6a0be344bac9b202e17f9993580)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:47.479411 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1cf1f-1543-493a-905a-fb4f4836d0d8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:47.523757 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:47.792519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-eec1cf1f-1543-493a-905a-fb4f4836d0d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e36d6a0be344bac9b202e17f9993580'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:47.793194 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-eec1cf1f-1543-493a-905a-fb4f4836d0d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e36d6a0be344bac9b202e17f9993580'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:47.862531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-eec1cf1f-1543-493a-905a-fb4f4836d0d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e36d6a0be344bac9b202e17f9993580'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:47.870257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-eec1cf1f-1543-493a-905a-fb4f4836d0d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e36d6a0be344bac9b202e17f9993580'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:47.881103 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:47.882707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-eec1cf1f-1543-493a-905a-fb4f4836d0d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e36d6a0be344bac9b202e17f9993580'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:47.888955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1126/2291] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:47 2022] DELETE /identity/v3/users/4e36d6a0be344bac9b202e17f9993580 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:47.893800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bf1f0-e475-4a5b-8a27-4b571217507f None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:47.894126 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bf1f0-e475-4a5b-8a27-4b571217507f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:47.894409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bf1f0-e475-4a5b-8a27-4b571217507f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:47.912627 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-714bf1f0-e475-4a5b-8a27-4b571217507f None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:47.915945 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-714bf1f0-e475-4a5b-8a27-4b571217507f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:47.972284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1166/2292] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:58:47.994885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1cf1f-1543-493a-905a-fb4f4836d0d8 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:47.998414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-eec1cf1f-1543-493a-905a-fb4f4836d0d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:48.076364 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1cf1f-1543-493a-905a-fb4f4836d0d8 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:48.083937 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87088c-14bb-43cd-b14d-05aa2d70258f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:48.084740 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87088c-14bb-43cd-b14d-05aa2d70258f service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:48.085123 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87088c-14bb-43cd-b14d-05aa2d70258f service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:48.085556 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87088c-14bb-43cd-b14d-05aa2d70258f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:48.098790 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87088c-14bb-43cd-b14d-05aa2d70258f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:48.106703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87088c-14bb-43cd-b14d-05aa2d70258f service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:48.118130 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1127/2293] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:48.826797 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bf1f0-e475-4a5b-8a27-4b571217507f None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:48.831117 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-714bf1f0-e475-4a5b-8a27-4b571217507f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:48.850041 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bf1f0-e475-4a5b-8a27-4b571217507f None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:48.857602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d8368-9dc5-4965-bed6-42c898214c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:48.858746 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d8368-9dc5-4965-bed6-42c898214c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:48.865021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d8368-9dc5-4965-bed6-42c898214c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:48.865021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d8368-9dc5-4965-bed6-42c898214c5b admin admin] PATH_INFO: `/v3/projects/901e7ccce46d4f4a961ecc1cf33093ac` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:48.865021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d8368-9dc5-4965-bed6-42c898214c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=901e7ccce46d4f4a961ecc1cf33093ac)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:48.865021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d8368-9dc5-4965-bed6-42c898214c5b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:49.035941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-429d8368-9dc5-4965-bed6-42c898214c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '901e7ccce46d4f4a961ecc1cf33093ac', 'request_id': 'req-429d8368-9dc5-4965-bed6-42c898214c5b'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:49.114459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-429d8368-9dc5-4965-bed6-42c898214c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '901e7ccce46d4f4a961ecc1cf33093ac', 'request_id': 'req-429d8368-9dc5-4965-bed6-42c898214c5b'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:49.122967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-429d8368-9dc5-4965-bed6-42c898214c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '901e7ccce46d4f4a961ecc1cf33093ac', 'request_id': 'req-429d8368-9dc5-4965-bed6-42c898214c5b'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:49.136661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-429d8368-9dc5-4965-bed6-42c898214c5b admin admin] The token cache is being invalidate because project 901e7ccce46d4f4a961ecc1cf33093ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:49.136960 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-429d8368-9dc5-4965-bed6-42c898214c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:49.138221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-429d8368-9dc5-4965-bed6-42c898214c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:49.140032 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1167/2294] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:48 2022] DELETE /identity/v3/projects/901e7ccce46d4f4a961ecc1cf33093ac => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:49.144062 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87088c-14bb-43cd-b14d-05aa2d70258f service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:49.156935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87088c-14bb-43cd-b14d-05aa2d70258f service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:49.232680 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e32e0-c06a-4263-899a-33b3f59867b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:49.233631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e32e0-c06a-4263-899a-33b3f59867b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:49.233913 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e32e0-c06a-4263-899a-33b3f59867b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:49.234225 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e32e0-c06a-4263-899a-33b3f59867b3 admin admin] PATH_INFO: `/v3/users/e2bb8d8d4161401a9a302262f567822d` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:49.235407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e32e0-c06a-4263-899a-33b3f59867b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2bb8d8d4161401a9a302262f567822d)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:49.237385 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e32e0-c06a-4263-899a-33b3f59867b3 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:49.391058 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-240e32e0-c06a-4263-899a-33b3f59867b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2bb8d8d4161401a9a302262f567822d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:49.391806 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-240e32e0-c06a-4263-899a-33b3f59867b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2bb8d8d4161401a9a302262f567822d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:49.407407 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:49.455601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-240e32e0-c06a-4263-899a-33b3f59867b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2bb8d8d4161401a9a302262f567822d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:49.463667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-240e32e0-c06a-4263-899a-33b3f59867b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2bb8d8d4161401a9a302262f567822d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:49.478865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-240e32e0-c06a-4263-899a-33b3f59867b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2bb8d8d4161401a9a302262f567822d'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:49.493922 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1128/2295] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:49 2022] DELETE /identity/v3/users/e2bb8d8d4161401a9a302262f567822d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:50.010545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:50.015500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d8368-9dc5-4965-bed6-42c898214c5b admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:50.018261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-429d8368-9dc5-4965-bed6-42c898214c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:50.036842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d8368-9dc5-4965-bed6-42c898214c5b admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:50.112787 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbaf613-68e2-4883-8e7e-d2502a87156c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:50.113758 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbaf613-68e2-4883-8e7e-d2502a87156c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:50.114118 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbaf613-68e2-4883-8e7e-d2502a87156c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:50.114556 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbaf613-68e2-4883-8e7e-d2502a87156c admin admin] PATH_INFO: `/v3/projects/86f89a8c85774a8d96776d72681d4db6` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:50.115967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbaf613-68e2-4883-8e7e-d2502a87156c admin admin] RBAC: Authorizing `identity:delete_project(project_id=86f89a8c85774a8d96776d72681d4db6)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:50.118783 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbaf613-68e2-4883-8e7e-d2502a87156c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:50.290869 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-6dbaf613-68e2-4883-8e7e-d2502a87156c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f89a8c85774a8d96776d72681d4db6', 'request_id': 'req-6dbaf613-68e2-4883-8e7e-d2502a87156c'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:50.534158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-6dbaf613-68e2-4883-8e7e-d2502a87156c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f89a8c85774a8d96776d72681d4db6', 'request_id': 'req-6dbaf613-68e2-4883-8e7e-d2502a87156c'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:50.534158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-6dbaf613-68e2-4883-8e7e-d2502a87156c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f89a8c85774a8d96776d72681d4db6', 'request_id': 'req-6dbaf613-68e2-4883-8e7e-d2502a87156c'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:50.534158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-6dbaf613-68e2-4883-8e7e-d2502a87156c admin admin] The token cache is being invalidate because project 86f89a8c85774a8d96776d72681d4db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:50.534158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-6dbaf613-68e2-4883-8e7e-d2502a87156c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:50.534639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-6dbaf613-68e2-4883-8e7e-d2502a87156c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:50.534639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1168/2296] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:50 2022] DELETE /identity/v3/projects/86f89a8c85774a8d96776d72681d4db6 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:50.534896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e32e0-c06a-4263-899a-33b3f59867b3 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:50.534896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-240e32e0-c06a-4263-899a-33b3f59867b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:50.540340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e32e0-c06a-4263-899a-33b3f59867b3 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:50.603021 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b2520-6252-4bcb-9d05-7f6f0fe053a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:50.603949 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b2520-6252-4bcb-9d05-7f6f0fe053a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:50.604232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b2520-6252-4bcb-9d05-7f6f0fe053a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:50.604546 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b2520-6252-4bcb-9d05-7f6f0fe053a4 admin admin] PATH_INFO: `/v3/users/6afb7d6aa3e94137ab84ec2546020370` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:50.605832 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b2520-6252-4bcb-9d05-7f6f0fe053a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6afb7d6aa3e94137ab84ec2546020370)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:50.609909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b2520-6252-4bcb-9d05-7f6f0fe053a4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:50.890860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6f6b2520-6252-4bcb-9d05-7f6f0fe053a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6afb7d6aa3e94137ab84ec2546020370'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:50.891606 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6f6b2520-6252-4bcb-9d05-7f6f0fe053a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6afb7d6aa3e94137ab84ec2546020370'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:51.005713 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6f6b2520-6252-4bcb-9d05-7f6f0fe053a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6afb7d6aa3e94137ab84ec2546020370'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:51.014779 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6f6b2520-6252-4bcb-9d05-7f6f0fe053a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6afb7d6aa3e94137ab84ec2546020370'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:51.027541 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6f6b2520-6252-4bcb-9d05-7f6f0fe053a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6afb7d6aa3e94137ab84ec2546020370'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:51.036362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1129/2297] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:50 2022] DELETE /identity/v3/users/6afb7d6aa3e94137ab84ec2546020370 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:51.377230 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:51.661177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbaf613-68e2-4883-8e7e-d2502a87156c admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:51.663903 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6dbaf613-68e2-4883-8e7e-d2502a87156c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:51.682536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbaf613-68e2-4883-8e7e-d2502a87156c admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:51.784577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e791651-e63c-4c24-8c48-d00f7098f9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:51.785720 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e791651-e63c-4c24-8c48-d00f7098f9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:51.786073 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e791651-e63c-4c24-8c48-d00f7098f9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:51.786352 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e791651-e63c-4c24-8c48-d00f7098f9ed admin admin] PATH_INFO: `/v3/projects/889ec5e473d040c081b8149c5eab5b10` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:51.788494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e791651-e63c-4c24-8c48-d00f7098f9ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=889ec5e473d040c081b8149c5eab5b10)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:51.792585 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e791651-e63c-4c24-8c48-d00f7098f9ed admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:51.846702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:51.940115 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4e791651-e63c-4c24-8c48-d00f7098f9ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '889ec5e473d040c081b8149c5eab5b10', 'request_id': 'req-4e791651-e63c-4c24-8c48-d00f7098f9ed'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:52.040270 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4e791651-e63c-4c24-8c48-d00f7098f9ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '889ec5e473d040c081b8149c5eab5b10', 'request_id': 'req-4e791651-e63c-4c24-8c48-d00f7098f9ed'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:52.054314 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4e791651-e63c-4c24-8c48-d00f7098f9ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '889ec5e473d040c081b8149c5eab5b10', 'request_id': 'req-4e791651-e63c-4c24-8c48-d00f7098f9ed'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:52.067245 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4e791651-e63c-4c24-8c48-d00f7098f9ed admin admin] The token cache is being invalidate because project 889ec5e473d040c081b8149c5eab5b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:52.069254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4e791651-e63c-4c24-8c48-d00f7098f9ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:52.069254 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4e791651-e63c-4c24-8c48-d00f7098f9ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:52.071135 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1169/2298] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:51 2022] DELETE /identity/v3/projects/889ec5e473d040c081b8149c5eab5b10 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:52.079626 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787852c9-2b35-43a8-b27f-f3e61facda80 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:52.080224 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787852c9-2b35-43a8-b27f-f3e61facda80 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:52.080713 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787852c9-2b35-43a8-b27f-f3e61facda80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:52.116397 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-787852c9-2b35-43a8-b27f-f3e61facda80 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:52.118969 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-787852c9-2b35-43a8-b27f-f3e61facda80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:52.190843 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1130/2299] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:52.199597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06d7fb-66e9-454a-a080-522f73090513 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:52.199891 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06d7fb-66e9-454a-a080-522f73090513 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:52.200227 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06d7fb-66e9-454a-a080-522f73090513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:52.220260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-1d06d7fb-66e9-454a-a080-522f73090513 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:52.221620 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-1d06d7fb-66e9-454a-a080-522f73090513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:52.230161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1170/2300] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:52.234241 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787852c9-2b35-43a8-b27f-f3e61facda80 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:52.243848 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787852c9-2b35-43a8-b27f-f3e61facda80 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:52.248855 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1d328-bbd0-4127-a907-b4fba1fc4201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:52.249780 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1d328-bbd0-4127-a907-b4fba1fc4201 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:52.250319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1d328-bbd0-4127-a907-b4fba1fc4201 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:52.250663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1d328-bbd0-4127-a907-b4fba1fc4201 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:52.251800 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1d328-bbd0-4127-a907-b4fba1fc4201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:58:52.252215 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1d328-bbd0-4127-a907-b4fba1fc4201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:52.253995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1d328-bbd0-4127-a907-b4fba1fc4201 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:52.270373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1131/2301] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:58:52.273075 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06d7fb-66e9-454a-a080-522f73090513 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:52.283948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06d7fb-66e9-454a-a080-522f73090513 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:52.289593 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc89d27-eadf-4afd-b75d-8f0bb29f0e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:52.290387 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc89d27-eadf-4afd-b75d-8f0bb29f0e12 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:52.290670 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc89d27-eadf-4afd-b75d-8f0bb29f0e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:52.291076 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc89d27-eadf-4afd-b75d-8f0bb29f0e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:52.291816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc89d27-eadf-4afd-b75d-8f0bb29f0e12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:52.297319 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc89d27-eadf-4afd-b75d-8f0bb29f0e12 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:52.381622 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1171/2302] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:52 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:52.386232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1d328-bbd0-4127-a907-b4fba1fc4201 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:52.401748 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1d328-bbd0-4127-a907-b4fba1fc4201 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:52.468386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391744a-db3d-485f-8dee-6f87f269abdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:52.469126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391744a-db3d-485f-8dee-6f87f269abdb admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:52.469418 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391744a-db3d-485f-8dee-6f87f269abdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:52.469719 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391744a-db3d-485f-8dee-6f87f269abdb admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:52.470428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391744a-db3d-485f-8dee-6f87f269abdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:52.474148 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391744a-db3d-485f-8dee-6f87f269abdb admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:52.603306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1132/2303] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:52 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:52.607442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc89d27-eadf-4afd-b75d-8f0bb29f0e12 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:52.620373 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc89d27-eadf-4afd-b75d-8f0bb29f0e12 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:52.625879 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68962ebd-2c07-4d5c-818f-3807ee430d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:52.626678 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68962ebd-2c07-4d5c-818f-3807ee430d6c admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:52.626996 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68962ebd-2c07-4d5c-818f-3807ee430d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:52.627456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68962ebd-2c07-4d5c-818f-3807ee430d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:52.629612 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68962ebd-2c07-4d5c-818f-3807ee430d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:52.631803 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68962ebd-2c07-4d5c-818f-3807ee430d6c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:52.646696 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1172/2304] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:52.654110 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391744a-db3d-485f-8dee-6f87f269abdb admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:52.668306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391744a-db3d-485f-8dee-6f87f269abdb admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:52.675031 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7dc27-1f1a-4922-93f0-8d9b9b218502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:52.676241 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7dc27-1f1a-4922-93f0-8d9b9b218502 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:52.685174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7dc27-1f1a-4922-93f0-8d9b9b218502 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:52.685174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7dc27-1f1a-4922-93f0-8d9b9b218502 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:52.685174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7dc27-1f1a-4922-93f0-8d9b9b218502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:52.685174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7dc27-1f1a-4922-93f0-8d9b9b218502 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:52.691194 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1133/2305] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:52.697313 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68962ebd-2c07-4d5c-818f-3807ee430d6c admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:52.709957 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68962ebd-2c07-4d5c-818f-3807ee430d6c admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:52.713339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612deb8-7917-4d45-935a-791834da8ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:52.714237 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612deb8-7917-4d45-935a-791834da8ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:52.714521 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612deb8-7917-4d45-935a-791834da8ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:52.714810 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612deb8-7917-4d45-935a-791834da8ea4 admin admin] PATH_INFO: `/v3/projects/1e72c2ad82ab4b23bfe27ed8632290e2/users/cc50c45885fe43f7a1cd51468b722fbf/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:52.732391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612deb8-7917-4d45-935a-791834da8ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e72c2ad82ab4b23bfe27ed8632290e2, user_id=cc50c45885fe43f7a1cd51468b722fbf, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:52.735168 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612deb8-7917-4d45-935a-791834da8ea4 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:52.821707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1173/2306] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:52 2022] PUT /identity/v3/projects/1e72c2ad82ab4b23bfe27ed8632290e2/users/cc50c45885fe43f7a1cd51468b722fbf/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:52.832859 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167d5c5-63d1-4606-989f-02856caa0484 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:52.833222 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167d5c5-63d1-4606-989f-02856caa0484 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:52.833575 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167d5c5-63d1-4606-989f-02856caa0484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:52.869209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d167d5c5-63d1-4606-989f-02856caa0484 None None] MFA Rules not processed for user `cc50c45885fe43f7a1cd51468b722fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:52.870516 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d167d5c5-63d1-4606-989f-02856caa0484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:52.945478 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1134/2307] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:52.955798 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612deb8-7917-4d45-935a-791834da8ea4 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:52.957837 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-3612deb8-7917-4d45-935a-791834da8ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:53.029979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612deb8-7917-4d45-935a-791834da8ea4 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:53.038091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d97df-c3bd-4071-9555-575e7e6ab2c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:53.038779 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d97df-c3bd-4071-9555-575e7e6ab2c5 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:53.039420 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d97df-c3bd-4071-9555-575e7e6ab2c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:53.039420 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d97df-c3bd-4071-9555-575e7e6ab2c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:53.049582 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d97df-c3bd-4071-9555-575e7e6ab2c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:53.051043 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d97df-c3bd-4071-9555-575e7e6ab2c5 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:53.060327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1174/2308] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:53.109471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:53.159139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167d5c5-63d1-4606-989f-02856caa0484 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:53.166701 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d167d5c5-63d1-4606-989f-02856caa0484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:53.268479 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167d5c5-63d1-4606-989f-02856caa0484 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:53.279605 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17908fba-cfac-4358-a2fb-1b0b7947cd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:53.280879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17908fba-cfac-4358-a2fb-1b0b7947cd5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:53.281170 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17908fba-cfac-4358-a2fb-1b0b7947cd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:53.284521 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17908fba-cfac-4358-a2fb-1b0b7947cd5c admin admin] PATH_INFO: `/v3/users/6d19ae3b2fb84342b522b2b9dd3f9a91` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:53.284521 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17908fba-cfac-4358-a2fb-1b0b7947cd5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d19ae3b2fb84342b522b2b9dd3f9a91)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:53.285197 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17908fba-cfac-4358-a2fb-1b0b7947cd5c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:53.287826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f132c-6a19-43c5-a8e0-a1b93e564aa0 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:53.288762 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f132c-6a19-43c5-a8e0-a1b93e564aa0 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:53.289258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f132c-6a19-43c5-a8e0-a1b93e564aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:53.319312 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-c10f132c-6a19-43c5-a8e0-a1b93e564aa0 None None] MFA Rules not processed for user `3c407a688b8948ed9c26aa2995678107`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:53.321235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c10f132c-6a19-43c5-a8e0-a1b93e564aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:53.394493 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1175/2309] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:53.554345 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-17908fba-cfac-4358-a2fb-1b0b7947cd5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d19ae3b2fb84342b522b2b9dd3f9a91'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:53.555581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-17908fba-cfac-4358-a2fb-1b0b7947cd5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d19ae3b2fb84342b522b2b9dd3f9a91'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:53.567453 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bca5c-1167-40d8-83d4-61d68cd09433 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:53.568848 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bca5c-1167-40d8-83d4-61d68cd09433 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:53.568848 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bca5c-1167-40d8-83d4-61d68cd09433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:53.588459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-235bca5c-1167-40d8-83d4-61d68cd09433 None None] MFA Rules not processed for user `1eefe0d721484433b72afca03a2c1bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:53.589623 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-235bca5c-1167-40d8-83d4-61d68cd09433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:53.654823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1176/2310] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Jun 16 18:58:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:58:53.673687 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-17908fba-cfac-4358-a2fb-1b0b7947cd5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d19ae3b2fb84342b522b2b9dd3f9a91'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:53.683681 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-17908fba-cfac-4358-a2fb-1b0b7947cd5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d19ae3b2fb84342b522b2b9dd3f9a91'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:53.701878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-17908fba-cfac-4358-a2fb-1b0b7947cd5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d19ae3b2fb84342b522b2b9dd3f9a91'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:53.708769 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1135/2311] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:53 2022] DELETE /identity/v3/users/6d19ae3b2fb84342b522b2b9dd3f9a91 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:53.714733 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ad7d3-55db-4a11-a57f-dbcf38ccc87b None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:53.715488 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ad7d3-55db-4a11-a57f-dbcf38ccc87b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:53.715772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ad7d3-55db-4a11-a57f-dbcf38ccc87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:53.725280 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17908fba-cfac-4358-a2fb-1b0b7947cd5c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:53.726740 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-17908fba-cfac-4358-a2fb-1b0b7947cd5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:53.734553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-ce6ad7d3-55db-4a11-a57f-dbcf38ccc87b None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:53.735930 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-ce6ad7d3-55db-4a11-a57f-dbcf38ccc87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:53.820011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17908fba-cfac-4358-a2fb-1b0b7947cd5c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:53.828671 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1177/2312] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:53.835690 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ad7d3-55db-4a11-a57f-dbcf38ccc87b None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:53.838059 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-ce6ad7d3-55db-4a11-a57f-dbcf38ccc87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:53.840083 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661046c-2381-4b3b-a2a8-e32310430c9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b45db002889846eda5b2a3e6917fcbe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:53.848178 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661046c-2381-4b3b-a2a8-e32310430c9a service swift] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:53.848178 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661046c-2381-4b3b-a2a8-e32310430c9a service swift] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:53.848178 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661046c-2381-4b3b-a2a8-e32310430c9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:53.848178 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3661046c-2381-4b3b-a2a8-e32310430c9a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:53.915986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ad7d3-55db-4a11-a57f-dbcf38ccc87b None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:53.921158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6df73-c2da-4e3d-85fc-a687746dbdf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:53.922107 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6df73-c2da-4e3d-85fc-a687746dbdf6 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:53.922568 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6df73-c2da-4e3d-85fc-a687746dbdf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:53.923002 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6df73-c2da-4e3d-85fc-a687746dbdf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:53.932188 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661046c-2381-4b3b-a2a8-e32310430c9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:53.936394 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6df73-c2da-4e3d-85fc-a687746dbdf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:53.938057 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6df73-c2da-4e3d-85fc-a687746dbdf6 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:53.945534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661046c-2381-4b3b-a2a8-e32310430c9a service swift] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:53.955568 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1178/2313] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:58:53.957147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1136/2314] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Jun 16 18:58:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 18:58:54.166600 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:54.514838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6df73-c2da-4e3d-85fc-a687746dbdf6 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:54.516981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-cff6df73-c2da-4e3d-85fc-a687746dbdf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:54.537128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6df73-c2da-4e3d-85fc-a687746dbdf6 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:54.551946 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7eaf34-a604-443b-8c98-c2e76dd120bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:54.553007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eaf34-a604-443b-8c98-c2e76dd120bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:54.553369 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eaf34-a604-443b-8c98-c2e76dd120bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:54.553711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eaf34-a604-443b-8c98-c2e76dd120bc admin admin] PATH_INFO: `/v3/projects/a0e4eeeec5aa4195ae6e43d5c267c45a` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:54.555306 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7eaf34-a604-443b-8c98-c2e76dd120bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e4eeeec5aa4195ae6e43d5c267c45a)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:54.558806 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7eaf34-a604-443b-8c98-c2e76dd120bc admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:54.773588 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-1f7eaf34-a604-443b-8c98-c2e76dd120bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e4eeeec5aa4195ae6e43d5c267c45a', 'request_id': 'req-1f7eaf34-a604-443b-8c98-c2e76dd120bc'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:54.895614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-1f7eaf34-a604-443b-8c98-c2e76dd120bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e4eeeec5aa4195ae6e43d5c267c45a', 'request_id': 'req-1f7eaf34-a604-443b-8c98-c2e76dd120bc'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:54.903095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-1f7eaf34-a604-443b-8c98-c2e76dd120bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e4eeeec5aa4195ae6e43d5c267c45a', 'request_id': 'req-1f7eaf34-a604-443b-8c98-c2e76dd120bc'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:54.916240 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-1f7eaf34-a604-443b-8c98-c2e76dd120bc admin admin] The token cache is being invalidate because project a0e4eeeec5aa4195ae6e43d5c267c45a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:54.916580 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-1f7eaf34-a604-443b-8c98-c2e76dd120bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:54.917498 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-1f7eaf34-a604-443b-8c98-c2e76dd120bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:54.919173 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1179/2315] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:54 2022] DELETE /identity/v3/projects/a0e4eeeec5aa4195ae6e43d5c267c45a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:54.927462 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661046c-2381-4b3b-a2a8-e32310430c9a service swift] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:54.939513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661046c-2381-4b3b-a2a8-e32310430c9a service swift] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:55.011456 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecd2b9-139e-4484-9689-f55a4db9422f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:55.012541 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecd2b9-139e-4484-9689-f55a4db9422f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:55.012893 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecd2b9-139e-4484-9689-f55a4db9422f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:55.013264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecd2b9-139e-4484-9689-f55a4db9422f admin admin] PATH_INFO: `/v3/users/884b095427ac44e29a870dfacb451885` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:55.014689 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecd2b9-139e-4484-9689-f55a4db9422f admin admin] RBAC: Authorizing `identity:delete_user(user_id=884b095427ac44e29a870dfacb451885)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:55.016889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecd2b9-139e-4484-9689-f55a4db9422f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:55.027231 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:55.270849 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-faecd2b9-139e-4484-9689-f55a4db9422f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '884b095427ac44e29a870dfacb451885'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:55.272617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-faecd2b9-139e-4484-9689-f55a4db9422f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '884b095427ac44e29a870dfacb451885'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:55.432897 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-faecd2b9-139e-4484-9689-f55a4db9422f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '884b095427ac44e29a870dfacb451885'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:55.441579 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-faecd2b9-139e-4484-9689-f55a4db9422f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '884b095427ac44e29a870dfacb451885'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:55.454299 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-faecd2b9-139e-4484-9689-f55a4db9422f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '884b095427ac44e29a870dfacb451885'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:55.460565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1137/2316] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:58:54 2022] DELETE /identity/v3/users/884b095427ac44e29a870dfacb451885 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:55.891691 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:56.043003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7eaf34-a604-443b-8c98-c2e76dd120bc admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:56.045408 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-1f7eaf34-a604-443b-8c98-c2e76dd120bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:56.095486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7eaf34-a604-443b-8c98-c2e76dd120bc admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:56.213264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0971c6-6573-41ee-b432-dec99806012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:56.214566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0971c6-6573-41ee-b432-dec99806012d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:56.214861 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0971c6-6573-41ee-b432-dec99806012d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:56.215138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0971c6-6573-41ee-b432-dec99806012d admin admin] PATH_INFO: `/v3/projects/3cbc023b2d8748c5b495e6ae4874fc92` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:56.217183 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0971c6-6573-41ee-b432-dec99806012d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cbc023b2d8748c5b495e6ae4874fc92)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:56.220212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0971c6-6573-41ee-b432-dec99806012d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:56.476763 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9d0971c6-6573-41ee-b432-dec99806012d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cbc023b2d8748c5b495e6ae4874fc92', 'request_id': 'req-9d0971c6-6573-41ee-b432-dec99806012d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:56.587971 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9d0971c6-6573-41ee-b432-dec99806012d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cbc023b2d8748c5b495e6ae4874fc92', 'request_id': 'req-9d0971c6-6573-41ee-b432-dec99806012d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:56.595025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9d0971c6-6573-41ee-b432-dec99806012d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cbc023b2d8748c5b495e6ae4874fc92', 'request_id': 'req-9d0971c6-6573-41ee-b432-dec99806012d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:56.605757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9d0971c6-6573-41ee-b432-dec99806012d admin admin] The token cache is being invalidate because project 3cbc023b2d8748c5b495e6ae4874fc92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:58:56.606046 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9d0971c6-6573-41ee-b432-dec99806012d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:56.606691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9d0971c6-6573-41ee-b432-dec99806012d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:58:56.608227 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1180/2317] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:58:56 2022] DELETE /identity/v3/projects/3cbc023b2d8748c5b495e6ae4874fc92 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:56.614148 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5480a-f047-42e2-9108-bd87c006d0ed None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:56.614672 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5480a-f047-42e2-9108-bd87c006d0ed None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:56.614771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5480a-f047-42e2-9108-bd87c006d0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:56.633666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-7fa5480a-f047-42e2-9108-bd87c006d0ed None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:56.635432 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7fa5480a-f047-42e2-9108-bd87c006d0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:56.694008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1138/2318] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:56.704367 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9c963-22b4-4857-9fd3-0daed9ac515b None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:56.704807 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9c963-22b4-4857-9fd3-0daed9ac515b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:56.705180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9c963-22b4-4857-9fd3-0daed9ac515b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:56.787793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-8fe9c963-22b4-4857-9fd3-0daed9ac515b None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:56.789092 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-8fe9c963-22b4-4857-9fd3-0daed9ac515b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:56.839940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:56.845847 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1181/2319] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:56.849993 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5480a-f047-42e2-9108-bd87c006d0ed None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:56.912675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5480a-f047-42e2-9108-bd87c006d0ed None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:56.917640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eaf049-6093-46e4-876c-380027571448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:56.918412 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaf049-6093-46e4-876c-380027571448 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:56.918906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaf049-6093-46e4-876c-380027571448 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:56.919270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaf049-6093-46e4-876c-380027571448 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:56.920081 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eaf049-6093-46e4-876c-380027571448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:58:56.920406 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eaf049-6093-46e4-876c-380027571448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:56.922138 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eaf049-6093-46e4-876c-380027571448 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:56.944559 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1139/2320] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:58:56.946970 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9c963-22b4-4857-9fd3-0daed9ac515b None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:56.958659 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9c963-22b4-4857-9fd3-0daed9ac515b None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:56.964302 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e855ed-65c9-4d86-a1d1-7a5fa4e614b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:56.965183 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e855ed-65c9-4d86-a1d1-7a5fa4e614b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:56.965532 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e855ed-65c9-4d86-a1d1-7a5fa4e614b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:56.965880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e855ed-65c9-4d86-a1d1-7a5fa4e614b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:56.966753 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e855ed-65c9-4d86-a1d1-7a5fa4e614b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:56.969285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e855ed-65c9-4d86-a1d1-7a5fa4e614b0 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:57.094671 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1182/2321] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:56 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:57.099010 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eaf049-6093-46e4-876c-380027571448 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:57.110860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eaf049-6093-46e4-876c-380027571448 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:57.179814 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ab786-ff49-48e6-b847-4ab015250628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:57.180762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ab786-ff49-48e6-b847-4ab015250628 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:57.180942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ab786-ff49-48e6-b847-4ab015250628 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:57.181222 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ab786-ff49-48e6-b847-4ab015250628 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:57.181984 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ab786-ff49-48e6-b847-4ab015250628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:57.184298 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ab786-ff49-48e6-b847-4ab015250628 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:57.287442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1140/2322] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:57 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:57.288827 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e855ed-65c9-4d86-a1d1-7a5fa4e614b0 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:57.304127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e855ed-65c9-4d86-a1d1-7a5fa4e614b0 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:57.310785 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f1057-7af5-4f69-8561-cab91949cec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:57.311704 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f1057-7af5-4f69-8561-cab91949cec6 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:57.312209 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f1057-7af5-4f69-8561-cab91949cec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:57.312713 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f1057-7af5-4f69-8561-cab91949cec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:57.313945 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f1057-7af5-4f69-8561-cab91949cec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:57.315884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f1057-7af5-4f69-8561-cab91949cec6 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:57.330196 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1183/2323] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:57.334610 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ab786-ff49-48e6-b847-4ab015250628 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:57.356607 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ab786-ff49-48e6-b847-4ab015250628 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:57.361635 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb2290-6276-4c97-9ab8-585c8dfcb68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:57.362315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb2290-6276-4c97-9ab8-585c8dfcb68a admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:57.362606 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb2290-6276-4c97-9ab8-585c8dfcb68a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:57.363088 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb2290-6276-4c97-9ab8-585c8dfcb68a admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:57.364093 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb2290-6276-4c97-9ab8-585c8dfcb68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:57.365958 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb2290-6276-4c97-9ab8-585c8dfcb68a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:57.376371 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1141/2324] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:58:57.380578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f1057-7af5-4f69-8561-cab91949cec6 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:57.400761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f1057-7af5-4f69-8561-cab91949cec6 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:57.410180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60f5d4-66be-4e66-8bfd-ab225c72b7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:57.411230 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60f5d4-66be-4e66-8bfd-ab225c72b7d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:57.411668 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60f5d4-66be-4e66-8bfd-ab225c72b7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:57.411942 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60f5d4-66be-4e66-8bfd-ab225c72b7d9 admin admin] PATH_INFO: `/v3/projects/404324d5cde24f049494238ab9f46cf3/users/d590419b37ec4e25a8ffe2e7b016bc1d/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:57.435440 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60f5d4-66be-4e66-8bfd-ab225c72b7d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=404324d5cde24f049494238ab9f46cf3, user_id=d590419b37ec4e25a8ffe2e7b016bc1d, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:57.438650 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60f5d4-66be-4e66-8bfd-ab225c72b7d9 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:57.524171 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1184/2325] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:57 2022] PUT /identity/v3/projects/404324d5cde24f049494238ab9f46cf3/users/d590419b37ec4e25a8ffe2e7b016bc1d/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:57.526740 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18943f43-8db0-4a1c-855c-e4c350213f78 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:57.527065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18943f43-8db0-4a1c-855c-e4c350213f78 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:57.527351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18943f43-8db0-4a1c-855c-e4c350213f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:57.567846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:57.592527 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-18943f43-8db0-4a1c-855c-e4c350213f78 None None] MFA Rules not processed for user `d590419b37ec4e25a8ffe2e7b016bc1d`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:57.594314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-18943f43-8db0-4a1c-855c-e4c350213f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:57.716290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1142/2326] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:57.721846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60f5d4-66be-4e66-8bfd-ab225c72b7d9 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:57.822710 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60f5d4-66be-4e66-8bfd-ab225c72b7d9 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:57.833774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ad47b-c917-4bda-93ee-d6bafdb623e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:57.835075 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ad47b-c917-4bda-93ee-d6bafdb623e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:57.835527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ad47b-c917-4bda-93ee-d6bafdb623e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:57.835962 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ad47b-c917-4bda-93ee-d6bafdb623e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:57.837718 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ad47b-c917-4bda-93ee-d6bafdb623e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:57.842018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ad47b-c917-4bda-93ee-d6bafdb623e4 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:57.845325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:57.949672 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18943f43-8db0-4a1c-855c-e4c350213f78 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:57.950228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1185/2327] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:58:57 2022] POST /identity/v3/projects => generated 371 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:57.965494 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18943f43-8db0-4a1c-855c-e4c350213f78 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:58.114156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93afae-e606-435c-88bc-9dc28e637b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:58.114925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93afae-e606-435c-88bc-9dc28e637b6b admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:58.115784 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93afae-e606-435c-88bc-9dc28e637b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:58.116071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93afae-e606-435c-88bc-9dc28e637b6b admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:58.117221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93afae-e606-435c-88bc-9dc28e637b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:58.123208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93afae-e606-435c-88bc-9dc28e637b6b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:58.261788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ad47b-c917-4bda-93ee-d6bafdb623e4 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:58.282213 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1143/2328] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:58:57 2022] POST /identity/v3/users => generated 292 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:58:58.287761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ad47b-c917-4bda-93ee-d6bafdb623e4 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:58.303911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b695e-0057-4069-a940-72f9a1c758e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:58.304453 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b695e-0057-4069-a940-72f9a1c758e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:58.305120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b695e-0057-4069-a940-72f9a1c758e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:58.305120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b695e-0057-4069-a940-72f9a1c758e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:58.306317 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b695e-0057-4069-a940-72f9a1c758e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:58.307937 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b695e-0057-4069-a940-72f9a1c758e3 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:58.324308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1186/2329] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:58.326320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93afae-e606-435c-88bc-9dc28e637b6b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:58.338739 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93afae-e606-435c-88bc-9dc28e637b6b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:58.346113 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af7a1a-1319-4ed6-a0d3-ede20e778497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:58.347021 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af7a1a-1319-4ed6-a0d3-ede20e778497 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:58.347644 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af7a1a-1319-4ed6-a0d3-ede20e778497 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:58.348328 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af7a1a-1319-4ed6-a0d3-ede20e778497 admin admin] PATH_INFO: `/v3/projects/417ecd227d5744eb97e0c3f63ff33866/users/a1b0e32ec82d4128b60dc518ebd36f5d/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:58.395994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af7a1a-1319-4ed6-a0d3-ede20e778497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=417ecd227d5744eb97e0c3f63ff33866, user_id=a1b0e32ec82d4128b60dc518ebd36f5d, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:58.399365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af7a1a-1319-4ed6-a0d3-ede20e778497 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:58.491751 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1144/2330] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:58 2022] PUT /identity/v3/projects/417ecd227d5744eb97e0c3f63ff33866/users/a1b0e32ec82d4128b60dc518ebd36f5d/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:58:58.506601 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b695e-0057-4069-a940-72f9a1c758e3 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:58.512049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b695e-0057-4069-a940-72f9a1c758e3 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:58.577017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f13a8-d9da-45a9-924f-d89bd5d9b51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:58.578205 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f13a8-d9da-45a9-924f-d89bd5d9b51e admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:58.578808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f13a8-d9da-45a9-924f-d89bd5d9b51e admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:58.579407 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f13a8-d9da-45a9-924f-d89bd5d9b51e admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:58.580896 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f13a8-d9da-45a9-924f-d89bd5d9b51e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:58.584023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f13a8-d9da-45a9-924f-d89bd5d9b51e admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:58.597864 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1187/2331] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:58:58.602868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af7a1a-1319-4ed6-a0d3-ede20e778497 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:58.622931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af7a1a-1319-4ed6-a0d3-ede20e778497 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:58.631219 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad07f39-df5c-4ebd-beb7-6221f33abf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:58.634319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad07f39-df5c-4ebd-beb7-6221f33abf3e admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:58.635512 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad07f39-df5c-4ebd-beb7-6221f33abf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:58.635852 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad07f39-df5c-4ebd-beb7-6221f33abf3e admin admin] PATH_INFO: `/v3/projects/417ecd227d5744eb97e0c3f63ff33866/users/a1b0e32ec82d4128b60dc518ebd36f5d/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:58.639661 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad07f39-df5c-4ebd-beb7-6221f33abf3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=417ecd227d5744eb97e0c3f63ff33866, user_id=a1b0e32ec82d4128b60dc518ebd36f5d, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:58.643913 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad07f39-df5c-4ebd-beb7-6221f33abf3e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:58.660486 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1145/2332] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:58:58 2022] PUT /identity/v3/projects/417ecd227d5744eb97e0c3f63ff33866/users/a1b0e32ec82d4128b60dc518ebd36f5d/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:58:58.672468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c210aeb-2659-4d8a-80cb-2b46ca3803c1 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:58.672468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c210aeb-2659-4d8a-80cb-2b46ca3803c1 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:58.672758 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c210aeb-2659-4d8a-80cb-2b46ca3803c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:58.719006 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-6c210aeb-2659-4d8a-80cb-2b46ca3803c1 None None] MFA Rules not processed for user `a1b0e32ec82d4128b60dc518ebd36f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:58.721066 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6c210aeb-2659-4d8a-80cb-2b46ca3803c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:58.887113 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1188/2333] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:58:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:58.902642 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad07f39-df5c-4ebd-beb7-6221f33abf3e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:58:58.902642 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0ad07f39-df5c-4ebd-beb7-6221f33abf3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:58.987946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad07f39-df5c-4ebd-beb7-6221f33abf3e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:58:58.992669 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0db282-b300-4b63-9dc3-0535437a22c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:58:58.994056 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0db282-b300-4b63-9dc3-0535437a22c5 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:58.994345 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0db282-b300-4b63-9dc3-0535437a22c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:58.997283 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0db282-b300-4b63-9dc3-0535437a22c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:59.001054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:59.070919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0db282-b300-4b63-9dc3-0535437a22c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:58:59.074049 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0db282-b300-4b63-9dc3-0535437a22c5 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:58:59.089816 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1146/2334] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:58:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:59.348984 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:00.354555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:00.736654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:01.567274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:02.354723 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:02.463883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c210aeb-2659-4d8a-80cb-2b46ca3803c1 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:02.526517 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:02.531956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c210aeb-2659-4d8a-80cb-2b46ca3803c1 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:02.539816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7abfae-15c6-4a58-a1d0-156fe3eb280a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:02.539816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7abfae-15c6-4a58-a1d0-156fe3eb280a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:02.539816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7abfae-15c6-4a58-a1d0-156fe3eb280a admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:02.539816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7abfae-15c6-4a58-a1d0-156fe3eb280a admin admin] PATH_INFO: `/v3/users/d590419b37ec4e25a8ffe2e7b016bc1d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:02.540311 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7abfae-15c6-4a58-a1d0-156fe3eb280a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d590419b37ec4e25a8ffe2e7b016bc1d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:02.542169 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7abfae-15c6-4a58-a1d0-156fe3eb280a admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:02.758039 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9d7abfae-15c6-4a58-a1d0-156fe3eb280a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd590419b37ec4e25a8ffe2e7b016bc1d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:02.758816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9d7abfae-15c6-4a58-a1d0-156fe3eb280a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd590419b37ec4e25a8ffe2e7b016bc1d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:02.856699 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9d7abfae-15c6-4a58-a1d0-156fe3eb280a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd590419b37ec4e25a8ffe2e7b016bc1d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:02.865702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9d7abfae-15c6-4a58-a1d0-156fe3eb280a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd590419b37ec4e25a8ffe2e7b016bc1d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:02.867058 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9d7abfae-15c6-4a58-a1d0-156fe3eb280a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd590419b37ec4e25a8ffe2e7b016bc1d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:02.887333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1189/2335] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:59:02 2022] DELETE /identity/v3/users/d590419b37ec4e25a8ffe2e7b016bc1d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:02.892686 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218b0ab-3e9a-4b2a-b7f0-5da9a59d6d44 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:02.893582 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218b0ab-3e9a-4b2a-b7f0-5da9a59d6d44 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:02.893869 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218b0ab-3e9a-4b2a-b7f0-5da9a59d6d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:02.925156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a218b0ab-3e9a-4b2a-b7f0-5da9a59d6d44 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:02.926391 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a218b0ab-3e9a-4b2a-b7f0-5da9a59d6d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:02.989938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1147/2336] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:03.000519 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7abfae-15c6-4a58-a1d0-156fe3eb280a admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:03.006143 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-9d7abfae-15c6-4a58-a1d0-156fe3eb280a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:03.093289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7abfae-15c6-4a58-a1d0-156fe3eb280a admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:03.096980 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe92f80-c10a-4e76-87cb-ecb5643cb894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:03.097634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe92f80-c10a-4e76-87cb-ecb5643cb894 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:03.097922 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe92f80-c10a-4e76-87cb-ecb5643cb894 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:03.098205 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe92f80-c10a-4e76-87cb-ecb5643cb894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:03.114971 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe92f80-c10a-4e76-87cb-ecb5643cb894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:03.116476 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe92f80-c10a-4e76-87cb-ecb5643cb894 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:03.127447 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1190/2337] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:03.365293 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:03.473964 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:03.703768 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218b0ab-3e9a-4b2a-b7f0-5da9a59d6d44 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:03.707871 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a218b0ab-3e9a-4b2a-b7f0-5da9a59d6d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:03.733010 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218b0ab-3e9a-4b2a-b7f0-5da9a59d6d44 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:03.740484 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68192f-0004-4576-9120-47c4f2c81282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:03.742111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68192f-0004-4576-9120-47c4f2c81282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:03.743644 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68192f-0004-4576-9120-47c4f2c81282 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:03.744219 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68192f-0004-4576-9120-47c4f2c81282 admin admin] PATH_INFO: `/v3/projects/404324d5cde24f049494238ab9f46cf3` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:03.754732 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68192f-0004-4576-9120-47c4f2c81282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=404324d5cde24f049494238ab9f46cf3)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:03.754732 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68192f-0004-4576-9120-47c4f2c81282 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:03.874395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3a68192f-0004-4576-9120-47c4f2c81282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '404324d5cde24f049494238ab9f46cf3', 'request_id': 'req-3a68192f-0004-4576-9120-47c4f2c81282'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:03.880914 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3a68192f-0004-4576-9120-47c4f2c81282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '404324d5cde24f049494238ab9f46cf3', 'request_id': 'req-3a68192f-0004-4576-9120-47c4f2c81282'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:03.888690 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3a68192f-0004-4576-9120-47c4f2c81282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '404324d5cde24f049494238ab9f46cf3', 'request_id': 'req-3a68192f-0004-4576-9120-47c4f2c81282'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:04.009239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3a68192f-0004-4576-9120-47c4f2c81282 admin admin] The token cache is being invalidate because project 404324d5cde24f049494238ab9f46cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:59:04.010429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3a68192f-0004-4576-9120-47c4f2c81282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:04.011472 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3a68192f-0004-4576-9120-47c4f2c81282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:04.013779 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1148/2338] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:59:03 2022] DELETE /identity/v3/projects/404324d5cde24f049494238ab9f46cf3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:04.019639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe92f80-c10a-4e76-87cb-ecb5643cb894 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:04.033026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe92f80-c10a-4e76-87cb-ecb5643cb894 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:04.125987 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c68a61-0635-434e-9b7c-0096721ce8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:04.127594 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c68a61-0635-434e-9b7c-0096721ce8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:04.127904 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c68a61-0635-434e-9b7c-0096721ce8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:04.128233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c68a61-0635-434e-9b7c-0096721ce8ca admin admin] PATH_INFO: `/v3/users/a1b0e32ec82d4128b60dc518ebd36f5d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:04.129497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c68a61-0635-434e-9b7c-0096721ce8ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b0e32ec82d4128b60dc518ebd36f5d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:04.131530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c68a61-0635-434e-9b7c-0096721ce8ca admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:04.387049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-60c68a61-0635-434e-9b7c-0096721ce8ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b0e32ec82d4128b60dc518ebd36f5d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:04.388000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-60c68a61-0635-434e-9b7c-0096721ce8ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b0e32ec82d4128b60dc518ebd36f5d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:04.399840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:04.490121 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-60c68a61-0635-434e-9b7c-0096721ce8ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b0e32ec82d4128b60dc518ebd36f5d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:04.497583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-60c68a61-0635-434e-9b7c-0096721ce8ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b0e32ec82d4128b60dc518ebd36f5d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:04.498250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-60c68a61-0635-434e-9b7c-0096721ce8ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b0e32ec82d4128b60dc518ebd36f5d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:04.517321 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1191/2339] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:59:04 2022] DELETE /identity/v3/users/a1b0e32ec82d4128b60dc518ebd36f5d => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:04.965267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:05.008987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68192f-0004-4576-9120-47c4f2c81282 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:05.010723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3a68192f-0004-4576-9120-47c4f2c81282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:05.029029 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68192f-0004-4576-9120-47c4f2c81282 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:05.110181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351c203-4b9a-4579-9519-c4c50fbb1d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:05.111062 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351c203-4b9a-4579-9519-c4c50fbb1d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:05.111346 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351c203-4b9a-4579-9519-c4c50fbb1d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:05.111632 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351c203-4b9a-4579-9519-c4c50fbb1d1f admin admin] PATH_INFO: `/v3/projects/417ecd227d5744eb97e0c3f63ff33866` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:05.112882 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351c203-4b9a-4579-9519-c4c50fbb1d1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=417ecd227d5744eb97e0c3f63ff33866)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:05.114854 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351c203-4b9a-4579-9519-c4c50fbb1d1f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:05.136589 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:05.299489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f351c203-4b9a-4579-9519-c4c50fbb1d1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '417ecd227d5744eb97e0c3f63ff33866', 'request_id': 'req-f351c203-4b9a-4579-9519-c4c50fbb1d1f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:05.306685 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f351c203-4b9a-4579-9519-c4c50fbb1d1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '417ecd227d5744eb97e0c3f63ff33866', 'request_id': 'req-f351c203-4b9a-4579-9519-c4c50fbb1d1f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:05.315898 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f351c203-4b9a-4579-9519-c4c50fbb1d1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '417ecd227d5744eb97e0c3f63ff33866', 'request_id': 'req-f351c203-4b9a-4579-9519-c4c50fbb1d1f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:05.400986 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f351c203-4b9a-4579-9519-c4c50fbb1d1f admin admin] The token cache is being invalidate because project 417ecd227d5744eb97e0c3f63ff33866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:59:05.401291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f351c203-4b9a-4579-9519-c4c50fbb1d1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:05.401967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-f351c203-4b9a-4579-9519-c4c50fbb1d1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:05.403569 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1149/2340] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:59:05 2022] DELETE /identity/v3/projects/417ecd227d5744eb97e0c3f63ff33866 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:06.103046 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c68a61-0635-434e-9b7c-0096721ce8ca admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:06.104652 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-60c68a61-0635-434e-9b7c-0096721ce8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:06.119673 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c68a61-0635-434e-9b7c-0096721ce8ca admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:06.215842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f2581-dd33-495e-a9ae-d87116cdb17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:06.217171 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f2581-dd33-495e-a9ae-d87116cdb17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:06.217555 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f2581-dd33-495e-a9ae-d87116cdb17d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:06.217983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f2581-dd33-495e-a9ae-d87116cdb17d admin admin] PATH_INFO: `/v3/users/cc50c45885fe43f7a1cd51468b722fbf` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:06.219320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f2581-dd33-495e-a9ae-d87116cdb17d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc50c45885fe43f7a1cd51468b722fbf)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:06.221685 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f2581-dd33-495e-a9ae-d87116cdb17d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:06.428040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-992f2581-dd33-495e-a9ae-d87116cdb17d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc50c45885fe43f7a1cd51468b722fbf'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:06.429051 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-992f2581-dd33-495e-a9ae-d87116cdb17d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc50c45885fe43f7a1cd51468b722fbf'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:06.497196 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-992f2581-dd33-495e-a9ae-d87116cdb17d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc50c45885fe43f7a1cd51468b722fbf'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:06.511192 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-992f2581-dd33-495e-a9ae-d87116cdb17d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc50c45885fe43f7a1cd51468b722fbf'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:06.515270 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-992f2581-dd33-495e-a9ae-d87116cdb17d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc50c45885fe43f7a1cd51468b722fbf'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:06.582346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1192/2341] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:59:06 2022] DELETE /identity/v3/users/cc50c45885fe43f7a1cd51468b722fbf => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:06.584732 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78142cb7-6b5d-4b6f-8332-67445b56b4de None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:06.585268 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78142cb7-6b5d-4b6f-8332-67445b56b4de None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:06.585368 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78142cb7-6b5d-4b6f-8332-67445b56b4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:06.621062 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:06.647188 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-78142cb7-6b5d-4b6f-8332-67445b56b4de None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:06.649772 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-78142cb7-6b5d-4b6f-8332-67445b56b4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:06.728741 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1150/2342] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:06.738391 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f2581-dd33-495e-a9ae-d87116cdb17d admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:06.739857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-992f2581-dd33-495e-a9ae-d87116cdb17d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:06.804323 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:06.844747 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f2581-dd33-495e-a9ae-d87116cdb17d admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:06.850531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ec6ff-7ffa-45da-bb26-ad80124c36b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:06.851339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ec6ff-7ffa-45da-bb26-ad80124c36b6 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:06.851724 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ec6ff-7ffa-45da-bb26-ad80124c36b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:06.852710 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ec6ff-7ffa-45da-bb26-ad80124c36b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:06.864059 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ec6ff-7ffa-45da-bb26-ad80124c36b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:06.866283 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ec6ff-7ffa-45da-bb26-ad80124c36b6 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:06.877575 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1193/2343] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:07.304601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78142cb7-6b5d-4b6f-8332-67445b56b4de None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:07.306111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-78142cb7-6b5d-4b6f-8332-67445b56b4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:07.325344 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78142cb7-6b5d-4b6f-8332-67445b56b4de None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:07.334569 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3e021-c091-4d52-931c-f376cfc0ab98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:07.335601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3e021-c091-4d52-931c-f376cfc0ab98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:07.337579 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3e021-c091-4d52-931c-f376cfc0ab98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:07.337938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3e021-c091-4d52-931c-f376cfc0ab98 admin admin] PATH_INFO: `/v3/projects/1e72c2ad82ab4b23bfe27ed8632290e2` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:07.358023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3e021-c091-4d52-931c-f376cfc0ab98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e72c2ad82ab4b23bfe27ed8632290e2)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:07.361265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3e021-c091-4d52-931c-f376cfc0ab98 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:07.523688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2bd3e021-c091-4d52-931c-f376cfc0ab98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e72c2ad82ab4b23bfe27ed8632290e2', 'request_id': 'req-2bd3e021-c091-4d52-931c-f376cfc0ab98'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:07.533488 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2bd3e021-c091-4d52-931c-f376cfc0ab98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e72c2ad82ab4b23bfe27ed8632290e2', 'request_id': 'req-2bd3e021-c091-4d52-931c-f376cfc0ab98'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:07.546793 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2bd3e021-c091-4d52-931c-f376cfc0ab98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e72c2ad82ab4b23bfe27ed8632290e2', 'request_id': 'req-2bd3e021-c091-4d52-931c-f376cfc0ab98'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:07.651746 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2bd3e021-c091-4d52-931c-f376cfc0ab98 admin admin] The token cache is being invalidate because project 1e72c2ad82ab4b23bfe27ed8632290e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:59:07.652877 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2bd3e021-c091-4d52-931c-f376cfc0ab98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:07.668869 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2bd3e021-c091-4d52-931c-f376cfc0ab98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:07.668869 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1151/2344] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:59:07 2022] DELETE /identity/v3/projects/1e72c2ad82ab4b23bfe27ed8632290e2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:07.959534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:08.038779 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:08.154176 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061c9fe-6843-4817-ac38-32864c64dfdd None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:08.154471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061c9fe-6843-4817-ac38-32864c64dfdd None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:08.154999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061c9fe-6843-4817-ac38-32864c64dfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:08.178496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-d061c9fe-6843-4817-ac38-32864c64dfdd None None] MFA Rules not processed for user `1eefe0d721484433b72afca03a2c1bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:08.179702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-d061c9fe-6843-4817-ac38-32864c64dfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:08.241957 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1194/2345] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Jun 16 18:59:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:08.260586 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3e021-c091-4d52-931c-f376cfc0ab98 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:08.262351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2bd3e021-c091-4d52-931c-f376cfc0ab98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:08.347452 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3e021-c091-4d52-931c-f376cfc0ab98 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:08.352733 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865e082-66c6-4d3a-9188-92848819b3f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b45db002889846eda5b2a3e6917fcbe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:08.353514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865e082-66c6-4d3a-9188-92848819b3f1 service swift] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:08.353830 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865e082-66c6-4d3a-9188-92848819b3f1 service swift] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:08.354077 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865e082-66c6-4d3a-9188-92848819b3f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:08.363829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865e082-66c6-4d3a-9188-92848819b3f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:08.366425 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865e082-66c6-4d3a-9188-92848819b3f1 service swift] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:08.376607 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1152/2346] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Jun 16 18:59:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:59:08.965355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:09.027545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:09.559552 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:09.719746 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:10.216102 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:10.347389 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:11.068676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:11.600604 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:12.292994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:12.461751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061c9fe-6843-4817-ac38-32864c64dfdd None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:12.463263 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-d061c9fe-6843-4817-ac38-32864c64dfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:12.565854 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865e082-66c6-4d3a-9188-92848819b3f1 service swift] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:12.567406 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-7865e082-66c6-4d3a-9188-92848819b3f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:12.653301 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:12.680507 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061c9fe-6843-4817-ac38-32864c64dfdd None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:12.702122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2721d6b-2a84-4910-b278-4e313cdedecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:12.702122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2721d6b-2a84-4910-b278-4e313cdedecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:12.702122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2721d6b-2a84-4910-b278-4e313cdedecd admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:12.702122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2721d6b-2a84-4910-b278-4e313cdedecd admin admin] PATH_INFO: `/v3/users/adaea084816644ba92e365fce64881ca` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:12.707987 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2721d6b-2a84-4910-b278-4e313cdedecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=adaea084816644ba92e365fce64881ca)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:12.712543 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2721d6b-2a84-4910-b278-4e313cdedecd admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:12.751717 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865e082-66c6-4d3a-9188-92848819b3f1 service swift] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:12.758490 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19b52a-ac1f-4029-857a-ea1ca6251219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:12.759742 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19b52a-ac1f-4029-857a-ea1ca6251219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:12.760281 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19b52a-ac1f-4029-857a-ea1ca6251219 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:12.760759 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19b52a-ac1f-4029-857a-ea1ca6251219 admin admin] PATH_INFO: `/v3/users/fe802598f6ee45c29a1f93ef49795ed7` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:12.762297 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19b52a-ac1f-4029-857a-ea1ca6251219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe802598f6ee45c29a1f93ef49795ed7)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:12.765128 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19b52a-ac1f-4029-857a-ea1ca6251219 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:12.958738 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b2721d6b-2a84-4910-b278-4e313cdedecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adaea084816644ba92e365fce64881ca'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:12.959663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b2721d6b-2a84-4910-b278-4e313cdedecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adaea084816644ba92e365fce64881ca'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:13.089557 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:13.091791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2a19b52a-ac1f-4029-857a-ea1ca6251219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe802598f6ee45c29a1f93ef49795ed7'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:13.093713 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2a19b52a-ac1f-4029-857a-ea1ca6251219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe802598f6ee45c29a1f93ef49795ed7'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:13.131313 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:13.132399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b2721d6b-2a84-4910-b278-4e313cdedecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adaea084816644ba92e365fce64881ca'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:13.156167 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b2721d6b-2a84-4910-b278-4e313cdedecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adaea084816644ba92e365fce64881ca'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:13.190345 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b2721d6b-2a84-4910-b278-4e313cdedecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adaea084816644ba92e365fce64881ca'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:13.205956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1195/2347] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:59:12 2022] DELETE /identity/v3/users/adaea084816644ba92e365fce64881ca => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:13.655520 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2a19b52a-ac1f-4029-857a-ea1ca6251219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe802598f6ee45c29a1f93ef49795ed7'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:13.665492 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2a19b52a-ac1f-4029-857a-ea1ca6251219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe802598f6ee45c29a1f93ef49795ed7'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:13.680736 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2a19b52a-ac1f-4029-857a-ea1ca6251219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe802598f6ee45c29a1f93ef49795ed7'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:13.689761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1153/2348] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:59:12 2022] DELETE /identity/v3/users/fe802598f6ee45c29a1f93ef49795ed7 => generated 0 bytes in 1124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:13.694424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37271e24-ca4c-4b13-957b-b8f67c81028a None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:13.699898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37271e24-ca4c-4b13-957b-b8f67c81028a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:13.699898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37271e24-ca4c-4b13-957b-b8f67c81028a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:13.724731 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19b52a-ac1f-4029-857a-ea1ca6251219 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:13.733787 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2a19b52a-ac1f-4029-857a-ea1ca6251219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:13.735603 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-37271e24-ca4c-4b13-957b-b8f67c81028a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:13.736859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-37271e24-ca4c-4b13-957b-b8f67c81028a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:13.883208 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:13.908854 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:13.933278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1196/2349] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:13.944407 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37271e24-ca4c-4b13-957b-b8f67c81028a None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:13.946827 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-37271e24-ca4c-4b13-957b-b8f67c81028a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:14.009692 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19b52a-ac1f-4029-857a-ea1ca6251219 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:14.032649 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a80b0-a18e-4d34-b34d-50264d71e3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:14.033731 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a80b0-a18e-4d34-b34d-50264d71e3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:14.040043 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a80b0-a18e-4d34-b34d-50264d71e3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:14.045314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a80b0-a18e-4d34-b34d-50264d71e3e1 admin admin] PATH_INFO: `/v3/projects/480d915e35db434bbb0763ee2718466d` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:14.045314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a80b0-a18e-4d34-b34d-50264d71e3e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=480d915e35db434bbb0763ee2718466d)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:14.045314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a80b0-a18e-4d34-b34d-50264d71e3e1 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:14.077414 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:14.097576 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37271e24-ca4c-4b13-957b-b8f67c81028a None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:14.109523 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ef89d-4928-4ce0-8404-42d368354ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:14.110712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ef89d-4928-4ce0-8404-42d368354ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:14.111230 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ef89d-4928-4ce0-8404-42d368354ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:14.112916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ef89d-4928-4ce0-8404-42d368354ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:14.143022 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ef89d-4928-4ce0-8404-42d368354ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:14.147782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ef89d-4928-4ce0-8404-42d368354ce1 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:14.175968 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1197/2350] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:14.300990 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0e5a80b0-a18e-4d34-b34d-50264d71e3e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480d915e35db434bbb0763ee2718466d', 'request_id': 'req-0e5a80b0-a18e-4d34-b34d-50264d71e3e1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:14.320359 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0e5a80b0-a18e-4d34-b34d-50264d71e3e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480d915e35db434bbb0763ee2718466d', 'request_id': 'req-0e5a80b0-a18e-4d34-b34d-50264d71e3e1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:14.334222 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0e5a80b0-a18e-4d34-b34d-50264d71e3e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480d915e35db434bbb0763ee2718466d', 'request_id': 'req-0e5a80b0-a18e-4d34-b34d-50264d71e3e1'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:14.444032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0e5a80b0-a18e-4d34-b34d-50264d71e3e1 admin admin] The token cache is being invalidate because project 480d915e35db434bbb0763ee2718466d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:59:14.444550 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0e5a80b0-a18e-4d34-b34d-50264d71e3e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:14.445744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0e5a80b0-a18e-4d34-b34d-50264d71e3e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:14.448199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1154/2351] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:59:13 2022] DELETE /identity/v3/projects/480d915e35db434bbb0763ee2718466d => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:14.453529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ef89d-4928-4ce0-8404-42d368354ce1 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:14.480873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ef89d-4928-4ce0-8404-42d368354ce1 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:14.531882 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:14.610697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:14.676173 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea9f13-2fb8-4010-bf68-6a511a9b33a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:14.677776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea9f13-2fb8-4010-bf68-6a511a9b33a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:14.677776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea9f13-2fb8-4010-bf68-6a511a9b33a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:14.678257 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea9f13-2fb8-4010-bf68-6a511a9b33a6 admin admin] PATH_INFO: `/v3/users/68afd5fe042643b88d57715bf2c09bb7` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:14.682070 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea9f13-2fb8-4010-bf68-6a511a9b33a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68afd5fe042643b88d57715bf2c09bb7)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:14.689314 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea9f13-2fb8-4010-bf68-6a511a9b33a6 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:14.730655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:14.752606 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:14.919644 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-e3ea9f13-2fb8-4010-bf68-6a511a9b33a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68afd5fe042643b88d57715bf2c09bb7'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:14.922359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-e3ea9f13-2fb8-4010-bf68-6a511a9b33a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68afd5fe042643b88d57715bf2c09bb7'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:15.003727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-e3ea9f13-2fb8-4010-bf68-6a511a9b33a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68afd5fe042643b88d57715bf2c09bb7'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:15.024308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-e3ea9f13-2fb8-4010-bf68-6a511a9b33a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68afd5fe042643b88d57715bf2c09bb7'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:15.026231 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-e3ea9f13-2fb8-4010-bf68-6a511a9b33a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68afd5fe042643b88d57715bf2c09bb7'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:15.030077 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:15.057287 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1198/2352] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:59:14 2022] DELETE /identity/v3/users/68afd5fe042643b88d57715bf2c09bb7 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:15.147629 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a80b0-a18e-4d34-b34d-50264d71e3e1 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:15.150789 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0e5a80b0-a18e-4d34-b34d-50264d71e3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:15.165200 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:15.240222 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a80b0-a18e-4d34-b34d-50264d71e3e1 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:15.295208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:15.323368 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:15.409076 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a68017-fc00-47a2-8e20-5365e7688a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:15.410717 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a68017-fc00-47a2-8e20-5365e7688a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:15.412383 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a68017-fc00-47a2-8e20-5365e7688a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:15.412808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a68017-fc00-47a2-8e20-5365e7688a6f admin admin] PATH_INFO: `/v3/projects/551e7bc349714316851f7364d106b2c7` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:15.415874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a68017-fc00-47a2-8e20-5365e7688a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=551e7bc349714316851f7364d106b2c7)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:15.418173 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a68017-fc00-47a2-8e20-5365e7688a6f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:15.530575 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:15.598611 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:15.613454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-92a68017-fc00-47a2-8e20-5365e7688a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '551e7bc349714316851f7364d106b2c7', 'request_id': 'req-92a68017-fc00-47a2-8e20-5365e7688a6f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:15.624862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-92a68017-fc00-47a2-8e20-5365e7688a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '551e7bc349714316851f7364d106b2c7', 'request_id': 'req-92a68017-fc00-47a2-8e20-5365e7688a6f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:15.635693 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-92a68017-fc00-47a2-8e20-5365e7688a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '551e7bc349714316851f7364d106b2c7', 'request_id': 'req-92a68017-fc00-47a2-8e20-5365e7688a6f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:15.699281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea9f13-2fb8-4010-bf68-6a511a9b33a6 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:15.701607 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-e3ea9f13-2fb8-4010-bf68-6a511a9b33a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:15.721548 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea9f13-2fb8-4010-bf68-6a511a9b33a6 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:15.739449 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-92a68017-fc00-47a2-8e20-5365e7688a6f admin admin] The token cache is being invalidate because project 551e7bc349714316851f7364d106b2c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:59:15.739449 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-92a68017-fc00-47a2-8e20-5365e7688a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:15.739449 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-92a68017-fc00-47a2-8e20-5365e7688a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:15.740350 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1155/2353] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:59:15 2022] DELETE /identity/v3/projects/551e7bc349714316851f7364d106b2c7 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:59:15.745214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b26b6-ea21-4069-aac8-cc544b521cd0 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:15.745509 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b26b6-ea21-4069-aac8-cc544b521cd0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:15.745792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b26b6-ea21-4069-aac8-cc544b521cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:15.797943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6e8b26b6-ea21-4069-aac8-cc544b521cd0 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:15.801887 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6e8b26b6-ea21-4069-aac8-cc544b521cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:15.826861 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c990b-3cae-4d4d-ae79-a6513f19fe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:15.828131 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c990b-3cae-4d4d-ae79-a6513f19fe81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:15.828656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c990b-3cae-4d4d-ae79-a6513f19fe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:15.829118 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c990b-3cae-4d4d-ae79-a6513f19fe81 admin admin] PATH_INFO: `/v3/projects/bf7156cb0e4b4168af3d10b9b7a07a65` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:15.830896 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c990b-3cae-4d4d-ae79-a6513f19fe81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf7156cb0e4b4168af3d10b9b7a07a65)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:15.833376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c990b-3cae-4d4d-ae79-a6513f19fe81 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:15.908503 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1156/2354] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:15.917199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff39ba1-2e22-4c97-973b-5295fd353143 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:15.917697 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff39ba1-2e22-4c97-973b-5295fd353143 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:15.918188 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff39ba1-2e22-4c97-973b-5295fd353143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:15.946459 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-2ff39ba1-2e22-4c97-973b-5295fd353143 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:15.948023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2ff39ba1-2e22-4c97-973b-5295fd353143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:15.959191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1157/2355] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:15.966556 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff39ba1-2e22-4c97-973b-5295fd353143 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:15.975708 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:15.983143 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff39ba1-2e22-4c97-973b-5295fd353143 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:16.001951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-350c990b-3cae-4d4d-ae79-a6513f19fe81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf7156cb0e4b4168af3d10b9b7a07a65', 'request_id': 'req-350c990b-3cae-4d4d-ae79-a6513f19fe81'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:16.044091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:16.072091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-350c990b-3cae-4d4d-ae79-a6513f19fe81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf7156cb0e4b4168af3d10b9b7a07a65', 'request_id': 'req-350c990b-3cae-4d4d-ae79-a6513f19fe81'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:16.080975 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc860bc0-066e-48fb-b6cd-ab842b48f8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:16.082361 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc860bc0-066e-48fb-b6cd-ab842b48f8df admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:16.083067 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc860bc0-066e-48fb-b6cd-ab842b48f8df admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:16.083356 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc860bc0-066e-48fb-b6cd-ab842b48f8df admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:16.083565 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-350c990b-3cae-4d4d-ae79-a6513f19fe81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf7156cb0e4b4168af3d10b9b7a07a65', 'request_id': 'req-350c990b-3cae-4d4d-ae79-a6513f19fe81'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:16.084166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc860bc0-066e-48fb-b6cd-ab842b48f8df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:59:16.084510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc860bc0-066e-48fb-b6cd-ab842b48f8df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:16.086958 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc860bc0-066e-48fb-b6cd-ab842b48f8df admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:16.106142 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1158/2356] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:59:16.118073 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-350c990b-3cae-4d4d-ae79-a6513f19fe81 admin admin] The token cache is being invalidate because project bf7156cb0e4b4168af3d10b9b7a07a65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:59:16.118678 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-350c990b-3cae-4d4d-ae79-a6513f19fe81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:16.119338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-350c990b-3cae-4d4d-ae79-a6513f19fe81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:16.121922 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc860bc0-066e-48fb-b6cd-ab842b48f8df admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:16.124885 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1199/2357] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:59:15 2022] DELETE /identity/v3/projects/bf7156cb0e4b4168af3d10b9b7a07a65 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:59:16.126512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37ea7f-c24e-4250-bc76-9df856cb174f None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:16.126807 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37ea7f-c24e-4250-bc76-9df856cb174f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:16.127446 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37ea7f-c24e-4250-bc76-9df856cb174f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:16.131956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bc860bc0-066e-48fb-b6cd-ab842b48f8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:16.150684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc860bc0-066e-48fb-b6cd-ab842b48f8df admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:16.165152 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b154884-6172-4dbf-ad45-c42062d166c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:16.167264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b154884-6172-4dbf-ad45-c42062d166c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:16.167745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b154884-6172-4dbf-ad45-c42062d166c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:16.168452 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b154884-6172-4dbf-ad45-c42062d166c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:16.169410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b154884-6172-4dbf-ad45-c42062d166c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:16.171896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b154884-6172-4dbf-ad45-c42062d166c4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:16.174484 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-2b37ea7f-c24e-4250-bc76-9df856cb174f None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:16.175704 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2b37ea7f-c24e-4250-bc76-9df856cb174f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:16.209632 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1200/2358] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:16.220184 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586e00-d745-4a93-a14d-a86a70d434f5 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:16.220688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586e00-d745-4a93-a14d-a86a70d434f5 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:16.221349 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586e00-d745-4a93-a14d-a86a70d434f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:16.246009 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-53586e00-d745-4a93-a14d-a86a70d434f5 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:16.247646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-53586e00-d745-4a93-a14d-a86a70d434f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:16.262661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1201/2359] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:59:16.268052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53586e00-d745-4a93-a14d-a86a70d434f5 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:16.279269 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:16.286085 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53586e00-d745-4a93-a14d-a86a70d434f5 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:16.293487 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee4aff-2e73-44ea-a333-5f532c51088f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:16.294717 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee4aff-2e73-44ea-a333-5f532c51088f admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:16.295325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee4aff-2e73-44ea-a333-5f532c51088f admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:16.295325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee4aff-2e73-44ea-a333-5f532c51088f admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:16.296182 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee4aff-2e73-44ea-a333-5f532c51088f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:59:16.296380 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee4aff-2e73-44ea-a333-5f532c51088f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:16.298252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee4aff-2e73-44ea-a333-5f532c51088f admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:16.314077 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1202/2360] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:59:16.318314 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee4aff-2e73-44ea-a333-5f532c51088f admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:16.327350 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1159/2361] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:59:16 2022] POST /identity/v3/projects => generated 373 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:59:16.328652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b154884-6172-4dbf-ad45-c42062d166c4 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:16.337603 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee4aff-2e73-44ea-a333-5f532c51088f admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:16.440120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:16.446476 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf7e36-5523-4661-90f0-524acc60b56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:16.447703 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf7e36-5523-4661-90f0-524acc60b56d admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:16.448405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf7e36-5523-4661-90f0-524acc60b56d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:16.448928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf7e36-5523-4661-90f0-524acc60b56d admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:16.450488 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf7e36-5523-4661-90f0-524acc60b56d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:16.453261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf7e36-5523-4661-90f0-524acc60b56d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:16.484676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b154884-6172-4dbf-ad45-c42062d166c4 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:16.502441 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c048d3d-e61f-469d-8936-07de5f9ee7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:16.503149 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c048d3d-e61f-469d-8936-07de5f9ee7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:16.503569 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c048d3d-e61f-469d-8936-07de5f9ee7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:16.503746 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c048d3d-e61f-469d-8936-07de5f9ee7a5 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:16.504489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c048d3d-e61f-469d-8936-07de5f9ee7a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:16.512841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c048d3d-e61f-469d-8936-07de5f9ee7a5 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:16.531588 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:16.623199 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1203/2362] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:59:16 2022] POST /identity/v3/projects => generated 385 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:59:16.637370 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf7e36-5523-4661-90f0-524acc60b56d admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:16.642271 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1160/2363] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:59:16 2022] POST /identity/v3/users => generated 287 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:59:16.643435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c048d3d-e61f-469d-8936-07de5f9ee7a5 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:16.661027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c048d3d-e61f-469d-8936-07de5f9ee7a5 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:16.765562 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:16.792708 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e38ad-e987-495e-b93b-96d7e0a2a98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:16.793705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e38ad-e987-495e-b93b-96d7e0a2a98a admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:16.794204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e38ad-e987-495e-b93b-96d7e0a2a98a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:16.794488 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e38ad-e987-495e-b93b-96d7e0a2a98a admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:16.795238 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e38ad-e987-495e-b93b-96d7e0a2a98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:16.797204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e38ad-e987-495e-b93b-96d7e0a2a98a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:16.849522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1161/2364] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:59:16.854232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e38ad-e987-495e-b93b-96d7e0a2a98a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:16.871893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf7e36-5523-4661-90f0-524acc60b56d admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:16.874589 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e38ad-e987-495e-b93b-96d7e0a2a98a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:16.880139 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:16.895568 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977faa71-9eca-4948-aa57-1f26a31adf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:16.896775 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977faa71-9eca-4948-aa57-1f26a31adf48 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:16.897273 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977faa71-9eca-4948-aa57-1f26a31adf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:16.897771 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977faa71-9eca-4948-aa57-1f26a31adf48 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:16.898796 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977faa71-9eca-4948-aa57-1f26a31adf48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:16.903755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977faa71-9eca-4948-aa57-1f26a31adf48 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:16.904030 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d3a2f-f52b-40fe-8208-853017009c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:16.904481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d3a2f-f52b-40fe-8208-853017009c8c admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:16.904781 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d3a2f-f52b-40fe-8208-853017009c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:16.905067 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d3a2f-f52b-40fe-8208-853017009c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:16.905923 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d3a2f-f52b-40fe-8208-853017009c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:16.907571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d3a2f-f52b-40fe-8208-853017009c8c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:16.951638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1162/2365] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:59:16.957913 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d3a2f-f52b-40fe-8208-853017009c8c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:16.987121 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d3a2f-f52b-40fe-8208-853017009c8c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:16.996658 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f2aa2-4cd5-41a4-9f97-cc3d98b57c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:17.000317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f2aa2-4cd5-41a4-9f97-cc3d98b57c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:17.000317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f2aa2-4cd5-41a4-9f97-cc3d98b57c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:17.000317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f2aa2-4cd5-41a4-9f97-cc3d98b57c97 admin admin] PATH_INFO: `/v3/projects/801d709016a9463da13c9ea6c6d988a4/users/158888a6de024d888cf93ba5c4b245f0/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:17.032568 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f2aa2-4cd5-41a4-9f97-cc3d98b57c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=801d709016a9463da13c9ea6c6d988a4, user_id=158888a6de024d888cf93ba5c4b245f0, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:17.037770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f2aa2-4cd5-41a4-9f97-cc3d98b57c97 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:17.056806 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1204/2366] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:59:16 2022] POST /identity/v3/users => generated 293 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:59:17.063087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977faa71-9eca-4948-aa57-1f26a31adf48 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:17.077445 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:17.110090 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977faa71-9eca-4948-aa57-1f26a31adf48 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:17.127978 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1163/2367] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:59:16 2022] PUT /identity/v3/projects/801d709016a9463da13c9ea6c6d988a4/users/158888a6de024d888cf93ba5c4b245f0/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:17.139997 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98144c0a-9734-4eed-82fe-b672d36d1af0 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:17.144517 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98144c0a-9734-4eed-82fe-b672d36d1af0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:17.144517 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98144c0a-9734-4eed-82fe-b672d36d1af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:17.186397 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-98144c0a-9734-4eed-82fe-b672d36d1af0 None None] MFA Rules not processed for user `158888a6de024d888cf93ba5c4b245f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:17.191249 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-98144c0a-9734-4eed-82fe-b672d36d1af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:17.198981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:17.287977 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2f1cf-823d-4942-94ca-8d8e45f6bf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:17.289186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2f1cf-823d-4942-94ca-8d8e45f6bf39 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:17.289737 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2f1cf-823d-4942-94ca-8d8e45f6bf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:17.290280 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2f1cf-823d-4942-94ca-8d8e45f6bf39 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:17.292078 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2f1cf-823d-4942-94ca-8d8e45f6bf39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:17.298528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2f1cf-823d-4942-94ca-8d8e45f6bf39 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:17.310218 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1164/2368] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:59:17.327835 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1205/2369] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:59:17.330032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98144c0a-9734-4eed-82fe-b672d36d1af0 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:17.331592 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-98144c0a-9734-4eed-82fe-b672d36d1af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:17.331909 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2f1cf-823d-4942-94ca-8d8e45f6bf39 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:17.353163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2f1cf-823d-4942-94ca-8d8e45f6bf39 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:17.362038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c675e4c-d124-4997-8727-fe998e25468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:17.364598 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c675e4c-d124-4997-8727-fe998e25468c admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:17.365375 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c675e4c-d124-4997-8727-fe998e25468c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:17.365913 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c675e4c-d124-4997-8727-fe998e25468c admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:17.367308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c675e4c-d124-4997-8727-fe998e25468c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:17.370169 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c675e4c-d124-4997-8727-fe998e25468c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:17.386488 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1206/2370] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:59:17.387904 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c675e4c-d124-4997-8727-fe998e25468c admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:17.407618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c675e4c-d124-4997-8727-fe998e25468c admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:17.414491 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88263b8d-7e7a-4a73-a0e4-40b4a012a490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:17.415708 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88263b8d-7e7a-4a73-a0e4-40b4a012a490 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:17.416202 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88263b8d-7e7a-4a73-a0e4-40b4a012a490 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:17.416728 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88263b8d-7e7a-4a73-a0e4-40b4a012a490 admin admin] PATH_INFO: `/v3/projects/789f6969e57b4678a93abe8b3feb4daa/users/97735676cd5046719345b79d8035ca1c/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:17.436858 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88263b8d-7e7a-4a73-a0e4-40b4a012a490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=789f6969e57b4678a93abe8b3feb4daa, user_id=97735676cd5046719345b79d8035ca1c, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:17.439992 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88263b8d-7e7a-4a73-a0e4-40b4a012a490 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:17.460601 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:17.461021 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98144c0a-9734-4eed-82fe-b672d36d1af0 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:17.469346 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffbe1f-948e-4662-9eca-5a9d5655a27a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:17.472796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffbe1f-948e-4662-9eca-5a9d5655a27a service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:17.472796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffbe1f-948e-4662-9eca-5a9d5655a27a service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:17.472796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffbe1f-948e-4662-9eca-5a9d5655a27a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:17.494886 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffbe1f-948e-4662-9eca-5a9d5655a27a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:17.497205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffbe1f-948e-4662-9eca-5a9d5655a27a service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:17.524021 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1165/2371] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:17.542036 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:17.570006 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1207/2372] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:59:17 2022] PUT /identity/v3/projects/789f6969e57b4678a93abe8b3feb4daa/users/97735676cd5046719345b79d8035ca1c/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:17.581428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ead51-4e83-468e-a5af-f22e417819e7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:17.581848 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ead51-4e83-468e-a5af-f22e417819e7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:17.582143 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ead51-4e83-468e-a5af-f22e417819e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:17.629848 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a76ead51-4e83-468e-a5af-f22e417819e7 None None] MFA Rules not processed for user `97735676cd5046719345b79d8035ca1c`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:17.634263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a76ead51-4e83-468e-a5af-f22e417819e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:17.785691 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1166/2373] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:17.794949 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88263b8d-7e7a-4a73-a0e4-40b4a012a490 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:17.796264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-88263b8d-7e7a-4a73-a0e4-40b4a012a490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:17.869724 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88263b8d-7e7a-4a73-a0e4-40b4a012a490 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:17.880555 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2eac1d-9594-4937-8917-79e3e6922cfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:17.885042 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eac1d-9594-4937-8917-79e3e6922cfc service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:17.886144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eac1d-9594-4937-8917-79e3e6922cfc service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:17.887463 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eac1d-9594-4937-8917-79e3e6922cfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:17.905446 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2eac1d-9594-4937-8917-79e3e6922cfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:17.908693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2eac1d-9594-4937-8917-79e3e6922cfc service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:17.928306 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1208/2374] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:18.070326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:18.672993 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:19.192835 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:19.457960 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:20.359805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:20.415781 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:20.838570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:20.986906 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:21.154516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:21.328573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:21.954319 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:22.169594 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:22.536049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:22.658201 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:23.414671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72195f1b-dbdf-44c8-8656-23cc5d539129 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:23.415291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72195f1b-dbdf-44c8-8656-23cc5d539129 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:23.415291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72195f1b-dbdf-44c8-8656-23cc5d539129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:23.442863 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-72195f1b-dbdf-44c8-8656-23cc5d539129 None None] MFA Rules not processed for user `1eefe0d721484433b72afca03a2c1bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:23.444180 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-72195f1b-dbdf-44c8-8656-23cc5d539129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:23.505052 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1167/2375] 10.222.0.93 () {58 vars in 967 bytes} [Thu Jun 16 18:59:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:23.519515 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2eac1d-9594-4937-8917-79e3e6922cfc service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:23.521013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-0d2eac1d-9594-4937-8917-79e3e6922cfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:23.586640 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:23.592554 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2eac1d-9594-4937-8917-79e3e6922cfc service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:23.597638 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fdf77-c4dd-4d1c-9103-24b118e239f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b45db002889846eda5b2a3e6917fcbe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:23.598322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fdf77-c4dd-4d1c-9103-24b118e239f0 service swift] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:23.598630 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fdf77-c4dd-4d1c-9103-24b118e239f0 service swift] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:23.598895 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fdf77-c4dd-4d1c-9103-24b118e239f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:23.610533 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fdf77-c4dd-4d1c-9103-24b118e239f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:23.612041 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fdf77-c4dd-4d1c-9103-24b118e239f0 service swift] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:23.620612 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1209/2376] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Jun 16 18:59:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:59:23.638283 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:24.020826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72195f1b-dbdf-44c8-8656-23cc5d539129 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:24.090708 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72195f1b-dbdf-44c8-8656-23cc5d539129 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:24.095494 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc0e94-369c-46d3-9eee-6f1215a89360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:24.096390 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc0e94-369c-46d3-9eee-6f1215a89360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:24.096693 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc0e94-369c-46d3-9eee-6f1215a89360 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:24.097158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc0e94-369c-46d3-9eee-6f1215a89360 admin admin] PATH_INFO: `/v3/users/158888a6de024d888cf93ba5c4b245f0` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:24.098363 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc0e94-369c-46d3-9eee-6f1215a89360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=158888a6de024d888cf93ba5c4b245f0)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:24.100388 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc0e94-369c-46d3-9eee-6f1215a89360 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:24.329986 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0acc0e94-369c-46d3-9eee-6f1215a89360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '158888a6de024d888cf93ba5c4b245f0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:24.330759 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0acc0e94-369c-46d3-9eee-6f1215a89360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '158888a6de024d888cf93ba5c4b245f0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:24.399746 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0acc0e94-369c-46d3-9eee-6f1215a89360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '158888a6de024d888cf93ba5c4b245f0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:24.412938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0acc0e94-369c-46d3-9eee-6f1215a89360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '158888a6de024d888cf93ba5c4b245f0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:24.427364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:24.439739 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-0acc0e94-369c-46d3-9eee-6f1215a89360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '158888a6de024d888cf93ba5c4b245f0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:24.457424 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1168/2377] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:59:24 2022] DELETE /identity/v3/users/158888a6de024d888cf93ba5c4b245f0 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:24.458047 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e5899-ff47-440d-ac7e-5986f4e9e01a None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:24.458346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e5899-ff47-440d-ac7e-5986f4e9e01a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:24.458626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e5899-ff47-440d-ac7e-5986f4e9e01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:24.492374 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-6f3e5899-ff47-440d-ac7e-5986f4e9e01a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:24.499865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:24.501559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6f3e5899-ff47-440d-ac7e-5986f4e9e01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:24.573746 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1210/2378] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:24.592900 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc0e94-369c-46d3-9eee-6f1215a89360 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:24.594788 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0acc0e94-369c-46d3-9eee-6f1215a89360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:24.675591 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc0e94-369c-46d3-9eee-6f1215a89360 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:24.687176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d01b1-ae7f-48f1-8f56-049b96b26406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:24.688103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d01b1-ae7f-48f1-8f56-049b96b26406 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:24.688624 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d01b1-ae7f-48f1-8f56-049b96b26406 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:24.689071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d01b1-ae7f-48f1-8f56-049b96b26406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:24.714328 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d01b1-ae7f-48f1-8f56-049b96b26406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:24.715822 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d01b1-ae7f-48f1-8f56-049b96b26406 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:24.730661 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1169/2379] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:25.054986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:25.308984 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e5899-ff47-440d-ac7e-5986f4e9e01a None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:25.310456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6f3e5899-ff47-440d-ac7e-5986f4e9e01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:25.324762 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e5899-ff47-440d-ac7e-5986f4e9e01a None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:25.329527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a1a9b-f0b2-4b01-8742-341edba71435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:25.334243 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a1a9b-f0b2-4b01-8742-341edba71435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:25.334243 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a1a9b-f0b2-4b01-8742-341edba71435 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:25.334243 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a1a9b-f0b2-4b01-8742-341edba71435 admin admin] PATH_INFO: `/v3/projects/801d709016a9463da13c9ea6c6d988a4` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:25.334243 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a1a9b-f0b2-4b01-8742-341edba71435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=801d709016a9463da13c9ea6c6d988a4)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:25.335436 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a1a9b-f0b2-4b01-8742-341edba71435 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:25.480164 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-d60a1a9b-f0b2-4b01-8742-341edba71435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '801d709016a9463da13c9ea6c6d988a4', 'request_id': 'req-d60a1a9b-f0b2-4b01-8742-341edba71435'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:25.621830 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-d60a1a9b-f0b2-4b01-8742-341edba71435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '801d709016a9463da13c9ea6c6d988a4', 'request_id': 'req-d60a1a9b-f0b2-4b01-8742-341edba71435'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:25.628759 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-d60a1a9b-f0b2-4b01-8742-341edba71435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '801d709016a9463da13c9ea6c6d988a4', 'request_id': 'req-d60a1a9b-f0b2-4b01-8742-341edba71435'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:25.639815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-d60a1a9b-f0b2-4b01-8742-341edba71435 admin admin] The token cache is being invalidate because project 801d709016a9463da13c9ea6c6d988a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:59:25.640108 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-d60a1a9b-f0b2-4b01-8742-341edba71435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:25.640771 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-d60a1a9b-f0b2-4b01-8742-341edba71435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:25.642388 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1211/2380] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:59:25 2022] DELETE /identity/v3/projects/801d709016a9463da13c9ea6c6d988a4 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:59:25.647269 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe8386-012c-408f-b86b-3197b1b5c499 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:25.648404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe8386-012c-408f-b86b-3197b1b5c499 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:25.648404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe8386-012c-408f-b86b-3197b1b5c499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:25.667992 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-bdfe8386-012c-408f-b86b-3197b1b5c499 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:25.669266 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bdfe8386-012c-408f-b86b-3197b1b5c499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:25.727099 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1170/2381] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:25.735644 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56dfca-840e-47db-ae64-236f0ad6a0a7 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:25.735937 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56dfca-840e-47db-ae64-236f0ad6a0a7 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:25.736219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56dfca-840e-47db-ae64-236f0ad6a0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:25.756893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-da56dfca-840e-47db-ae64-236f0ad6a0a7 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:25.758589 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-da56dfca-840e-47db-ae64-236f0ad6a0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:25.768707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1212/2382] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:25.793421 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe8386-012c-408f-b86b-3197b1b5c499 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:25.803317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe8386-012c-408f-b86b-3197b1b5c499 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:25.808104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91a67b-2ad5-40f5-bec0-1d4f092a10ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:25.813645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91a67b-2ad5-40f5-bec0-1d4f092a10ff admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:25.813645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91a67b-2ad5-40f5-bec0-1d4f092a10ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:25.813645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91a67b-2ad5-40f5-bec0-1d4f092a10ff admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:25.813645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91a67b-2ad5-40f5-bec0-1d4f092a10ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:59:25.813645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91a67b-2ad5-40f5-bec0-1d4f092a10ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:25.814663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91a67b-2ad5-40f5-bec0-1d4f092a10ff admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:25.827130 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1171/2383] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:59:25.833691 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56dfca-840e-47db-ae64-236f0ad6a0a7 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:25.843780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56dfca-840e-47db-ae64-236f0ad6a0a7 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:25.848782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0f219-0daf-4849-beb6-eb1b751c03fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:25.849688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0f219-0daf-4849-beb6-eb1b751c03fa admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:25.849978 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0f219-0daf-4849-beb6-eb1b751c03fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:25.850257 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0f219-0daf-4849-beb6-eb1b751c03fa admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:25.850959 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0f219-0daf-4849-beb6-eb1b751c03fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:25.852915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0f219-0daf-4849-beb6-eb1b751c03fa admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:25.865802 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:25.964560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1213/2384] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:59:25 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:59:25.966985 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91a67b-2ad5-40f5-bec0-1d4f092a10ff admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:25.978523 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91a67b-2ad5-40f5-bec0-1d4f092a10ff admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:26.039550 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eefc4c-86f5-46b0-847c-5167f892464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:26.040230 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eefc4c-86f5-46b0-847c-5167f892464b admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:26.040552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eefc4c-86f5-46b0-847c-5167f892464b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:26.040833 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eefc4c-86f5-46b0-847c-5167f892464b admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:26.041532 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eefc4c-86f5-46b0-847c-5167f892464b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:26.043628 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eefc4c-86f5-46b0-847c-5167f892464b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:26.141003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1172/2385] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:59:25 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:59:26.145134 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0f219-0daf-4849-beb6-eb1b751c03fa admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:26.155456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0f219-0daf-4849-beb6-eb1b751c03fa admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:26.160166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17474fc-b605-405c-959a-ffb585ba3da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:26.160854 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17474fc-b605-405c-959a-ffb585ba3da4 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:26.161143 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17474fc-b605-405c-959a-ffb585ba3da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:26.161427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17474fc-b605-405c-959a-ffb585ba3da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:26.162244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17474fc-b605-405c-959a-ffb585ba3da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:26.163928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17474fc-b605-405c-959a-ffb585ba3da4 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:26.174585 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1214/2386] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:59:26.178758 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eefc4c-86f5-46b0-847c-5167f892464b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:26.189669 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eefc4c-86f5-46b0-847c-5167f892464b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:26.197558 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b6be0-7260-45af-a3b1-39ded32bb696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:26.198823 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b6be0-7260-45af-a3b1-39ded32bb696 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:26.199113 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b6be0-7260-45af-a3b1-39ded32bb696 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:26.199435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b6be0-7260-45af-a3b1-39ded32bb696 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:26.200242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b6be0-7260-45af-a3b1-39ded32bb696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:26.206376 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b6be0-7260-45af-a3b1-39ded32bb696 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:26.215123 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1173/2387] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:59:26.219211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17474fc-b605-405c-959a-ffb585ba3da4 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:26.227774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:26.232173 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17474fc-b605-405c-959a-ffb585ba3da4 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:26.237340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6578ab-551a-41f8-9097-e152fc1b4110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:26.238528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6578ab-551a-41f8-9097-e152fc1b4110 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:26.238823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6578ab-551a-41f8-9097-e152fc1b4110 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:26.239098 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6578ab-551a-41f8-9097-e152fc1b4110 admin admin] PATH_INFO: `/v3/projects/3edb4592dbcf421faf5813b9518e3bfa/users/c666f383cb3348e29f91c296d8e8c9f0/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:26.256209 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6578ab-551a-41f8-9097-e152fc1b4110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3edb4592dbcf421faf5813b9518e3bfa, user_id=c666f383cb3348e29f91c296d8e8c9f0, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:26.259786 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6578ab-551a-41f8-9097-e152fc1b4110 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:26.359259 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1215/2388] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:59:26 2022] PUT /identity/v3/projects/3edb4592dbcf421faf5813b9518e3bfa/users/c666f383cb3348e29f91c296d8e8c9f0/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:59:26.369628 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a9605-14fd-4b4d-908a-c9ceb498e01d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:26.370175 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a9605-14fd-4b4d-908a-c9ceb498e01d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:26.370463 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a9605-14fd-4b4d-908a-c9ceb498e01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:26.401831 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-491a9605-14fd-4b4d-908a-c9ceb498e01d None None] MFA Rules not processed for user `c666f383cb3348e29f91c296d8e8c9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:26.401831 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-491a9605-14fd-4b4d-908a-c9ceb498e01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:26.462856 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1174/2389] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:59:26.467893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6578ab-551a-41f8-9097-e152fc1b4110 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:26.532972 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6578ab-551a-41f8-9097-e152fc1b4110 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:26.539183 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc730c-9b96-4254-9aa4-819f6961a169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:26.539183 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc730c-9b96-4254-9aa4-819f6961a169 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:26.539398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc730c-9b96-4254-9aa4-819f6961a169 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:26.539611 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc730c-9b96-4254-9aa4-819f6961a169 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:26.540314 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc730c-9b96-4254-9aa4-819f6961a169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:26.542305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc730c-9b96-4254-9aa4-819f6961a169 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:26.643494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1216/2390] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:59:26 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:59:26.645294 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a9605-14fd-4b4d-908a-c9ceb498e01d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:26.658408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a9605-14fd-4b4d-908a-c9ceb498e01d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:26.661931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:26.724375 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6fd30-0269-47af-bd58-844e9056ecfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:26.725093 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6fd30-0269-47af-bd58-844e9056ecfa admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:26.725379 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6fd30-0269-47af-bd58-844e9056ecfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:26.725659 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6fd30-0269-47af-bd58-844e9056ecfa admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:26.726422 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6fd30-0269-47af-bd58-844e9056ecfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:26.728412 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6fd30-0269-47af-bd58-844e9056ecfa admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:26.815258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1175/2391] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:59:26 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:59:26.819327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc730c-9b96-4254-9aa4-819f6961a169 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:26.833592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc730c-9b96-4254-9aa4-819f6961a169 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:26.839106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321fe70-389c-425b-90a6-9471f859ac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:26.848569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321fe70-389c-425b-90a6-9471f859ac5d admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:26.848569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321fe70-389c-425b-90a6-9471f859ac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:26.848569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321fe70-389c-425b-90a6-9471f859ac5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:26.848569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321fe70-389c-425b-90a6-9471f859ac5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:26.848569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321fe70-389c-425b-90a6-9471f859ac5d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:26.857321 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1217/2392] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:59:26.861209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6fd30-0269-47af-bd58-844e9056ecfa admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:26.873234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6fd30-0269-47af-bd58-844e9056ecfa admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:26.878458 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a619fb-f458-4fa0-b6f4-fedf7ca8594a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:26.879204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a619fb-f458-4fa0-b6f4-fedf7ca8594a admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:26.879657 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a619fb-f458-4fa0-b6f4-fedf7ca8594a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:26.879982 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a619fb-f458-4fa0-b6f4-fedf7ca8594a admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:26.880847 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a619fb-f458-4fa0-b6f4-fedf7ca8594a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:26.885321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a619fb-f458-4fa0-b6f4-fedf7ca8594a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:26.896159 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1176/2393] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:59:26.900528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321fe70-389c-425b-90a6-9471f859ac5d admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:26.911020 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321fe70-389c-425b-90a6-9471f859ac5d admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:26.915922 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce9a94-afdf-473d-92a0-7234632bb02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:26.916844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce9a94-afdf-473d-92a0-7234632bb02a admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:26.917184 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce9a94-afdf-473d-92a0-7234632bb02a admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:26.917425 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce9a94-afdf-473d-92a0-7234632bb02a admin admin] PATH_INFO: `/v3/projects/ea2e4cc5832f47eab2156633a3267821/users/7bce7f0451464fb094f025e0a0cd0803/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:26.932831 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce9a94-afdf-473d-92a0-7234632bb02a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea2e4cc5832f47eab2156633a3267821, user_id=7bce7f0451464fb094f025e0a0cd0803, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:26.935474 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce9a94-afdf-473d-92a0-7234632bb02a admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:26.940571 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:26.952541 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a619fb-f458-4fa0-b6f4-fedf7ca8594a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:26.955269 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f2a619fb-f458-4fa0-b6f4-fedf7ca8594a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:26.973943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a619fb-f458-4fa0-b6f4-fedf7ca8594a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:26.979392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fedc5-5e72-47c0-9b0c-45468315d75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:26.980281 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fedc5-5e72-47c0-9b0c-45468315d75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:26.980638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fedc5-5e72-47c0-9b0c-45468315d75b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:26.981269 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fedc5-5e72-47c0-9b0c-45468315d75b admin admin] PATH_INFO: `/v3/users/e3818b63658b4c7588db8b4c4a25f16c` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:26.982321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fedc5-5e72-47c0-9b0c-45468315d75b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3818b63658b4c7588db8b4c4a25f16c)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:26.985900 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fedc5-5e72-47c0-9b0c-45468315d75b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:27.029016 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1218/2394] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:59:26 2022] PUT /identity/v3/projects/ea2e4cc5832f47eab2156633a3267821/users/7bce7f0451464fb094f025e0a0cd0803/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:59:27.039733 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655f517-26ad-48ab-87b4-ede549306279 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:27.040388 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655f517-26ad-48ab-87b4-ede549306279 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:27.040994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655f517-26ad-48ab-87b4-ede549306279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:27.083753 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:27.092674 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-c655f517-26ad-48ab-87b4-ede549306279 None None] MFA Rules not processed for user `7bce7f0451464fb094f025e0a0cd0803`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:27.093916 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c655f517-26ad-48ab-87b4-ede549306279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:27.173178 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1219/2395] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:27.181522 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655f517-26ad-48ab-87b4-ede549306279 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:27.215972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-631fedc5-5e72-47c0-9b0c-45468315d75b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3818b63658b4c7588db8b4c4a25f16c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:27.216987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-631fedc5-5e72-47c0-9b0c-45468315d75b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3818b63658b4c7588db8b4c4a25f16c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:27.301130 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655f517-26ad-48ab-87b4-ede549306279 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:27.307085 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6ad96-fac3-403b-9fe8-4b14136ff45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:27.307640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-631fedc5-5e72-47c0-9b0c-45468315d75b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3818b63658b4c7588db8b4c4a25f16c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:27.307764 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6ad96-fac3-403b-9fe8-4b14136ff45a admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:27.308053 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6ad96-fac3-403b-9fe8-4b14136ff45a admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:27.308306 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6ad96-fac3-403b-9fe8-4b14136ff45a admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:27.309051 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6ad96-fac3-403b-9fe8-4b14136ff45a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:27.311008 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6ad96-fac3-403b-9fe8-4b14136ff45a admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:27.317366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-631fedc5-5e72-47c0-9b0c-45468315d75b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3818b63658b4c7588db8b4c4a25f16c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:27.332365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-631fedc5-5e72-47c0-9b0c-45468315d75b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3818b63658b4c7588db8b4c4a25f16c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:27.339526 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1177/2396] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:59:26 2022] DELETE /identity/v3/users/e3818b63658b4c7588db8b4c4a25f16c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:27.340410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fedc5-5e72-47c0-9b0c-45468315d75b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:27.341850 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-631fedc5-5e72-47c0-9b0c-45468315d75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:27.417837 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fedc5-5e72-47c0-9b0c-45468315d75b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:27.424314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ac66c-9b15-439a-9790-e45af72fd6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:27.429210 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ac66c-9b15-439a-9790-e45af72fd6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:27.429708 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ac66c-9b15-439a-9790-e45af72fd6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:27.430004 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ac66c-9b15-439a-9790-e45af72fd6d8 admin admin] PATH_INFO: `/v3/users/97735676cd5046719345b79d8035ca1c` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:27.432402 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ac66c-9b15-439a-9790-e45af72fd6d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97735676cd5046719345b79d8035ca1c)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:27.434663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ac66c-9b15-439a-9790-e45af72fd6d8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:27.436940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1220/2397] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:59:27 2022] POST /identity/v3/projects => generated 385 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:59:27.441139 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6ad96-fac3-403b-9fe8-4b14136ff45a admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:27.446433 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-60a6ad96-fac3-403b-9fe8-4b14136ff45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:27.528808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6ad96-fac3-403b-9fe8-4b14136ff45a admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:27.533715 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64b571-4cf4-4da1-81fa-adc46f1eb91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:27.537888 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64b571-4cf4-4da1-81fa-adc46f1eb91f admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:27.537888 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64b571-4cf4-4da1-81fa-adc46f1eb91f admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:27.537888 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64b571-4cf4-4da1-81fa-adc46f1eb91f admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:27.537888 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64b571-4cf4-4da1-81fa-adc46f1eb91f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:27.537888 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64b571-4cf4-4da1-81fa-adc46f1eb91f admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:27.651511 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1221/2398] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:59:27 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:59:27.651511 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64b571-4cf4-4da1-81fa-adc46f1eb91f admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:27.651511 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-0f64b571-4cf4-4da1-81fa-adc46f1eb91f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:27.668190 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64b571-4cf4-4da1-81fa-adc46f1eb91f admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:27.674107 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360a7bb-f512-4c26-a9a7-c259deb69a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:27.675076 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360a7bb-f512-4c26-a9a7-c259deb69a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:27.675518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360a7bb-f512-4c26-a9a7-c259deb69a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:27.675717 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360a7bb-f512-4c26-a9a7-c259deb69a14 admin admin] PATH_INFO: `/v3/projects/42b140f4931a48c9aed1c1e9e3ab280b` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:27.676883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360a7bb-f512-4c26-a9a7-c259deb69a14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b140f4931a48c9aed1c1e9e3ab280b)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:27.679465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360a7bb-f512-4c26-a9a7-c259deb69a14 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:27.773615 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c58ac66c-9b15-439a-9790-e45af72fd6d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97735676cd5046719345b79d8035ca1c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:27.775317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c58ac66c-9b15-439a-9790-e45af72fd6d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97735676cd5046719345b79d8035ca1c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:27.843418 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b360a7bb-f512-4c26-a9a7-c259deb69a14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b140f4931a48c9aed1c1e9e3ab280b', 'request_id': 'req-b360a7bb-f512-4c26-a9a7-c259deb69a14'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:27.855104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c58ac66c-9b15-439a-9790-e45af72fd6d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97735676cd5046719345b79d8035ca1c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:27.863075 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c58ac66c-9b15-439a-9790-e45af72fd6d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97735676cd5046719345b79d8035ca1c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:27.875274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c58ac66c-9b15-439a-9790-e45af72fd6d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97735676cd5046719345b79d8035ca1c'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:27.881242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1178/2399] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:59:27 2022] DELETE /identity/v3/users/97735676cd5046719345b79d8035ca1c => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:27.885400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ac66c-9b15-439a-9790-e45af72fd6d8 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:27.886768 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c58ac66c-9b15-439a-9790-e45af72fd6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:27.929025 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:27.952915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ac66c-9b15-439a-9790-e45af72fd6d8 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:27.957722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708bec1-2d79-4daa-92ed-611ee8dec773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:27.958391 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708bec1-2d79-4daa-92ed-611ee8dec773 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:27.958680 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708bec1-2d79-4daa-92ed-611ee8dec773 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:27.958968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708bec1-2d79-4daa-92ed-611ee8dec773 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:27.959700 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708bec1-2d79-4daa-92ed-611ee8dec773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:27.962031 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708bec1-2d79-4daa-92ed-611ee8dec773 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:27.962394 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b360a7bb-f512-4c26-a9a7-c259deb69a14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b140f4931a48c9aed1c1e9e3ab280b', 'request_id': 'req-b360a7bb-f512-4c26-a9a7-c259deb69a14'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:27.970359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b360a7bb-f512-4c26-a9a7-c259deb69a14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b140f4931a48c9aed1c1e9e3ab280b', 'request_id': 'req-b360a7bb-f512-4c26-a9a7-c259deb69a14'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:27.972647 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1179/2400] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:59:27.973998 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041bdbd-4915-415b-9d86-69412c06c275 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:27.974294 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041bdbd-4915-415b-9d86-69412c06c275 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:27.974584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041bdbd-4915-415b-9d86-69412c06c275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:27.985774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b360a7bb-f512-4c26-a9a7-c259deb69a14 admin admin] The token cache is being invalidate because project 42b140f4931a48c9aed1c1e9e3ab280b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:59:27.986067 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b360a7bb-f512-4c26-a9a7-c259deb69a14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:27.986750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b360a7bb-f512-4c26-a9a7-c259deb69a14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:27.988323 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1222/2401] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:59:27 2022] DELETE /identity/v3/projects/42b140f4931a48c9aed1c1e9e3ab280b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:27.989099 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360a7bb-f512-4c26-a9a7-c259deb69a14 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:27.990381 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b360a7bb-f512-4c26-a9a7-c259deb69a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:27.993893 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-3041bdbd-4915-415b-9d86-69412c06c275 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:27.995547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3041bdbd-4915-415b-9d86-69412c06c275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:28.005213 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1180/2402] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:28.010894 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8719f-b32f-4307-a16d-168169cba995 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:28.010894 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8719f-b32f-4307-a16d-168169cba995 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:28.010894 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8719f-b32f-4307-a16d-168169cba995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:28.027297 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-bcc8719f-b32f-4307-a16d-168169cba995 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:28.028556 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bcc8719f-b32f-4307-a16d-168169cba995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:28.037046 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1181/2403] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:28.038400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8719f-b32f-4307-a16d-168169cba995 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:28.039858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bcc8719f-b32f-4307-a16d-168169cba995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:28.067783 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360a7bb-f512-4c26-a9a7-c259deb69a14 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:28.072880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:28.075394 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c98a8-b372-4a7d-80d5-6ea6cc508eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:28.076360 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c98a8-b372-4a7d-80d5-6ea6cc508eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:28.076701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c98a8-b372-4a7d-80d5-6ea6cc508eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:28.076984 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c98a8-b372-4a7d-80d5-6ea6cc508eb8 admin admin] PATH_INFO: `/v3/projects/0e45823de37d4462b6f18b92430cb90c/users/faad27cbaf0d42f58292b393ba59fa2d/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:28.092031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c98a8-b372-4a7d-80d5-6ea6cc508eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e45823de37d4462b6f18b92430cb90c, user_id=faad27cbaf0d42f58292b393ba59fa2d, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:28.094773 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c98a8-b372-4a7d-80d5-6ea6cc508eb8 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:28.099798 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8719f-b32f-4307-a16d-168169cba995 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:28.103643 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29048a80-1982-4f81-bc56-8e4132ea0c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:28.104298 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29048a80-1982-4f81-bc56-8e4132ea0c89 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:28.104620 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29048a80-1982-4f81-bc56-8e4132ea0c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:28.104910 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29048a80-1982-4f81-bc56-8e4132ea0c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:28.114278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29048a80-1982-4f81-bc56-8e4132ea0c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:28.115770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29048a80-1982-4f81-bc56-8e4132ea0c89 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:28.125144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1182/2404] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:28.126368 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae1340-fd3d-4fe2-9a56-0a19a091578e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:28.126670 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae1340-fd3d-4fe2-9a56-0a19a091578e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:28.126951 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae1340-fd3d-4fe2-9a56-0a19a091578e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:28.147333 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c0ae1340-fd3d-4fe2-9a56-0a19a091578e None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:28.149545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c0ae1340-fd3d-4fe2-9a56-0a19a091578e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:28.158374 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1183/2405] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:28.162628 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae1340-fd3d-4fe2-9a56-0a19a091578e None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:28.171878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae1340-fd3d-4fe2-9a56-0a19a091578e None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:28.177255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf810f1-3787-46e0-be10-db5e31b09a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:28.178409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf810f1-3787-46e0-be10-db5e31b09a8c admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:28.178409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf810f1-3787-46e0-be10-db5e31b09a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:28.178820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf810f1-3787-46e0-be10-db5e31b09a8c admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:28.180282 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf810f1-3787-46e0-be10-db5e31b09a8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:59:28.180282 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf810f1-3787-46e0-be10-db5e31b09a8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:28.181064 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1223/2406] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:59:27 2022] PUT /identity/v3/projects/0e45823de37d4462b6f18b92430cb90c/users/faad27cbaf0d42f58292b393ba59fa2d/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:28.182000 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf810f1-3787-46e0-be10-db5e31b09a8c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:28.185234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c98a8-b372-4a7d-80d5-6ea6cc508eb8 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:28.201415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1184/2407] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:59:28.207309 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf810f1-3787-46e0-be10-db5e31b09a8c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:28.217005 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf810f1-3787-46e0-be10-db5e31b09a8c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:28.262376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c98a8-b372-4a7d-80d5-6ea6cc508eb8 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:28.274446 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f28aaf-1ce9-4753-a399-9c6ba07fdc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:28.274793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f28aaf-1ce9-4753-a399-9c6ba07fdc5d admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:28.275088 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f28aaf-1ce9-4753-a399-9c6ba07fdc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:28.275370 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f28aaf-1ce9-4753-a399-9c6ba07fdc5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:28.276111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f28aaf-1ce9-4753-a399-9c6ba07fdc5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:28.277794 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f28aaf-1ce9-4753-a399-9c6ba07fdc5d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:28.294212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1224/2408] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:59:28.294336 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b11ad1-45d5-40bf-b008-050315d1fb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:28.294336 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b11ad1-45d5-40bf-b008-050315d1fb1b admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:28.294336 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b11ad1-45d5-40bf-b008-050315d1fb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:28.294336 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b11ad1-45d5-40bf-b008-050315d1fb1b admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:28.294672 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b11ad1-45d5-40bf-b008-050315d1fb1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:28.294749 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f28aaf-1ce9-4753-a399-9c6ba07fdc5d admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:28.294857 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b11ad1-45d5-40bf-b008-050315d1fb1b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:28.303482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f28aaf-1ce9-4753-a399-9c6ba07fdc5d admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:28.312581 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40838bfc-942c-4888-8e5a-06b4a5b079c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:28.313647 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40838bfc-942c-4888-8e5a-06b4a5b079c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:28.313999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40838bfc-942c-4888-8e5a-06b4a5b079c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:28.314341 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40838bfc-942c-4888-8e5a-06b4a5b079c4 admin admin] PATH_INFO: `/v3/projects/0e45823de37d4462b6f18b92430cb90c/users/faad27cbaf0d42f58292b393ba59fa2d/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:28.316851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40838bfc-942c-4888-8e5a-06b4a5b079c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e45823de37d4462b6f18b92430cb90c, user_id=faad27cbaf0d42f58292b393ba59fa2d, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:28.320241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40838bfc-942c-4888-8e5a-06b4a5b079c4 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:28.332523 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1225/2409] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:59:28 2022] PUT /identity/v3/projects/0e45823de37d4462b6f18b92430cb90c/users/faad27cbaf0d42f58292b393ba59fa2d/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:59:28.344557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f771635-0ae2-4154-b78e-defb79c6d0e9 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:28.345067 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f771635-0ae2-4154-b78e-defb79c6d0e9 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:28.345414 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f771635-0ae2-4154-b78e-defb79c6d0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:28.384574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1185/2410] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:59:28 2022] POST /identity/v3/projects => generated 369 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:59:28.389077 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b11ad1-45d5-40bf-b008-050315d1fb1b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:28.397732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-2f771635-0ae2-4154-b78e-defb79c6d0e9 None None] MFA Rules not processed for user `faad27cbaf0d42f58292b393ba59fa2d`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:28.399851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2f771635-0ae2-4154-b78e-defb79c6d0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:28.482163 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b11ad1-45d5-40bf-b008-050315d1fb1b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:28.488476 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7cb39-0914-4157-8c57-8fc3bb3272a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:28.489289 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7cb39-0914-4157-8c57-8fc3bb3272a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:28.490088 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7cb39-0914-4157-8c57-8fc3bb3272a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:28.490088 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7cb39-0914-4157-8c57-8fc3bb3272a9 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:28.491138 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7cb39-0914-4157-8c57-8fc3bb3272a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:28.493355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7cb39-0914-4157-8c57-8fc3bb3272a9 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:28.494737 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1226/2411] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:28.510005 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f771635-0ae2-4154-b78e-defb79c6d0e9 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:28.511476 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2f771635-0ae2-4154-b78e-defb79c6d0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:28.594853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f771635-0ae2-4154-b78e-defb79c6d0e9 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:28.599243 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1186/2412] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:59:28 2022] POST /identity/v3/users => generated 285 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:59:28.600352 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d59ff7-d747-457d-b31d-1b70d390bdbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:28.601769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d59ff7-d747-457d-b31d-1b70d390bdbc service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:28.602067 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d59ff7-d747-457d-b31d-1b70d390bdbc service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:28.602345 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d59ff7-d747-457d-b31d-1b70d390bdbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:28.603109 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7cb39-0914-4157-8c57-8fc3bb3272a9 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:28.604416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f4d59ff7-d747-457d-b31d-1b70d390bdbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:28.616988 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7cb39-0914-4157-8c57-8fc3bb3272a9 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:28.622942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc6e63-e77c-4135-8e15-907abe6134b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:28.624206 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc6e63-e77c-4135-8e15-907abe6134b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:28.624750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc6e63-e77c-4135-8e15-907abe6134b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:28.625087 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc6e63-e77c-4135-8e15-907abe6134b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:28.628214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc6e63-e77c-4135-8e15-907abe6134b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:28.628214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc6e63-e77c-4135-8e15-907abe6134b9 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:28.651701 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1187/2413] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:59:28.652638 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc6e63-e77c-4135-8e15-907abe6134b9 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:28.654338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-94bc6e63-e77c-4135-8e15-907abe6134b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:28.668338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc6e63-e77c-4135-8e15-907abe6134b9 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:28.674944 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbd203-5f98-4416-8913-f5cb39a68e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:28.675685 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbd203-5f98-4416-8913-f5cb39a68e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:28.675969 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbd203-5f98-4416-8913-f5cb39a68e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:28.676245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbd203-5f98-4416-8913-f5cb39a68e14 admin admin] PATH_INFO: `/v3/projects/789f6969e57b4678a93abe8b3feb4daa` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:28.677596 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fbd203-5f98-4416-8913-f5cb39a68e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=789f6969e57b4678a93abe8b3feb4daa)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:28.679548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fbd203-5f98-4416-8913-f5cb39a68e14 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:28.690703 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d59ff7-d747-457d-b31d-1b70d390bdbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:28.692247 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d59ff7-d747-457d-b31d-1b70d390bdbc service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:28.703840 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1227/2414] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:59:28.704616 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d59ff7-d747-457d-b31d-1b70d390bdbc service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:28.715947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d59ff7-d747-457d-b31d-1b70d390bdbc service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:28.733586 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7777760-2618-4a3a-9199-2531da47b864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:28.733586 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7777760-2618-4a3a-9199-2531da47b864 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:28.733586 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7777760-2618-4a3a-9199-2531da47b864 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:28.733586 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7777760-2618-4a3a-9199-2531da47b864 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:28.733907 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7777760-2618-4a3a-9199-2531da47b864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:28.733907 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7777760-2618-4a3a-9199-2531da47b864 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:28.743012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1228/2415] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:59:28.747109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7777760-2618-4a3a-9199-2531da47b864 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:28.757629 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7777760-2618-4a3a-9199-2531da47b864 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:28.762526 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c5013-832f-4c6b-afa7-5ccefdcad3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:28.763500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c5013-832f-4c6b-afa7-5ccefdcad3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:28.763791 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c5013-832f-4c6b-afa7-5ccefdcad3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:28.764071 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c5013-832f-4c6b-afa7-5ccefdcad3f0 admin admin] PATH_INFO: `/v3/projects/dd504cf0e67b4cf5b8e39221993c20ab/users/2799e5582e3f43f891c61e257c6bb664/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:28.780944 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c5013-832f-4c6b-afa7-5ccefdcad3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd504cf0e67b4cf5b8e39221993c20ab, user_id=2799e5582e3f43f891c61e257c6bb664, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:28.785193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c5013-832f-4c6b-afa7-5ccefdcad3f0 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:28.805357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-10fbd203-5f98-4416-8913-f5cb39a68e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '789f6969e57b4678a93abe8b3feb4daa', 'request_id': 'req-10fbd203-5f98-4416-8913-f5cb39a68e14'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:28.814453 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-10fbd203-5f98-4416-8913-f5cb39a68e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '789f6969e57b4678a93abe8b3feb4daa', 'request_id': 'req-10fbd203-5f98-4416-8913-f5cb39a68e14'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:28.823030 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-10fbd203-5f98-4416-8913-f5cb39a68e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '789f6969e57b4678a93abe8b3feb4daa', 'request_id': 'req-10fbd203-5f98-4416-8913-f5cb39a68e14'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:28.878660 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1229/2416] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:59:28 2022] PUT /identity/v3/projects/dd504cf0e67b4cf5b8e39221993c20ab/users/2799e5582e3f43f891c61e257c6bb664/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:59:28.889198 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3a1d8-73c9-4567-82f4-00eb34b68d5c None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:28.889493 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3a1d8-73c9-4567-82f4-00eb34b68d5c None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:28.889772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3a1d8-73c9-4567-82f4-00eb34b68d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:28.913845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-10fbd203-5f98-4416-8913-f5cb39a68e14 admin admin] The token cache is being invalidate because project 789f6969e57b4678a93abe8b3feb4daa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:59:28.917151 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-10fbd203-5f98-4416-8913-f5cb39a68e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:28.917151 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-10fbd203-5f98-4416-8913-f5cb39a68e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:28.917151 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1188/2417] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:59:28 2022] DELETE /identity/v3/projects/789f6969e57b4678a93abe8b3feb4daa => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:28.921047 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-26c3a1d8-73c9-4567-82f4-00eb34b68d5c None None] MFA Rules not processed for user `2799e5582e3f43f891c61e257c6bb664`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:28.921563 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cebba-c4ba-4ec9-9fea-4f09caa2d9ca None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:28.922419 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-26c3a1d8-73c9-4567-82f4-00eb34b68d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:28.924665 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cebba-c4ba-4ec9-9fea-4f09caa2d9ca None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:28.924963 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cebba-c4ba-4ec9-9fea-4f09caa2d9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:28.945263 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-175cebba-c4ba-4ec9-9fea-4f09caa2d9ca None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:28.946382 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-175cebba-c4ba-4ec9-9fea-4f09caa2d9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:29.000290 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1230/2418] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:59:29.013171 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3a1d8-73c9-4567-82f4-00eb34b68d5c None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:29.017799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-26c3a1d8-73c9-4567-82f4-00eb34b68d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:29.039516 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1189/2419] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:59:29.043210 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414b210-8312-4176-9f01-4598f1a3cc17 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:29.043581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414b210-8312-4176-9f01-4598f1a3cc17 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:29.043755 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414b210-8312-4176-9f01-4598f1a3cc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:29.065192 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-9414b210-8312-4176-9f01-4598f1a3cc17 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:29.066952 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-9414b210-8312-4176-9f01-4598f1a3cc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:29.076481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1190/2420] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:29.080643 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414b210-8312-4176-9f01-4598f1a3cc17 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:29.086695 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3a1d8-73c9-4567-82f4-00eb34b68d5c None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:29.088137 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc6643-2414-4a09-ba76-172af133ec64 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00c13f10b14449cea284eb629a316d83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:29.088964 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc6643-2414-4a09-ba76-172af133ec64 service glance] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:29.089297 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc6643-2414-4a09-ba76-172af133ec64 service glance] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:29.089618 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc6643-2414-4a09-ba76-172af133ec64 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:29.091168 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414b210-8312-4176-9f01-4598f1a3cc17 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:29.095964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb3f14-fb2a-4362-9a70-9561332a88b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:29.096757 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb3f14-fb2a-4362-9a70-9561332a88b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:29.097118 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb3f14-fb2a-4362-9a70-9561332a88b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:29.097480 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb3f14-fb2a-4362-9a70-9561332a88b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:29.098295 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb3f14-fb2a-4362-9a70-9561332a88b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:59:29.098674 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb3f14-fb2a-4362-9a70-9561332a88b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:29.099534 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc6643-2414-4a09-ba76-172af133ec64 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:29.100545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb3f14-fb2a-4362-9a70-9561332a88b9 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:29.101054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc6643-2414-4a09-ba76-172af133ec64 service glance] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:29.113547 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1231/2421] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:29.126281 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1191/2422] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:59:29.128335 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc6643-2414-4a09-ba76-172af133ec64 service glance] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:29.135304 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:29.147959 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc6643-2414-4a09-ba76-172af133ec64 service glance] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:29.148076 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505df25-2bf6-4696-9a06-82eaf34a179b None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:29.148076 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505df25-2bf6-4696-9a06-82eaf34a179b None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:29.148076 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505df25-2bf6-4696-9a06-82eaf34a179b None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:29.148744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1192/2423] 10.222.0.93 () {54 vars in 921 bytes} [Thu Jun 16 18:59:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:59:29.155104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f8206-3d1a-4a8a-93f6-3c0074e9b770 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:29.155455 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f8206-3d1a-4a8a-93f6-3c0074e9b770 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:29.155871 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f8206-3d1a-4a8a-93f6-3c0074e9b770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:29.157866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca64fa-deae-4fd1-8e67-c6fb6be00a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:29.158745 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca64fa-deae-4fd1-8e67-c6fb6be00a6a admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:29.160015 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca64fa-deae-4fd1-8e67-c6fb6be00a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:29.160377 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca64fa-deae-4fd1-8e67-c6fb6be00a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:29.161255 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca64fa-deae-4fd1-8e67-c6fb6be00a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:29.165444 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca64fa-deae-4fd1-8e67-c6fb6be00a6a admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:29.227412 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-da8f8206-3d1a-4a8a-93f6-3c0074e9b770 None None] MFA Rules not processed for user `3503ec98bea14693a17a84e686586bad`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:29.235873 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-da8f8206-3d1a-4a8a-93f6-3c0074e9b770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:29.259879 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:29.302007 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1232/2424] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:59:29 2022] POST /identity/v3/projects => generated 359 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:59:29.306321 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca64fa-deae-4fd1-8e67-c6fb6be00a6a admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:29.339069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1193/2425] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Jun 16 18:59:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:59:29.358793 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f8206-3d1a-4a8a-93f6-3c0074e9b770 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:29.368801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f8206-3d1a-4a8a-93f6-3c0074e9b770 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:29.400185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca64fa-deae-4fd1-8e67-c6fb6be00a6a admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:29.408376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68423c-47b7-4c2c-bd96-cebd14e96f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:29.409106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68423c-47b7-4c2c-bd96-cebd14e96f6c admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:29.409399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68423c-47b7-4c2c-bd96-cebd14e96f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:29.409687 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68423c-47b7-4c2c-bd96-cebd14e96f6c admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:29.410408 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68423c-47b7-4c2c-bd96-cebd14e96f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:29.412480 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68423c-47b7-4c2c-bd96-cebd14e96f6c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:29.425066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fd98c-62fb-4926-9940-50b561ed705d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00c13f10b14449cea284eb629a316d83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:29.428661 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fd98c-62fb-4926-9940-50b561ed705d service glance] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:29.428661 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fd98c-62fb-4926-9940-50b561ed705d service glance] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:29.428661 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fd98c-62fb-4926-9940-50b561ed705d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:29.514774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1233/2426] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:59:29 2022] POST /identity/v3/users => generated 280 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:59:29.518731 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68423c-47b7-4c2c-bd96-cebd14e96f6c admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:29.531387 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68423c-47b7-4c2c-bd96-cebd14e96f6c admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:29.534368 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fd98c-62fb-4926-9940-50b561ed705d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:29.538575 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fd98c-62fb-4926-9940-50b561ed705d service glance] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:29.544187 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e32793-0c2a-4ee3-968f-26f88a4f0ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:29.544912 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e32793-0c2a-4ee3-968f-26f88a4f0ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:29.545320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e32793-0c2a-4ee3-968f-26f88a4f0ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:29.545540 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e32793-0c2a-4ee3-968f-26f88a4f0ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:29.546220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e32793-0c2a-4ee3-968f-26f88a4f0ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:29.547870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e32793-0c2a-4ee3-968f-26f88a4f0ed2 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:29.556202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1194/2427] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:59:29.570499 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1234/2428] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:59:29.571270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fd98c-62fb-4926-9940-50b561ed705d service glance] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:29.583139 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fd98c-62fb-4926-9940-50b561ed705d service glance] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:29.589095 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a802ff5-4030-416b-8525-ff3ab88a5030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:29.589842 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a802ff5-4030-416b-8525-ff3ab88a5030 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:29.590318 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a802ff5-4030-416b-8525-ff3ab88a5030 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:29.590540 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a802ff5-4030-416b-8525-ff3ab88a5030 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:29.591430 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a802ff5-4030-416b-8525-ff3ab88a5030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:29.593309 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a802ff5-4030-416b-8525-ff3ab88a5030 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:29.604704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1195/2429] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:59:29.609443 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e32793-0c2a-4ee3-968f-26f88a4f0ed2 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:29.622490 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e32793-0c2a-4ee3-968f-26f88a4f0ed2 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:29.630724 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447f3a0-e088-40ae-8e40-b491e1d03742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:29.632860 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447f3a0-e088-40ae-8e40-b491e1d03742 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:29.634969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447f3a0-e088-40ae-8e40-b491e1d03742 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:29.634969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447f3a0-e088-40ae-8e40-b491e1d03742 admin admin] PATH_INFO: `/v3/projects/3e1715d4bf6d413dac3f545c52803b5d/users/486f7e9444bb46469fc02a75198a98ab/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:29.652576 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447f3a0-e088-40ae-8e40-b491e1d03742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1715d4bf6d413dac3f545c52803b5d, user_id=486f7e9444bb46469fc02a75198a98ab, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:29.655853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447f3a0-e088-40ae-8e40-b491e1d03742 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:29.768220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1235/2430] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:59:29 2022] PUT /identity/v3/projects/3e1715d4bf6d413dac3f545c52803b5d/users/486f7e9444bb46469fc02a75198a98ab/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:29.775196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae28d-e758-43fe-b32b-fb3db7691496 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:29.775549 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae28d-e758-43fe-b32b-fb3db7691496 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:29.775904 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae28d-e758-43fe-b32b-fb3db7691496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:29.806810 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a66ae28d-e758-43fe-b32b-fb3db7691496 None None] MFA Rules not processed for user `486f7e9444bb46469fc02a75198a98ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:29.808287 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a66ae28d-e758-43fe-b32b-fb3db7691496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:29.821095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28755a9-4696-4380-b53d-3e7d46c57e85 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:29.821095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28755a9-4696-4380-b53d-3e7d46c57e85 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:29.821095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28755a9-4696-4380-b53d-3e7d46c57e85 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:29.821095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1236/2431] 10.222.0.93 () {54 vars in 921 bytes} [Thu Jun 16 18:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:59:29.824717 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101e4a2-43c9-4c5c-9169-7283e50aa0cd None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:29.825082 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101e4a2-43c9-4c5c-9169-7283e50aa0cd None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:29.825436 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101e4a2-43c9-4c5c-9169-7283e50aa0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:29.847310 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-f101e4a2-43c9-4c5c-9169-7283e50aa0cd None None] MFA Rules not processed for user `753728a82bdb406892015f8373932ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:29.849716 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f101e4a2-43c9-4c5c-9169-7283e50aa0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:29.886184 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1196/2432] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:29 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:29.918854 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ae28d-e758-43fe-b32b-fb3db7691496 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:29.920228 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a66ae28d-e758-43fe-b32b-fb3db7691496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:29.920734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1237/2433] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Jun 16 18:59:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:59:29.936733 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101e4a2-43c9-4c5c-9169-7283e50aa0cd None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:29.938314 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f101e4a2-43c9-4c5c-9169-7283e50aa0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:29.950735 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101e4a2-43c9-4c5c-9169-7283e50aa0cd None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:29.955827 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c4fdc-4867-4580-9386-80620661501f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:29.956117 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c4fdc-4867-4580-9386-80620661501f service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:29.956407 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c4fdc-4867-4580-9386-80620661501f service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:29.956719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c4fdc-4867-4580-9386-80620661501f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:29.964476 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c4fdc-4867-4580-9386-80620661501f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:29.965886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c4fdc-4867-4580-9386-80620661501f service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:29.975168 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1238/2434] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:29.989729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ae28d-e758-43fe-b32b-fb3db7691496 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:29.994341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9aa8e-9ed7-4c01-8d6d-2e4a4f345e4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:29.994853 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9aa8e-9ed7-4c01-8d6d-2e4a4f345e4b service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:29.995140 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9aa8e-9ed7-4c01-8d6d-2e4a4f345e4b service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:29.995420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9aa8e-9ed7-4c01-8d6d-2e4a4f345e4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:30.004462 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9aa8e-9ed7-4c01-8d6d-2e4a4f345e4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:30.005868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9aa8e-9ed7-4c01-8d6d-2e4a4f345e4b service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:30.023099 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1197/2435] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:29 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:30.039551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c4fdc-4867-4580-9386-80620661501f service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:30.124021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c4fdc-4867-4580-9386-80620661501f service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:30.124021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7ce43-41bd-4eb3-b005-8e2ee99db4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:30.124021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7ce43-41bd-4eb3-b005-8e2ee99db4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:30.124021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7ce43-41bd-4eb3-b005-8e2ee99db4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:30.124370 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7ce43-41bd-4eb3-b005-8e2ee99db4b7 admin admin] PATH_INFO: `/v3/users/486f7e9444bb46469fc02a75198a98ab` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:30.125609 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7ce43-41bd-4eb3-b005-8e2ee99db4b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=486f7e9444bb46469fc02a75198a98ab)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:30.127562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7ce43-41bd-4eb3-b005-8e2ee99db4b7 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:30.129961 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ff2f2-bb20-4bbb-932a-c1cf22baf707 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:30.130254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ff2f2-bb20-4bbb-932a-c1cf22baf707 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:30.130519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ff2f2-bb20-4bbb-932a-c1cf22baf707 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:30.132739 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1198/2436] 10.222.0.93 () {54 vars in 921 bytes} [Thu Jun 16 18:59:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:59:30.152319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f85ba9-5dad-4041-b0ec-e23232b24f33 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:30.152319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f85ba9-5dad-4041-b0ec-e23232b24f33 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:30.152319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f85ba9-5dad-4041-b0ec-e23232b24f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:30.169170 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:30.174594 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-97f85ba9-5dad-4041-b0ec-e23232b24f33 None None] MFA Rules not processed for user `3503ec98bea14693a17a84e686586bad`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:30.176492 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-97f85ba9-5dad-4041-b0ec-e23232b24f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:30.251447 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:30.253668 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1199/2437] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Jun 16 18:59:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:59:30.324141 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f85ba9-5dad-4041-b0ec-e23232b24f33 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:30.325592 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-97f85ba9-5dad-4041-b0ec-e23232b24f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:30.339447 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f85ba9-5dad-4041-b0ec-e23232b24f33 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:30.345319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2964db-3ef2-469a-8875-9e0b8d489c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:30.346401 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2964db-3ef2-469a-8875-9e0b8d489c7e service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:30.346401 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2964db-3ef2-469a-8875-9e0b8d489c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:30.362908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2964db-3ef2-469a-8875-9e0b8d489c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:30.362908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2964db-3ef2-469a-8875-9e0b8d489c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:30.362908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2964db-3ef2-469a-8875-9e0b8d489c7e service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:30.378119 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1200/2438] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:59:30.397047 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-31b7ce43-41bd-4eb3-b005-8e2ee99db4b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '486f7e9444bb46469fc02a75198a98ab'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:30.398041 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-31b7ce43-41bd-4eb3-b005-8e2ee99db4b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '486f7e9444bb46469fc02a75198a98ab'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:30.460494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-31b7ce43-41bd-4eb3-b005-8e2ee99db4b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '486f7e9444bb46469fc02a75198a98ab'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:30.468492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-31b7ce43-41bd-4eb3-b005-8e2ee99db4b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '486f7e9444bb46469fc02a75198a98ab'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:30.472090 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-31b7ce43-41bd-4eb3-b005-8e2ee99db4b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '486f7e9444bb46469fc02a75198a98ab'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:30.492587 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1239/2439] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:59:30 2022] DELETE /identity/v3/users/486f7e9444bb46469fc02a75198a98ab => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:30.495115 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e16801-97ef-47ef-8c58-70915f2b7509 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:30.495457 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e16801-97ef-47ef-8c58-70915f2b7509 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:30.495839 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e16801-97ef-47ef-8c58-70915f2b7509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:30.526231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f0e16801-97ef-47ef-8c58-70915f2b7509 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:30.527755 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f0e16801-97ef-47ef-8c58-70915f2b7509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:30.637577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1201/2440] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:30.651159 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7ce43-41bd-4eb3-b005-8e2ee99db4b7 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:30.653474 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-31b7ce43-41bd-4eb3-b005-8e2ee99db4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:30.777444 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7ce43-41bd-4eb3-b005-8e2ee99db4b7 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:30.781262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411ca0d-970f-416f-91aa-4ecf15679218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:30.782097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411ca0d-970f-416f-91aa-4ecf15679218 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:30.782528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411ca0d-970f-416f-91aa-4ecf15679218 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:30.782910 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411ca0d-970f-416f-91aa-4ecf15679218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:30.795465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411ca0d-970f-416f-91aa-4ecf15679218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:30.801842 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:30.801926 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411ca0d-970f-416f-91aa-4ecf15679218 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:30.808879 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1240/2441] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:30.861615 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e16801-97ef-47ef-8c58-70915f2b7509 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:30.868275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f0e16801-97ef-47ef-8c58-70915f2b7509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:30.872169 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:30.926923 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e16801-97ef-47ef-8c58-70915f2b7509 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:30.930602 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2211b89-8222-4831-bcb4-b1d8b1683f5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:30.931259 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2211b89-8222-4831-bcb4-b1d8b1683f5a service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:30.931543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2211b89-8222-4831-bcb4-b1d8b1683f5a service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:30.931819 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2211b89-8222-4831-bcb4-b1d8b1683f5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:30.933630 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a2211b89-8222-4831-bcb4-b1d8b1683f5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:31.003777 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2211b89-8222-4831-bcb4-b1d8b1683f5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:31.005275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2211b89-8222-4831-bcb4-b1d8b1683f5a service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:31.020634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1202/2442] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:31.308186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:31.432479 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:31.641470 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411ca0d-970f-416f-91aa-4ecf15679218 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:31.646153 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c411ca0d-970f-416f-91aa-4ecf15679218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:31.666904 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411ca0d-970f-416f-91aa-4ecf15679218 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:31.690454 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0efe5-7634-492a-977c-afab242482ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:31.693052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0efe5-7634-492a-977c-afab242482ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:31.694182 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0efe5-7634-492a-977c-afab242482ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:31.695843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0efe5-7634-492a-977c-afab242482ed admin admin] PATH_INFO: `/v3/projects/3e1715d4bf6d413dac3f545c52803b5d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:31.700968 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0efe5-7634-492a-977c-afab242482ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e1715d4bf6d413dac3f545c52803b5d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:31.704600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0efe5-7634-492a-977c-afab242482ed admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:31.848199 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-59c0efe5-7634-492a-977c-afab242482ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e1715d4bf6d413dac3f545c52803b5d', 'request_id': 'req-59c0efe5-7634-492a-977c-afab242482ed'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:31.934917 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-59c0efe5-7634-492a-977c-afab242482ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e1715d4bf6d413dac3f545c52803b5d', 'request_id': 'req-59c0efe5-7634-492a-977c-afab242482ed'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:31.942949 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-59c0efe5-7634-492a-977c-afab242482ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e1715d4bf6d413dac3f545c52803b5d', 'request_id': 'req-59c0efe5-7634-492a-977c-afab242482ed'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:31.956245 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-59c0efe5-7634-492a-977c-afab242482ed admin admin] The token cache is being invalidate because project 3e1715d4bf6d413dac3f545c52803b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:59:31.956782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-59c0efe5-7634-492a-977c-afab242482ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:31.957698 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-59c0efe5-7634-492a-977c-afab242482ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:31.959932 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1241/2443] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:59:31 2022] DELETE /identity/v3/projects/3e1715d4bf6d413dac3f545c52803b5d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:31.969761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ea53f-4b08-4751-b38b-6129a7b67f04 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:31.969761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ea53f-4b08-4751-b38b-6129a7b67f04 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:31.969761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ea53f-4b08-4751-b38b-6129a7b67f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:31.992804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-691ea53f-4b08-4751-b38b-6129a7b67f04 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:31.994166 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-691ea53f-4b08-4751-b38b-6129a7b67f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:32.091874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1203/2444] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:32.094602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cae16-2c7f-491a-93c2-27dcae9669c6 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:32.095790 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cae16-2c7f-491a-93c2-27dcae9669c6 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:32.096288 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cae16-2c7f-491a-93c2-27dcae9669c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:32.121281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-8c3cae16-2c7f-491a-93c2-27dcae9669c6 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:32.122870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-8c3cae16-2c7f-491a-93c2-27dcae9669c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:32.133678 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1242/2445] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:32.138928 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ea53f-4b08-4751-b38b-6129a7b67f04 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:32.149309 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ea53f-4b08-4751-b38b-6129a7b67f04 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:32.156190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aefd30-2b0a-4c1c-a199-7804c75cad04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:32.156897 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aefd30-2b0a-4c1c-a199-7804c75cad04 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:32.157178 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aefd30-2b0a-4c1c-a199-7804c75cad04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:32.157438 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aefd30-2b0a-4c1c-a199-7804c75cad04 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:32.158913 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aefd30-2b0a-4c1c-a199-7804c75cad04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:59:32.158913 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aefd30-2b0a-4c1c-a199-7804c75cad04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:32.164171 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aefd30-2b0a-4c1c-a199-7804c75cad04 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:32.200628 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1204/2446] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:59:32.201675 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3cae16-2c7f-491a-93c2-27dcae9669c6 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:32.211719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3cae16-2c7f-491a-93c2-27dcae9669c6 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:32.219004 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd037d-6e71-4df3-80cc-d4224109677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:32.219816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd037d-6e71-4df3-80cc-d4224109677e admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:32.220179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd037d-6e71-4df3-80cc-d4224109677e admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:32.220573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd037d-6e71-4df3-80cc-d4224109677e admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:32.221389 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd037d-6e71-4df3-80cc-d4224109677e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:32.223632 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd037d-6e71-4df3-80cc-d4224109677e admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:32.296310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:32.354126 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1243/2447] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:59:32 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:59:32.358366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aefd30-2b0a-4c1c-a199-7804c75cad04 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:32.377457 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aefd30-2b0a-4c1c-a199-7804c75cad04 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:32.463270 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05f851-57f1-4011-b50e-ac0feca1fb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:32.463965 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05f851-57f1-4011-b50e-ac0feca1fb67 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:32.464358 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05f851-57f1-4011-b50e-ac0feca1fb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:32.464667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05f851-57f1-4011-b50e-ac0feca1fb67 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:32.465400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05f851-57f1-4011-b50e-ac0feca1fb67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:32.468059 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05f851-57f1-4011-b50e-ac0feca1fb67 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:32.575239 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:32.582033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1205/2448] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:59:32 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:59:32.587324 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd037d-6e71-4df3-80cc-d4224109677e admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:32.598217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd037d-6e71-4df3-80cc-d4224109677e admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:32.619175 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a3d60-a0b9-4d4c-8ed3-bcec10801536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:32.619961 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a3d60-a0b9-4d4c-8ed3-bcec10801536 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:32.620312 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a3d60-a0b9-4d4c-8ed3-bcec10801536 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:32.620729 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a3d60-a0b9-4d4c-8ed3-bcec10801536 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:32.621483 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a3d60-a0b9-4d4c-8ed3-bcec10801536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:32.623217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a3d60-a0b9-4d4c-8ed3-bcec10801536 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:32.637003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1244/2449] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:59:32.641167 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05f851-57f1-4011-b50e-ac0feca1fb67 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:32.655534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05f851-57f1-4011-b50e-ac0feca1fb67 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:32.657515 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a3d60-a0b9-4d4c-8ed3-bcec10801536 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:32.659449 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-e88a3d60-a0b9-4d4c-8ed3-bcec10801536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:32.668720 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acb46f-9f2e-446a-81bb-ea8a8c520b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:32.671933 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb46f-9f2e-446a-81bb-ea8a8c520b02 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:32.672233 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb46f-9f2e-446a-81bb-ea8a8c520b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:32.672742 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb46f-9f2e-446a-81bb-ea8a8c520b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:32.673329 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acb46f-9f2e-446a-81bb-ea8a8c520b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:32.674975 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acb46f-9f2e-446a-81bb-ea8a8c520b02 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:32.687177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1206/2450] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:59:32.691590 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acb46f-9f2e-446a-81bb-ea8a8c520b02 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:32.705996 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acb46f-9f2e-446a-81bb-ea8a8c520b02 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:32.713483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214eafd-a509-4866-837f-9dd92bd070ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:32.714441 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214eafd-a509-4866-837f-9dd92bd070ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:32.714782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214eafd-a509-4866-837f-9dd92bd070ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:32.715085 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214eafd-a509-4866-837f-9dd92bd070ed admin admin] PATH_INFO: `/v3/projects/d70fdd7a643245659a616680072560f4/users/8cd43532b520400e969b1929a6d0ed38/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:32.743622 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214eafd-a509-4866-837f-9dd92bd070ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70fdd7a643245659a616680072560f4, user_id=8cd43532b520400e969b1929a6d0ed38, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:32.750668 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214eafd-a509-4866-837f-9dd92bd070ed admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:32.759333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a3d60-a0b9-4d4c-8ed3-bcec10801536 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:32.764645 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18900636-6859-4cfe-94e3-fe3b286ab5e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:32.765151 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18900636-6859-4cfe-94e3-fe3b286ab5e6 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:32.765501 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18900636-6859-4cfe-94e3-fe3b286ab5e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:32.765955 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18900636-6859-4cfe-94e3-fe3b286ab5e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:32.768238 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-18900636-6859-4cfe-94e3-fe3b286ab5e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:32.833211 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1207/2451] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:59:32 2022] PUT /identity/v3/projects/d70fdd7a643245659a616680072560f4/users/8cd43532b520400e969b1929a6d0ed38/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:59:32.839508 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47daac34-01c5-4a98-b557-b01cd56bc360 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:32.839813 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47daac34-01c5-4a98-b557-b01cd56bc360 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:32.840096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47daac34-01c5-4a98-b557-b01cd56bc360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:32.862233 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-47daac34-01c5-4a98-b557-b01cd56bc360 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:32.863628 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-47daac34-01c5-4a98-b557-b01cd56bc360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:32.872814 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18900636-6859-4cfe-94e3-fe3b286ab5e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:32.874336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18900636-6859-4cfe-94e3-fe3b286ab5e6 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:32.892660 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1245/2452] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:32.967005 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1208/2453] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:59:32.977682 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18900636-6859-4cfe-94e3-fe3b286ab5e6 service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:32.979442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-18900636-6859-4cfe-94e3-fe3b286ab5e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:33.044031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18900636-6859-4cfe-94e3-fe3b286ab5e6 service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:33.104568 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f63f4-32ee-4177-bb95-54c5114a8815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:33.105543 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f63f4-32ee-4177-bb95-54c5114a8815 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:33.105834 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f63f4-32ee-4177-bb95-54c5114a8815 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:33.106112 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f63f4-32ee-4177-bb95-54c5114a8815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:33.116989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f63f4-32ee-4177-bb95-54c5114a8815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:33.118468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f63f4-32ee-4177-bb95-54c5114a8815 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:33.128777 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1246/2454] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:33.295915 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:33.335050 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:33.454631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:33.563293 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:33.680500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:33.982111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:34.246194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:34.633253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b265cd-5c8e-4595-848e-fc7f5f163b31 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:34.633253 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b265cd-5c8e-4595-848e-fc7f5f163b31 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:34.633884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b265cd-5c8e-4595-848e-fc7f5f163b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:34.635928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:34.672844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a5b265cd-5c8e-4595-848e-fc7f5f163b31 None None] MFA Rules not processed for user `1eefe0d721484433b72afca03a2c1bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:34.674854 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a5b265cd-5c8e-4595-848e-fc7f5f163b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:34.749903 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:34.760142 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1209/2455] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Jun 16 18:59:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:34.774226 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f63f4-32ee-4177-bb95-54c5114a8815 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:34.775992 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-152f63f4-32ee-4177-bb95-54c5114a8815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:34.917054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f63f4-32ee-4177-bb95-54c5114a8815 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:34.923430 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208cb6b-fa25-433d-9268-b6c59df95545 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b45db002889846eda5b2a3e6917fcbe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:34.924301 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208cb6b-fa25-433d-9268-b6c59df95545 service swift] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:34.924827 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208cb6b-fa25-433d-9268-b6c59df95545 service swift] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:34.925270 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208cb6b-fa25-433d-9268-b6c59df95545 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:34.936410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208cb6b-fa25-433d-9268-b6c59df95545 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:34.938574 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208cb6b-fa25-433d-9268-b6c59df95545 service swift] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:34.976276 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1247/2456] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Jun 16 18:59:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:59:35.593499 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:39.788356 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b265cd-5c8e-4595-848e-fc7f5f163b31 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:39.790117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a5b265cd-5c8e-4595-848e-fc7f5f163b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:39.830010 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b265cd-5c8e-4595-848e-fc7f5f163b31 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:39.841623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02711b00-5b29-4f95-93d0-58677425925d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:39.842537 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02711b00-5b29-4f95-93d0-58677425925d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:39.842923 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02711b00-5b29-4f95-93d0-58677425925d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:39.843427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02711b00-5b29-4f95-93d0-58677425925d admin admin] PATH_INFO: `/v3/users/c666f383cb3348e29f91c296d8e8c9f0` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:39.844845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02711b00-5b29-4f95-93d0-58677425925d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c666f383cb3348e29f91c296d8e8c9f0)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:39.847061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02711b00-5b29-4f95-93d0-58677425925d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:40.064953 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-02711b00-5b29-4f95-93d0-58677425925d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c666f383cb3348e29f91c296d8e8c9f0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.066073 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-02711b00-5b29-4f95-93d0-58677425925d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c666f383cb3348e29f91c296d8e8c9f0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.141834 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-02711b00-5b29-4f95-93d0-58677425925d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c666f383cb3348e29f91c296d8e8c9f0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.163327 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-02711b00-5b29-4f95-93d0-58677425925d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c666f383cb3348e29f91c296d8e8c9f0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.198940 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-02711b00-5b29-4f95-93d0-58677425925d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c666f383cb3348e29f91c296d8e8c9f0'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.212498 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1210/2457] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:59:39 2022] DELETE /identity/v3/users/c666f383cb3348e29f91c296d8e8c9f0 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:40.216945 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44464b88-38e7-4689-93e5-81f372ce2c80 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:40.217585 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44464b88-38e7-4689-93e5-81f372ce2c80 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:40.217585 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44464b88-38e7-4689-93e5-81f372ce2c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:40.269781 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-44464b88-38e7-4689-93e5-81f372ce2c80 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:40.270947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-44464b88-38e7-4689-93e5-81f372ce2c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:40.379679 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:40.430497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1248/2458] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:40.442319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02711b00-5b29-4f95-93d0-58677425925d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:40.445432 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-02711b00-5b29-4f95-93d0-58677425925d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:40.585610 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02711b00-5b29-4f95-93d0-58677425925d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:40.596687 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4160a-471f-4156-8f7d-eedc7030bf0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:40.597808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4160a-471f-4156-8f7d-eedc7030bf0f service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:40.598320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4160a-471f-4156-8f7d-eedc7030bf0f service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:40.598818 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4160a-471f-4156-8f7d-eedc7030bf0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:40.617473 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4160a-471f-4156-8f7d-eedc7030bf0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:40.621196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4160a-471f-4156-8f7d-eedc7030bf0f service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:40.653889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1211/2459] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:41.604261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44464b88-38e7-4689-93e5-81f372ce2c80 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:41.608362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-44464b88-38e7-4689-93e5-81f372ce2c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:41.635841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44464b88-38e7-4689-93e5-81f372ce2c80 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:41.645784 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0810a-33a6-4d0c-88fc-c9460adab187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:41.650543 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0810a-33a6-4d0c-88fc-c9460adab187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:41.651321 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0810a-33a6-4d0c-88fc-c9460adab187 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:41.651858 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0810a-33a6-4d0c-88fc-c9460adab187 admin admin] PATH_INFO: `/v3/projects/3edb4592dbcf421faf5813b9518e3bfa` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:41.661272 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0810a-33a6-4d0c-88fc-c9460adab187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3edb4592dbcf421faf5813b9518e3bfa)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:41.661272 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0810a-33a6-4d0c-88fc-c9460adab187 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:41.821399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7ce0810a-33a6-4d0c-88fc-c9460adab187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3edb4592dbcf421faf5813b9518e3bfa', 'request_id': 'req-7ce0810a-33a6-4d0c-88fc-c9460adab187'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:41.932424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7ce0810a-33a6-4d0c-88fc-c9460adab187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3edb4592dbcf421faf5813b9518e3bfa', 'request_id': 'req-7ce0810a-33a6-4d0c-88fc-c9460adab187'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:41.948869 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7ce0810a-33a6-4d0c-88fc-c9460adab187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3edb4592dbcf421faf5813b9518e3bfa', 'request_id': 'req-7ce0810a-33a6-4d0c-88fc-c9460adab187'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:41.992738 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7ce0810a-33a6-4d0c-88fc-c9460adab187 admin admin] The token cache is being invalidate because project 3edb4592dbcf421faf5813b9518e3bfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:59:41.993518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7ce0810a-33a6-4d0c-88fc-c9460adab187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:41.994636 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7ce0810a-33a6-4d0c-88fc-c9460adab187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:42.003343 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1249/2460] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:59:41 2022] DELETE /identity/v3/projects/3edb4592dbcf421faf5813b9518e3bfa => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:42.004291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4160a-471f-4156-8f7d-eedc7030bf0f service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:42.020952 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4160a-471f-4156-8f7d-eedc7030bf0f service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:42.156908 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738851d-9c17-4f56-abd7-44841f76901f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:42.157788 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738851d-9c17-4f56-abd7-44841f76901f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:42.158244 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738851d-9c17-4f56-abd7-44841f76901f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:42.158431 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738851d-9c17-4f56-abd7-44841f76901f admin admin] PATH_INFO: `/v3/users/7bce7f0451464fb094f025e0a0cd0803` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:42.161375 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738851d-9c17-4f56-abd7-44841f76901f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bce7f0451464fb094f025e0a0cd0803)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:42.163985 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738851d-9c17-4f56-abd7-44841f76901f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:42.207353 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:42.405158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3738851d-9c17-4f56-abd7-44841f76901f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bce7f0451464fb094f025e0a0cd0803'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:42.405887 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3738851d-9c17-4f56-abd7-44841f76901f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bce7f0451464fb094f025e0a0cd0803'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:42.482395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3738851d-9c17-4f56-abd7-44841f76901f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bce7f0451464fb094f025e0a0cd0803'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:42.494967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3738851d-9c17-4f56-abd7-44841f76901f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bce7f0451464fb094f025e0a0cd0803'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:42.520986 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3738851d-9c17-4f56-abd7-44841f76901f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bce7f0451464fb094f025e0a0cd0803'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:42.530427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1212/2461] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:59:42 2022] DELETE /identity/v3/users/7bce7f0451464fb094f025e0a0cd0803 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:59:42.616468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca54a4-8602-4f84-8323-ecac09d8a36a None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:42.618211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca54a4-8602-4f84-8323-ecac09d8a36a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:42.618740 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca54a4-8602-4f84-8323-ecac09d8a36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:42.670757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-b2ca54a4-8602-4f84-8323-ecac09d8a36a None None] MFA Rules not processed for user `8cd43532b520400e969b1929a6d0ed38`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:42.672376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b2ca54a4-8602-4f84-8323-ecac09d8a36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:42.783038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1250/2462] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:42.784150 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738851d-9c17-4f56-abd7-44841f76901f admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:42.785926 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3738851d-9c17-4f56-abd7-44841f76901f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:42.934540 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738851d-9c17-4f56-abd7-44841f76901f admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:42.947198 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0f708-1b35-4143-b963-6775f524f3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:42.949134 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0f708-1b35-4143-b963-6775f524f3a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:42.961297 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0f708-1b35-4143-b963-6775f524f3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:42.961809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0f708-1b35-4143-b963-6775f524f3a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:42.962832 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0f708-1b35-4143-b963-6775f524f3a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:42.969879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0f708-1b35-4143-b963-6775f524f3a4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:43.120836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1213/2463] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:59:42 2022] POST /identity/v3/projects => generated 383 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:59:43.128917 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca54a4-8602-4f84-8323-ecac09d8a36a None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:43.143436 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca54a4-8602-4f84-8323-ecac09d8a36a None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:43.216065 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:43.235298 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8fbba-2684-4f79-9502-70ab0f361fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:43.235298 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8fbba-2684-4f79-9502-70ab0f361fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:43.241957 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8fbba-2684-4f79-9502-70ab0f361fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:43.241957 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8fbba-2684-4f79-9502-70ab0f361fb1 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:43.241957 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8fbba-2684-4f79-9502-70ab0f361fb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:43.241957 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8fbba-2684-4f79-9502-70ab0f361fb1 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:43.346991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1251/2464] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:59:43 2022] POST /identity/v3/users => generated 298 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:59:43.352487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0f708-1b35-4143-b963-6775f524f3a4 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:43.384404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0f708-1b35-4143-b963-6775f524f3a4 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:43.384778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8fbba-2684-4f79-9502-70ab0f361fb1 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:43.391239 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-78d8fbba-2684-4f79-9502-70ab0f361fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:43.405797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8ba42-e3dc-4081-97d2-26adff6edbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:43.407545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8ba42-e3dc-4081-97d2-26adff6edbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:43.410157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8ba42-e3dc-4081-97d2-26adff6edbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:43.410631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8ba42-e3dc-4081-97d2-26adff6edbe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:43.450328 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8ba42-e3dc-4081-97d2-26adff6edbe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:43.451223 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8fbba-2684-4f79-9502-70ab0f361fb1 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:43.451380 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8ba42-e3dc-4081-97d2-26adff6edbe9 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:43.451532 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefedf90-b1d5-4bff-b7f6-ebd44b32d6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:43.451532 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefedf90-b1d5-4bff-b7f6-ebd44b32d6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:43.451532 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefedf90-b1d5-4bff-b7f6-ebd44b32d6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:43.451532 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefedf90-b1d5-4bff-b7f6-ebd44b32d6a6 admin admin] PATH_INFO: `/v3/projects/ea2e4cc5832f47eab2156633a3267821` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:43.452313 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefedf90-b1d5-4bff-b7f6-ebd44b32d6a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea2e4cc5832f47eab2156633a3267821)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:43.452313 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefedf90-b1d5-4bff-b7f6-ebd44b32d6a6 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:43.469887 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1214/2465] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:59:43.475469 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8ba42-e3dc-4081-97d2-26adff6edbe9 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:43.520935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8ba42-e3dc-4081-97d2-26adff6edbe9 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:43.539454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bd7b8-8f74-4091-a3d9-cbc034e88a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:43.540395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bd7b8-8f74-4091-a3d9-cbc034e88a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:43.545449 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bd7b8-8f74-4091-a3d9-cbc034e88a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:43.545884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bd7b8-8f74-4091-a3d9-cbc034e88a71 admin admin] PATH_INFO: `/v3/projects/fe03db22944a474dabac8e2ac4ca8bde/users/c6934275ec3448588ae7cf63ae3314d6/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:43.591237 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bd7b8-8f74-4091-a3d9-cbc034e88a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe03db22944a474dabac8e2ac4ca8bde, user_id=c6934275ec3448588ae7cf63ae3314d6, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:43.594409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bd7b8-8f74-4091-a3d9-cbc034e88a71 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:43.715724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1215/2466] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:59:43 2022] PUT /identity/v3/projects/fe03db22944a474dabac8e2ac4ca8bde/users/c6934275ec3448588ae7cf63ae3314d6/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:43.719333 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bd7b8-8f74-4091-a3d9-cbc034e88a71 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:43.728670 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-eefedf90-b1d5-4bff-b7f6-ebd44b32d6a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea2e4cc5832f47eab2156633a3267821', 'request_id': 'req-eefedf90-b1d5-4bff-b7f6-ebd44b32d6a6'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:43.796767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-eefedf90-b1d5-4bff-b7f6-ebd44b32d6a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea2e4cc5832f47eab2156633a3267821', 'request_id': 'req-eefedf90-b1d5-4bff-b7f6-ebd44b32d6a6'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:43.825265 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-eefedf90-b1d5-4bff-b7f6-ebd44b32d6a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea2e4cc5832f47eab2156633a3267821', 'request_id': 'req-eefedf90-b1d5-4bff-b7f6-ebd44b32d6a6'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:43.840368 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:43.869614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-eefedf90-b1d5-4bff-b7f6-ebd44b32d6a6 admin admin] The token cache is being invalidate because project ea2e4cc5832f47eab2156633a3267821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:59:43.872020 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-eefedf90-b1d5-4bff-b7f6-ebd44b32d6a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:43.874285 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-eefedf90-b1d5-4bff-b7f6-ebd44b32d6a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:43.880423 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1252/2467] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:59:43 2022] DELETE /identity/v3/projects/ea2e4cc5832f47eab2156633a3267821 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:43.885243 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefedf90-b1d5-4bff-b7f6-ebd44b32d6a6 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:43.889537 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-eefedf90-b1d5-4bff-b7f6-ebd44b32d6a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:43.916626 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bd7b8-8f74-4091-a3d9-cbc034e88a71 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:44.039284 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e353d8c-4879-437f-b82c-7911800f9be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:44.041143 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e353d8c-4879-437f-b82c-7911800f9be3 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:44.041704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e353d8c-4879-437f-b82c-7911800f9be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:44.042488 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e353d8c-4879-437f-b82c-7911800f9be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:44.043655 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e353d8c-4879-437f-b82c-7911800f9be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:44.046763 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e353d8c-4879-437f-b82c-7911800f9be3 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:44.056080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefedf90-b1d5-4bff-b7f6-ebd44b32d6a6 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:44.063521 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1216/2468] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:59:44.069955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e353d8c-4879-437f-b82c-7911800f9be3 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:44.074936 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6e353d8c-4879-437f-b82c-7911800f9be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:44.083133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84fc0a-218c-418b-ae38-3b6e8a4435cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:44.088181 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84fc0a-218c-418b-ae38-3b6e8a4435cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:44.088716 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84fc0a-218c-418b-ae38-3b6e8a4435cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:44.089642 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84fc0a-218c-418b-ae38-3b6e8a4435cb admin admin] PATH_INFO: `/v3/users/faad27cbaf0d42f58292b393ba59fa2d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:44.093201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84fc0a-218c-418b-ae38-3b6e8a4435cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=faad27cbaf0d42f58292b393ba59fa2d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:44.097045 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84fc0a-218c-418b-ae38-3b6e8a4435cb admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:44.119823 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e353d8c-4879-437f-b82c-7911800f9be3 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:44.125307 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b2af1-994f-4221-a78a-2ecc3d59c56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:44.127494 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b2af1-994f-4221-a78a-2ecc3d59c56d admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:44.127798 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b2af1-994f-4221-a78a-2ecc3d59c56d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:44.128064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b2af1-994f-4221-a78a-2ecc3d59c56d admin admin] PATH_INFO: `/v3/projects/fe03db22944a474dabac8e2ac4ca8bde/users/c6934275ec3448588ae7cf63ae3314d6/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:44.130365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b2af1-994f-4221-a78a-2ecc3d59c56d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe03db22944a474dabac8e2ac4ca8bde, user_id=c6934275ec3448588ae7cf63ae3314d6, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:44.135206 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b2af1-994f-4221-a78a-2ecc3d59c56d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:44.158457 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1217/2469] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:59:44 2022] PUT /identity/v3/projects/fe03db22944a474dabac8e2ac4ca8bde/users/c6934275ec3448588ae7cf63ae3314d6/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:44.368907 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7a84fc0a-218c-418b-ae38-3b6e8a4435cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faad27cbaf0d42f58292b393ba59fa2d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:44.369943 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7a84fc0a-218c-418b-ae38-3b6e8a4435cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faad27cbaf0d42f58292b393ba59fa2d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:44.448287 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7a84fc0a-218c-418b-ae38-3b6e8a4435cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faad27cbaf0d42f58292b393ba59fa2d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:44.457086 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=80,keystone:INSERT=5,keystone:DELETE=15 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:44.458428 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7a84fc0a-218c-418b-ae38-3b6e8a4435cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faad27cbaf0d42f58292b393ba59fa2d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:44.460869 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7a84fc0a-218c-418b-ae38-3b6e8a4435cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faad27cbaf0d42f58292b393ba59fa2d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:44.502211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1253/2470] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:59:43 2022] DELETE /identity/v3/users/faad27cbaf0d42f58292b393ba59fa2d => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:45.280946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b2af1-994f-4221-a78a-2ecc3d59c56d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:45.283849 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b51b2af1-994f-4221-a78a-2ecc3d59c56d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:45.584577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b2af1-994f-4221-a78a-2ecc3d59c56d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:45.835293 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327b327-8370-4722-bb66-2cdf649003c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:45.838626 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327b327-8370-4722-bb66-2cdf649003c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:45.840049 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327b327-8370-4722-bb66-2cdf649003c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:45.840695 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327b327-8370-4722-bb66-2cdf649003c3 admin admin] PATH_INFO: `/v3/projects/0e45823de37d4462b6f18b92430cb90c` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:45.843397 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327b327-8370-4722-bb66-2cdf649003c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e45823de37d4462b6f18b92430cb90c)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:45.848706 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327b327-8370-4722-bb66-2cdf649003c3 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:45.950586 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:46.743806 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b327b327-8370-4722-bb66-2cdf649003c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e45823de37d4462b6f18b92430cb90c', 'request_id': 'req-b327b327-8370-4722-bb66-2cdf649003c3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:46.755457 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b327b327-8370-4722-bb66-2cdf649003c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e45823de37d4462b6f18b92430cb90c', 'request_id': 'req-b327b327-8370-4722-bb66-2cdf649003c3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:46.766489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b327b327-8370-4722-bb66-2cdf649003c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e45823de37d4462b6f18b92430cb90c', 'request_id': 'req-b327b327-8370-4722-bb66-2cdf649003c3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:46.925388 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b327b327-8370-4722-bb66-2cdf649003c3 admin admin] The token cache is being invalidate because project 0e45823de37d4462b6f18b92430cb90c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:59:46.927005 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b327b327-8370-4722-bb66-2cdf649003c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:46.932724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b327b327-8370-4722-bb66-2cdf649003c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:46.939724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1218/2471] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:59:45 2022] DELETE /identity/v3/projects/0e45823de37d4462b6f18b92430cb90c => generated 0 bytes in 1662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:46.947991 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59340dd8-314a-42f2-a21a-5a57775698b1 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:46.948561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59340dd8-314a-42f2-a21a-5a57775698b1 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:46.948561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59340dd8-314a-42f2-a21a-5a57775698b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:46.977049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-59340dd8-314a-42f2-a21a-5a57775698b1 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:46.978312 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-59340dd8-314a-42f2-a21a-5a57775698b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:47.098158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1254/2472] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:59:47.105817 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9d7a8-1a80-4fed-aa43-f48c07747968 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:47.106201 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9d7a8-1a80-4fed-aa43-f48c07747968 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:47.106639 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9d7a8-1a80-4fed-aa43-f48c07747968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:47.148800 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-29b9d7a8-1a80-4fed-aa43-f48c07747968 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:47.150050 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-29b9d7a8-1a80-4fed-aa43-f48c07747968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:47.173237 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1219/2473] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:47.177942 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59340dd8-314a-42f2-a21a-5a57775698b1 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:47.202094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59340dd8-314a-42f2-a21a-5a57775698b1 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:47.218696 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe06ca2-c4f1-4477-87c6-84730a07f082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:47.219395 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe06ca2-c4f1-4477-87c6-84730a07f082 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:47.219679 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe06ca2-c4f1-4477-87c6-84730a07f082 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:47.222411 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe06ca2-c4f1-4477-87c6-84730a07f082 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:47.227063 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe06ca2-c4f1-4477-87c6-84730a07f082 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:59:47.227400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe06ca2-c4f1-4477-87c6-84730a07f082 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:47.231423 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe06ca2-c4f1-4477-87c6-84730a07f082 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:47.294001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1255/2474] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 18:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:59:47.301753 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9d7a8-1a80-4fed-aa43-f48c07747968 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:47.318169 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9d7a8-1a80-4fed-aa43-f48c07747968 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:47.331002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52be213-f407-4edd-b56d-37dc4f13548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:47.332489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52be213-f407-4edd-b56d-37dc4f13548b admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:47.332788 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52be213-f407-4edd-b56d-37dc4f13548b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:47.333074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52be213-f407-4edd-b56d-37dc4f13548b admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:47.333881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52be213-f407-4edd-b56d-37dc4f13548b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:47.362611 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52be213-f407-4edd-b56d-37dc4f13548b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:47.527087 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1220/2475] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 18:59:47 2022] POST /identity/v3/projects => generated 385 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:59:47.531700 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe06ca2-c4f1-4477-87c6-84730a07f082 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:47.549720 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe06ca2-c4f1-4477-87c6-84730a07f082 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:47.738793 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb897cd-2c8d-4a1c-8ffa-79e437899fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:47.742606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb897cd-2c8d-4a1c-8ffa-79e437899fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:47.742606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb897cd-2c8d-4a1c-8ffa-79e437899fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:47.742606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb897cd-2c8d-4a1c-8ffa-79e437899fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:47.742606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb897cd-2c8d-4a1c-8ffa-79e437899fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:47.744535 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb897cd-2c8d-4a1c-8ffa-79e437899fb3 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:47.892216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1256/2476] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 18:59:47 2022] POST /identity/v3/users => generated 293 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:59:47.901936 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52be213-f407-4edd-b56d-37dc4f13548b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:47.916283 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52be213-f407-4edd-b56d-37dc4f13548b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:47.952209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82fa82-e5ff-4975-a650-378eba266ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:47.955630 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82fa82-e5ff-4975-a650-378eba266ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:47.958065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82fa82-e5ff-4975-a650-378eba266ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:47.958065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82fa82-e5ff-4975-a650-378eba266ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:47.958065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82fa82-e5ff-4975-a650-378eba266ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:47.964816 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82fa82-e5ff-4975-a650-378eba266ee7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:47.978673 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1221/2477] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:59:47.983103 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb897cd-2c8d-4a1c-8ffa-79e437899fb3 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:47.998257 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb897cd-2c8d-4a1c-8ffa-79e437899fb3 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:48.003940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5495d-b080-4f08-9b00-880515fd2f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:48.006219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5495d-b080-4f08-9b00-880515fd2f2d admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:48.006219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5495d-b080-4f08-9b00-880515fd2f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:48.006219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5495d-b080-4f08-9b00-880515fd2f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:48.007029 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5495d-b080-4f08-9b00-880515fd2f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:48.008920 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5495d-b080-4f08-9b00-880515fd2f2d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:48.030035 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1257/2478] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 18:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:59:48.034109 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82fa82-e5ff-4975-a650-378eba266ee7 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:48.047801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82fa82-e5ff-4975-a650-378eba266ee7 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:48.058600 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8ed59-99b1-4058-a334-9d2d70df036b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:48.061089 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8ed59-99b1-4058-a334-9d2d70df036b admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:48.061557 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8ed59-99b1-4058-a334-9d2d70df036b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:48.061849 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8ed59-99b1-4058-a334-9d2d70df036b admin admin] PATH_INFO: `/v3/projects/ef30bfb58d70414a97f8670381f9d36b/users/8a5e3a67ec0446e99d3de69f71a379cb/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:48.101848 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8ed59-99b1-4058-a334-9d2d70df036b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef30bfb58d70414a97f8670381f9d36b, user_id=8a5e3a67ec0446e99d3de69f71a379cb, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:48.107031 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8ed59-99b1-4058-a334-9d2d70df036b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:48.223998 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1222/2479] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 18:59:48 2022] PUT /identity/v3/projects/ef30bfb58d70414a97f8670381f9d36b/users/8a5e3a67ec0446e99d3de69f71a379cb/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:48.236395 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4039e16-4143-41e4-9ff7-baefcc9bc015 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:48.236757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4039e16-4143-41e4-9ff7-baefcc9bc015 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:48.237040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4039e16-4143-41e4-9ff7-baefcc9bc015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:48.298073 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-b4039e16-4143-41e4-9ff7-baefcc9bc015 None None] MFA Rules not processed for user `8a5e3a67ec0446e99d3de69f71a379cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:48.300410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b4039e16-4143-41e4-9ff7-baefcc9bc015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:48.375343 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:48.473660 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1258/2480] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:48.483025 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8ed59-99b1-4058-a334-9d2d70df036b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:48.485732 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c5a8ed59-99b1-4058-a334-9d2d70df036b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:48.639907 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8ed59-99b1-4058-a334-9d2d70df036b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:48.649985 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c99d6b-0daf-4d54-8e6c-3517c1317f95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:48.650664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c99d6b-0daf-4d54-8e6c-3517c1317f95 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:48.651130 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c99d6b-0daf-4d54-8e6c-3517c1317f95 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:48.651514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c99d6b-0daf-4d54-8e6c-3517c1317f95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:48.665249 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c99d6b-0daf-4d54-8e6c-3517c1317f95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:48.668543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c99d6b-0daf-4d54-8e6c-3517c1317f95 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:48.682643 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1223/2481] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:52.126820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4039e16-4143-41e4-9ff7-baefcc9bc015 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:52.211034 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4039e16-4143-41e4-9ff7-baefcc9bc015 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:52.215989 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ec18a-fa6a-47c1-811f-5c69283d5bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:52.216963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ec18a-fa6a-47c1-811f-5c69283d5bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:52.217244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ec18a-fa6a-47c1-811f-5c69283d5bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:52.217659 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ec18a-fa6a-47c1-811f-5c69283d5bc0 admin admin] PATH_INFO: `/v3/users/8a5e3a67ec0446e99d3de69f71a379cb` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:52.218821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ec18a-fa6a-47c1-811f-5c69283d5bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a5e3a67ec0446e99d3de69f71a379cb)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:52.221035 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ec18a-fa6a-47c1-811f-5c69283d5bc0 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:52.471522 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-be4ec18a-fa6a-47c1-811f-5c69283d5bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a5e3a67ec0446e99d3de69f71a379cb'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:52.472932 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-be4ec18a-fa6a-47c1-811f-5c69283d5bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a5e3a67ec0446e99d3de69f71a379cb'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:52.550324 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-be4ec18a-fa6a-47c1-811f-5c69283d5bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a5e3a67ec0446e99d3de69f71a379cb'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:52.559766 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-be4ec18a-fa6a-47c1-811f-5c69283d5bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a5e3a67ec0446e99d3de69f71a379cb'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:52.563394 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-be4ec18a-fa6a-47c1-811f-5c69283d5bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a5e3a67ec0446e99d3de69f71a379cb'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:52.591642 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1259/2482] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:59:52 2022] DELETE /identity/v3/users/8a5e3a67ec0446e99d3de69f71a379cb => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:52.596062 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6662-5153-4718-93e2-248e9cb0a9db None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:52.596846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6662-5153-4718-93e2-248e9cb0a9db None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:52.596846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6662-5153-4718-93e2-248e9cb0a9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:52.626090 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-2a1c6662-5153-4718-93e2-248e9cb0a9db None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:52.636311 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2a1c6662-5153-4718-93e2-248e9cb0a9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:52.718989 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:52.756407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1224/2483] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:52.778487 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ec18a-fa6a-47c1-811f-5c69283d5bc0 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:52.780265 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-be4ec18a-fa6a-47c1-811f-5c69283d5bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:52.911038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ec18a-fa6a-47c1-811f-5c69283d5bc0 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:52.923288 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e0ad0-50b1-4163-ad38-7c7115c7e345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:52.923976 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e0ad0-50b1-4163-ad38-7c7115c7e345 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:52.924267 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e0ad0-50b1-4163-ad38-7c7115c7e345 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:52.925336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e0ad0-50b1-4163-ad38-7c7115c7e345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:52.932646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:52.935070 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e0ad0-50b1-4163-ad38-7c7115c7e345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:52.936645 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e0ad0-50b1-4163-ad38-7c7115c7e345 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:52.958192 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1260/2484] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:53.080924 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b741e1-cfc0-4f8b-85c2-e68e4a03edfa None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:53.087761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b741e1-cfc0-4f8b-85c2-e68e4a03edfa None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:53.087761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b741e1-cfc0-4f8b-85c2-e68e4a03edfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:53.121126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-29b741e1-cfc0-4f8b-85c2-e68e4a03edfa None None] MFA Rules not processed for user `c6934275ec3448588ae7cf63ae3314d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:53.123728 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-29b741e1-cfc0-4f8b-85c2-e68e4a03edfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:53.210778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1225/2485] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:53.293398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e0ad0-50b1-4163-ad38-7c7115c7e345 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:53.295109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-4e5e0ad0-50b1-4163-ad38-7c7115c7e345 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:53.433354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e0ad0-50b1-4163-ad38-7c7115c7e345 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:53.438540 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e51f98-13eb-4439-9baf-3d2b9c654479 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00c13f10b14449cea284eb629a316d83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:53.439552 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e51f98-13eb-4439-9baf-3d2b9c654479 service glance] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:53.439842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e51f98-13eb-4439-9baf-3d2b9c654479 service glance] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:53.440119 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e51f98-13eb-4439-9baf-3d2b9c654479 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:53.448772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-67e51f98-13eb-4439-9baf-3d2b9c654479 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:53.597205 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e51f98-13eb-4439-9baf-3d2b9c654479 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:53.600474 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e51f98-13eb-4439-9baf-3d2b9c654479 service glance] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:53.611530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1261/2486] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:53.781189 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b741e1-cfc0-4f8b-85c2-e68e4a03edfa None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:53.783267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-29b741e1-cfc0-4f8b-85c2-e68e4a03edfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:53.827934 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b741e1-cfc0-4f8b-85c2-e68e4a03edfa None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:53.850844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d21040-374a-44b1-b4bb-b5c6519e6a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:53.850844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d21040-374a-44b1-b4bb-b5c6519e6a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:53.850844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d21040-374a-44b1-b4bb-b5c6519e6a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:53.850844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d21040-374a-44b1-b4bb-b5c6519e6a52 admin admin] PATH_INFO: `/v3/projects/ef30bfb58d70414a97f8670381f9d36b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:53.851216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d21040-374a-44b1-b4bb-b5c6519e6a52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef30bfb58d70414a97f8670381f9d36b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:53.853008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d21040-374a-44b1-b4bb-b5c6519e6a52 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:54.030189 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f26067-63e8-4af2-8f40-89d94adac0c9 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:54.030189 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f26067-63e8-4af2-8f40-89d94adac0c9 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:54.030189 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f26067-63e8-4af2-8f40-89d94adac0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:54.073246 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-10d21040-374a-44b1-b4bb-b5c6519e6a52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef30bfb58d70414a97f8670381f9d36b', 'request_id': 'req-10d21040-374a-44b1-b4bb-b5c6519e6a52'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:54.080804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-10d21040-374a-44b1-b4bb-b5c6519e6a52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef30bfb58d70414a97f8670381f9d36b', 'request_id': 'req-10d21040-374a-44b1-b4bb-b5c6519e6a52'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:54.089033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-10d21040-374a-44b1-b4bb-b5c6519e6a52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef30bfb58d70414a97f8670381f9d36b', 'request_id': 'req-10d21040-374a-44b1-b4bb-b5c6519e6a52'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:54.118506 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-17f26067-63e8-4af2-8f40-89d94adac0c9 None None] MFA Rules not processed for user `1eefe0d721484433b72afca03a2c1bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:54.119772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-17f26067-63e8-4af2-8f40-89d94adac0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:54.191506 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1262/2487] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Jun 16 18:59:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:59:54.201573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-10d21040-374a-44b1-b4bb-b5c6519e6a52 admin admin] The token cache is being invalidate because project ef30bfb58d70414a97f8670381f9d36b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:59:54.201872 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-10d21040-374a-44b1-b4bb-b5c6519e6a52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:54.202504 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-10d21040-374a-44b1-b4bb-b5c6519e6a52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:54.204062 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1226/2488] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 18:59:53 2022] DELETE /identity/v3/projects/ef30bfb58d70414a97f8670381f9d36b => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:54.217987 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f26067-63e8-4af2-8f40-89d94adac0c9 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:54.219490 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-17f26067-63e8-4af2-8f40-89d94adac0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:54.222983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:54.329312 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f26067-63e8-4af2-8f40-89d94adac0c9 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:54.334732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943a7c2-4824-40a0-bc10-929a94daddba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b45db002889846eda5b2a3e6917fcbe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:54.335461 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943a7c2-4824-40a0-bc10-929a94daddba service swift] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:54.335742 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943a7c2-4824-40a0-bc10-929a94daddba service swift] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:54.336019 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943a7c2-4824-40a0-bc10-929a94daddba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:54.338409 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-1943a7c2-4824-40a0-bc10-929a94daddba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:54.362271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943a7c2-4824-40a0-bc10-929a94daddba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:54.366026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943a7c2-4824-40a0-bc10-929a94daddba service swift] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:54.383260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1263/2489] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Jun 16 18:59:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:59:55.100630 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d21040-374a-44b1-b4bb-b5c6519e6a52 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:55.102076 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-10d21040-374a-44b1-b4bb-b5c6519e6a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:55.210686 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:55.298362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d21040-374a-44b1-b4bb-b5c6519e6a52 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:55.307278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5c052-2f37-41a8-8da8-7d9a644dc633 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3abe1d47a1164776bf3a82fe4b129d9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:55.316044 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5c052-2f37-41a8-8da8-7d9a644dc633 service placement] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:55.316044 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5c052-2f37-41a8-8da8-7d9a644dc633 service placement] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:55.316044 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5c052-2f37-41a8-8da8-7d9a644dc633 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:55.320984 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-54f5c052-2f37-41a8-8da8-7d9a644dc633 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:55.365230 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5c052-2f37-41a8-8da8-7d9a644dc633 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:55.367926 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5c052-2f37-41a8-8da8-7d9a644dc633 service placement] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:55.435129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1227/2490] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:56.131600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cdf5e-7aee-4649-89e0-c47390e42a0f None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:56.132230 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cdf5e-7aee-4649-89e0-c47390e42a0f None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:56.132230 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cdf5e-7aee-4649-89e0-c47390e42a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:56.175537 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-ee7cdf5e-7aee-4649-89e0-c47390e42a0f None None] MFA Rules not processed for user `1eefe0d721484433b72afca03a2c1bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:56.178648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-ee7cdf5e-7aee-4649-89e0-c47390e42a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:56.206686 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1264/2491] 10.222.0.93 () {58 vars in 967 bytes} [Thu Jun 16 18:59:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:56.215016 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5c052-2f37-41a8-8da8-7d9a644dc633 service placement] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:56.220350 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-54f5c052-2f37-41a8-8da8-7d9a644dc633 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:56.247715 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5c052-2f37-41a8-8da8-7d9a644dc633 service placement] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:56.258997 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634408f2-ef4f-4186-9b53-46285a109db1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b45db002889846eda5b2a3e6917fcbe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:56.259907 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634408f2-ef4f-4186-9b53-46285a109db1 service swift] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:56.260258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634408f2-ef4f-4186-9b53-46285a109db1 service swift] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:56.260659 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634408f2-ef4f-4186-9b53-46285a109db1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:56.270564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634408f2-ef4f-4186-9b53-46285a109db1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:56.272853 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634408f2-ef4f-4186-9b53-46285a109db1 service swift] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:56.293811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1228/2492] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Jun 16 18:59:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:59:59.544762 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cdf5e-7aee-4649-89e0-c47390e42a0f None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:59.546835 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-ee7cdf5e-7aee-4649-89e0-c47390e42a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:59.633884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cdf5e-7aee-4649-89e0-c47390e42a0f None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:59.638760 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe5fe9-f3e3-49bd-a0f6-e9cc62a84e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:59.639648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe5fe9-f3e3-49bd-a0f6-e9cc62a84e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:59.641380 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe5fe9-f3e3-49bd-a0f6-e9cc62a84e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:59.641380 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe5fe9-f3e3-49bd-a0f6-e9cc62a84e44 admin admin] PATH_INFO: `/v3/users/2799e5582e3f43f891c61e257c6bb664` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:59.641588 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe5fe9-f3e3-49bd-a0f6-e9cc62a84e44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2799e5582e3f43f891c61e257c6bb664)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:59.643840 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe5fe9-f3e3-49bd-a0f6-e9cc62a84e44 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:59.835165 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-09fe5fe9-f3e3-49bd-a0f6-e9cc62a84e44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2799e5582e3f43f891c61e257c6bb664'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:59.835906 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-09fe5fe9-f3e3-49bd-a0f6-e9cc62a84e44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2799e5582e3f43f891c61e257c6bb664'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:59.950422 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-09fe5fe9-f3e3-49bd-a0f6-e9cc62a84e44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2799e5582e3f43f891c61e257c6bb664'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:59.963078 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-09fe5fe9-f3e3-49bd-a0f6-e9cc62a84e44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2799e5582e3f43f891c61e257c6bb664'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:59.964003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-09fe5fe9-f3e3-49bd-a0f6-e9cc62a84e44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2799e5582e3f43f891c61e257c6bb664'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:59.972322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:59.994089 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1265/2493] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 18:59:59 2022] DELETE /identity/v3/users/2799e5582e3f43f891c61e257c6bb664 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:59.999527 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000581e7-6d5c-47c0-9e85-46721a514cd8 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:00.000583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000581e7-6d5c-47c0-9e85-46721a514cd8 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:00.000864 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000581e7-6d5c-47c0-9e85-46721a514cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:00.020127 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-000581e7-6d5c-47c0-9e85-46721a514cd8 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:00:00.021399 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-000581e7-6d5c-47c0-9e85-46721a514cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:00.102533 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1229/2494] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 18:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:00:00.112567 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe5fe9-f3e3-49bd-a0f6-e9cc62a84e44 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:00:00.114424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-09fe5fe9-f3e3-49bd-a0f6-e9cc62a84e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:00.182353 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe5fe9-f3e3-49bd-a0f6-e9cc62a84e44 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:00:00.188334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad1d4b-5cee-41be-89b4-51b70450d695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:00:00.189376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad1d4b-5cee-41be-89b4-51b70450d695 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:00.189826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad1d4b-5cee-41be-89b4-51b70450d695 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:00.190241 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad1d4b-5cee-41be-89b4-51b70450d695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:00.204242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad1d4b-5cee-41be-89b4-51b70450d695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:00:00.206242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad1d4b-5cee-41be-89b4-51b70450d695 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:00:00.218550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1266/2495] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:00:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:00:00.788120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000581e7-6d5c-47c0-9e85-46721a514cd8 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:00:00.789625 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-000581e7-6d5c-47c0-9e85-46721a514cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:00.802242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000581e7-6d5c-47c0-9e85-46721a514cd8 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:00:00.819636 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec0aee-7f9e-4c94-9e63-1cebedc82a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:00:00.820595 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec0aee-7f9e-4c94-9e63-1cebedc82a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:00.820888 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec0aee-7f9e-4c94-9e63-1cebedc82a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:00.822101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec0aee-7f9e-4c94-9e63-1cebedc82a75 admin admin] PATH_INFO: `/v3/projects/dd504cf0e67b4cf5b8e39221993c20ab` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:00.822729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec0aee-7f9e-4c94-9e63-1cebedc82a75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd504cf0e67b4cf5b8e39221993c20ab)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:00:00.837350 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec0aee-7f9e-4c94-9e63-1cebedc82a75 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:00:00.999269 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e7ec0aee-7f9e-4c94-9e63-1cebedc82a75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd504cf0e67b4cf5b8e39221993c20ab', 'request_id': 'req-e7ec0aee-7f9e-4c94-9e63-1cebedc82a75'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:00:01.007361 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e7ec0aee-7f9e-4c94-9e63-1cebedc82a75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd504cf0e67b4cf5b8e39221993c20ab', 'request_id': 'req-e7ec0aee-7f9e-4c94-9e63-1cebedc82a75'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:00:01.018130 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e7ec0aee-7f9e-4c94-9e63-1cebedc82a75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd504cf0e67b4cf5b8e39221993c20ab', 'request_id': 'req-e7ec0aee-7f9e-4c94-9e63-1cebedc82a75'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:00:01.101679 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e7ec0aee-7f9e-4c94-9e63-1cebedc82a75 admin admin] The token cache is being invalidate because project dd504cf0e67b4cf5b8e39221993c20ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:00:01.102079 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e7ec0aee-7f9e-4c94-9e63-1cebedc82a75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:00:01.102759 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-e7ec0aee-7f9e-4c94-9e63-1cebedc82a75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:00:01.105158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1230/2496] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:00:00 2022] DELETE /identity/v3/projects/dd504cf0e67b4cf5b8e39221993c20ab => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:00:01.114465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017fef3-820b-47d9-bb87-971bf093b244 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:01.114465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017fef3-820b-47d9-bb87-971bf093b244 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:01.114465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017fef3-820b-47d9-bb87-971bf093b244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:01.135029 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-2017fef3-820b-47d9-bb87-971bf093b244 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:00:01.136382 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2017fef3-820b-47d9-bb87-971bf093b244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:01.213631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1267/2497] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:00:01.223132 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6f1ec-6338-4215-afdf-5ba1b1499070 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:01.223552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6f1ec-6338-4215-afdf-5ba1b1499070 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:01.224272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6f1ec-6338-4215-afdf-5ba1b1499070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:01.252414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-adc6f1ec-6338-4215-afdf-5ba1b1499070 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:00:01.253633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-adc6f1ec-6338-4215-afdf-5ba1b1499070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:01.272513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1231/2498] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:00:01.275531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017fef3-820b-47d9-bb87-971bf093b244 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:00:01.292321 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017fef3-820b-47d9-bb87-971bf093b244 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:00:01.292802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b8117-ab38-41b4-b5a8-e9f0ebae857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:00:01.293131 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b8117-ab38-41b4-b5a8-e9f0ebae857c admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:01.293643 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b8117-ab38-41b4-b5a8-e9f0ebae857c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:01.293753 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b8117-ab38-41b4-b5a8-e9f0ebae857c admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:01.294427 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b8117-ab38-41b4-b5a8-e9f0ebae857c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:00:01.294738 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b8117-ab38-41b4-b5a8-e9f0ebae857c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:00:01.296530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b8117-ab38-41b4-b5a8-e9f0ebae857c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:00:01.310248 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1268/2499] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 19:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 19:00:01.317248 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6f1ec-6338-4215-afdf-5ba1b1499070 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:00:01.330152 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6f1ec-6338-4215-afdf-5ba1b1499070 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:00:01.335021 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13289e3-c226-483f-bd59-fa9a2778aa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:00:01.335697 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13289e3-c226-483f-bd59-fa9a2778aa10 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:01.335987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13289e3-c226-483f-bd59-fa9a2778aa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:01.336271 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13289e3-c226-483f-bd59-fa9a2778aa10 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:01.337061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13289e3-c226-483f-bd59-fa9a2778aa10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:00:01.338977 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13289e3-c226-483f-bd59-fa9a2778aa10 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:00:01.666881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1232/2500] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:00:01 2022] POST /identity/v3/projects => generated 371 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:00:01.672186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b8117-ab38-41b4-b5a8-e9f0ebae857c admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:00:01.682644 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b8117-ab38-41b4-b5a8-e9f0ebae857c admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:00:01.754626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2818c4-4a6b-4e38-be31-7f246218cd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:00:01.755331 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2818c4-4a6b-4e38-be31-7f246218cd7b admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:01.755862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2818c4-4a6b-4e38-be31-7f246218cd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:01.756186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2818c4-4a6b-4e38-be31-7f246218cd7b admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:01.757089 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2818c4-4a6b-4e38-be31-7f246218cd7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:00:01.759048 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2818c4-4a6b-4e38-be31-7f246218cd7b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:00:01.908383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1269/2501] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:00:01 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:00:01.909533 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13289e3-c226-483f-bd59-fa9a2778aa10 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:00:01.920748 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13289e3-c226-483f-bd59-fa9a2778aa10 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:00:01.925364 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b8d5b-a621-45e5-b75d-78dac95a7894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:00:01.926121 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b8d5b-a621-45e5-b75d-78dac95a7894 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:01.926388 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b8d5b-a621-45e5-b75d-78dac95a7894 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:01.926663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b8d5b-a621-45e5-b75d-78dac95a7894 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:01.927981 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b8d5b-a621-45e5-b75d-78dac95a7894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:00:01.929611 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b8d5b-a621-45e5-b75d-78dac95a7894 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:00:01.931814 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:01.940688 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1233/2502] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:00:01.945130 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2818c4-4a6b-4e38-be31-7f246218cd7b admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:00:01.951786 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:01.958296 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2818c4-4a6b-4e38-be31-7f246218cd7b admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:00:01.963371 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d13f53-4542-427e-b956-5bd3c5265a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:00:01.963934 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d13f53-4542-427e-b956-5bd3c5265a79 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:01.964208 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d13f53-4542-427e-b956-5bd3c5265a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:01.964600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d13f53-4542-427e-b956-5bd3c5265a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:01.965250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d13f53-4542-427e-b956-5bd3c5265a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:00:01.966909 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d13f53-4542-427e-b956-5bd3c5265a79 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:00:01.978553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1270/2503] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:00:01.982375 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b8d5b-a621-45e5-b75d-78dac95a7894 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:00:01.994079 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b8d5b-a621-45e5-b75d-78dac95a7894 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:00:01.999201 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7ffcf-48fb-4f5e-b453-80839d47275d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:00:02.000641 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7ffcf-48fb-4f5e-b453-80839d47275d admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:02.001306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7ffcf-48fb-4f5e-b453-80839d47275d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:02.001951 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7ffcf-48fb-4f5e-b453-80839d47275d admin admin] PATH_INFO: `/v3/projects/fcbd7525f117406f99e879db19a262d3/users/b688cd2391574928a0e5230ce898a4f7/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:02.022946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7ffcf-48fb-4f5e-b453-80839d47275d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcbd7525f117406f99e879db19a262d3, user_id=b688cd2391574928a0e5230ce898a4f7, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:00:02.026659 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7ffcf-48fb-4f5e-b453-80839d47275d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:00:02.116000 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1234/2504] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:00:01 2022] PUT /identity/v3/projects/fcbd7525f117406f99e879db19a262d3/users/b688cd2391574928a0e5230ce898a4f7/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:00:02.126153 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79894c6-f61b-4b69-8060-bafd97a3a54c None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:02.129985 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79894c6-f61b-4b69-8060-bafd97a3a54c None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:02.131121 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79894c6-f61b-4b69-8060-bafd97a3a54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:02.165810 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-e79894c6-f61b-4b69-8060-bafd97a3a54c None None] MFA Rules not processed for user `b688cd2391574928a0e5230ce898a4f7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:00:02.167048 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-e79894c6-f61b-4b69-8060-bafd97a3a54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:02.254993 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1271/2505] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:00:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:00:02.268516 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7ffcf-48fb-4f5e-b453-80839d47275d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:00:02.270332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-aac7ffcf-48fb-4f5e-b453-80839d47275d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:02.341454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7ffcf-48fb-4f5e-b453-80839d47275d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:00:02.345734 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd8c09-18db-4761-8309-a23a4e05a6d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:00:02.346588 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd8c09-18db-4761-8309-a23a4e05a6d1 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:02.347071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd8c09-18db-4761-8309-a23a4e05a6d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:02.347508 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd8c09-18db-4761-8309-a23a4e05a6d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:02.357361 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd8c09-18db-4761-8309-a23a4e05a6d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:00:02.359019 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd8c09-18db-4761-8309-a23a4e05a6d1 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:00:02.370553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1235/2506] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:00:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:00:02.409085 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79894c6-f61b-4b69-8060-bafd97a3a54c None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:00:02.504193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79894c6-f61b-4b69-8060-bafd97a3a54c None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:00:02.509974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e7ce9-58ff-4714-908c-f904ebe2b2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:00:02.511112 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e7ce9-58ff-4714-908c-f904ebe2b2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:02.511411 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e7ce9-58ff-4714-908c-f904ebe2b2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:02.511688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e7ce9-58ff-4714-908c-f904ebe2b2c8 admin admin] PATH_INFO: `/v3/users/b688cd2391574928a0e5230ce898a4f7` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:02.515077 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e7ce9-58ff-4714-908c-f904ebe2b2c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b688cd2391574928a0e5230ce898a4f7)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:00:02.517109 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e7ce9-58ff-4714-908c-f904ebe2b2c8 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:00:02.675341 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-c23e7ce9-58ff-4714-908c-f904ebe2b2c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b688cd2391574928a0e5230ce898a4f7'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:00:02.676105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-c23e7ce9-58ff-4714-908c-f904ebe2b2c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b688cd2391574928a0e5230ce898a4f7'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:00:02.749883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-c23e7ce9-58ff-4714-908c-f904ebe2b2c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b688cd2391574928a0e5230ce898a4f7'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:00:02.758726 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-c23e7ce9-58ff-4714-908c-f904ebe2b2c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b688cd2391574928a0e5230ce898a4f7'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:00:02.759363 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-c23e7ce9-58ff-4714-908c-f904ebe2b2c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b688cd2391574928a0e5230ce898a4f7'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:00:02.791180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1272/2507] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:00:02 2022] DELETE /identity/v3/users/b688cd2391574928a0e5230ce898a4f7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:00:02.796817 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1af269-b6d9-4851-a095-f0bc05b8a0bd None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:02.797111 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1af269-b6d9-4851-a095-f0bc05b8a0bd None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:02.797392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1af269-b6d9-4851-a095-f0bc05b8a0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:02.819249 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-0f1af269-b6d9-4851-a095-f0bc05b8a0bd None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:00:02.820656 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0f1af269-b6d9-4851-a095-f0bc05b8a0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:02.895102 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1236/2508] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:00:02.905035 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e7ce9-58ff-4714-908c-f904ebe2b2c8 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:00:02.907084 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c23e7ce9-58ff-4714-908c-f904ebe2b2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:02.913204 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:02.975997 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e7ce9-58ff-4714-908c-f904ebe2b2c8 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:00:02.981599 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95c6ec-4fa3-4dd5-9e45-7d19702cc44a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:00:02.982268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95c6ec-4fa3-4dd5-9e45-7d19702cc44a service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:02.982554 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95c6ec-4fa3-4dd5-9e45-7d19702cc44a service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:02.982831 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95c6ec-4fa3-4dd5-9e45-7d19702cc44a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:02.993201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95c6ec-4fa3-4dd5-9e45-7d19702cc44a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:00:02.995131 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95c6ec-4fa3-4dd5-9e45-7d19702cc44a service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:00:03.006537 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1273/2509] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:00:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:00:03.526979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1af269-b6d9-4851-a095-f0bc05b8a0bd None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:00:03.529648 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0f1af269-b6d9-4851-a095-f0bc05b8a0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:03.547804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1af269-b6d9-4851-a095-f0bc05b8a0bd None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:00:03.555060 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c6522-f0b0-4a73-874a-adb654d9919b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:00:03.556231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c6522-f0b0-4a73-874a-adb654d9919b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:03.556810 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c6522-f0b0-4a73-874a-adb654d9919b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:03.557187 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c6522-f0b0-4a73-874a-adb654d9919b admin admin] PATH_INFO: `/v3/projects/fcbd7525f117406f99e879db19a262d3` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:03.558778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c6522-f0b0-4a73-874a-adb654d9919b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcbd7525f117406f99e879db19a262d3)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:00:03.560909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c6522-f0b0-4a73-874a-adb654d9919b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:00:03.662104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-149c6522-f0b0-4a73-874a-adb654d9919b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcbd7525f117406f99e879db19a262d3', 'request_id': 'req-149c6522-f0b0-4a73-874a-adb654d9919b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:00:03.670698 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-149c6522-f0b0-4a73-874a-adb654d9919b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcbd7525f117406f99e879db19a262d3', 'request_id': 'req-149c6522-f0b0-4a73-874a-adb654d9919b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:00:03.678129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-149c6522-f0b0-4a73-874a-adb654d9919b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcbd7525f117406f99e879db19a262d3', 'request_id': 'req-149c6522-f0b0-4a73-874a-adb654d9919b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:00:03.768557 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:03.773382 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-149c6522-f0b0-4a73-874a-adb654d9919b admin admin] The token cache is being invalidate because project fcbd7525f117406f99e879db19a262d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:00:03.773681 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-149c6522-f0b0-4a73-874a-adb654d9919b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:00:03.774481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-149c6522-f0b0-4a73-874a-adb654d9919b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:00:03.776548 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1237/2510] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:00:03 2022] DELETE /identity/v3/projects/fcbd7525f117406f99e879db19a262d3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:00:06.233414 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed857d-1e4c-43ca-a436-981ad5b92508 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:06.233924 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed857d-1e4c-43ca-a436-981ad5b92508 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:06.234021 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed857d-1e4c-43ca-a436-981ad5b92508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:06.251602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-58ed857d-1e4c-43ca-a436-981ad5b92508 None None] MFA Rules not processed for user `8cd43532b520400e969b1929a6d0ed38`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:00:06.252843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-58ed857d-1e4c-43ca-a436-981ad5b92508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:06.310252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1274/2511] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:00:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:00:09.773631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5527e-37d3-486f-817b-e27c3c4fa9e9 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:09.774150 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5527e-37d3-486f-817b-e27c3c4fa9e9 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:09.774244 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5527e-37d3-486f-817b-e27c3c4fa9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:09.793104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-60d5527e-37d3-486f-817b-e27c3c4fa9e9 None None] MFA Rules not processed for user `1eefe0d721484433b72afca03a2c1bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:00:09.794261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-60d5527e-37d3-486f-817b-e27c3c4fa9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:09.851918 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1238/2512] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Jun 16 19:00:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:00:09.864064 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed857d-1e4c-43ca-a436-981ad5b92508 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:00:09.866049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-58ed857d-1e4c-43ca-a436-981ad5b92508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:09.936985 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed857d-1e4c-43ca-a436-981ad5b92508 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:00:09.942075 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe09dc1-e85f-4867-8d0b-3a08eed853db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b45db002889846eda5b2a3e6917fcbe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:00:09.945897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe09dc1-e85f-4867-8d0b-3a08eed853db service swift] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:09.945897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe09dc1-e85f-4867-8d0b-3a08eed853db service swift] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:09.945897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe09dc1-e85f-4867-8d0b-3a08eed853db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:09.954378 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe09dc1-e85f-4867-8d0b-3a08eed853db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:00:09.956031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe09dc1-e85f-4867-8d0b-3a08eed853db service swift] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:00:09.964384 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1275/2513] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Jun 16 19:00:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 19:00:19.844495 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=25 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:19.960905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=82 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:35.898565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5527e-37d3-486f-817b-e27c3c4fa9e9 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:00:35.900059 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-60d5527e-37d3-486f-817b-e27c3c4fa9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:35.955396 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5527e-37d3-486f-817b-e27c3c4fa9e9 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:00:35.959722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62db4a-1ce9-493c-a548-e8c7deb75326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:00:35.960392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62db4a-1ce9-493c-a548-e8c7deb75326 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:35.960700 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62db4a-1ce9-493c-a548-e8c7deb75326 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:35.960974 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62db4a-1ce9-493c-a548-e8c7deb75326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:35.962699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0d62db4a-1ce9-493c-a548-e8c7deb75326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:36.024114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62db4a-1ce9-493c-a548-e8c7deb75326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:00:36.025577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62db4a-1ce9-493c-a548-e8c7deb75326 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:00:36.035032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1239/2514] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:00:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 19:00:46.030777 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=50 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:47.869474 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523399a-16a9-4f0a-acaf-27199a145115 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:47.870049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523399a-16a9-4f0a-acaf-27199a145115 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:47.870049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523399a-16a9-4f0a-acaf-27199a145115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:47.889401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-f523399a-16a9-4f0a-acaf-27199a145115 None None] MFA Rules not processed for user `3c407a688b8948ed9c26aa2995678107`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:00:47.890671 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f523399a-16a9-4f0a-acaf-27199a145115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:47.957452 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1276/2515] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:00:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:00:50.132754 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083fa88-04b1-43b1-b9f2-414aed9548da None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:50.133259 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083fa88-04b1-43b1-b9f2-414aed9548da None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:50.133356 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083fa88-04b1-43b1-b9f2-414aed9548da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:50.151890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d083fa88-04b1-43b1-b9f2-414aed9548da None None] MFA Rules not processed for user `9813c801a8274c1abe49a0ff7457f119`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:00:50.153115 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d083fa88-04b1-43b1-b9f2-414aed9548da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:50.211643 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1240/2516] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:00:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:00:51.005874 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3458a-7eaa-4f05-83ef-b292d023d14a None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:51.006395 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3458a-7eaa-4f05-83ef-b292d023d14a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:51.006501 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3458a-7eaa-4f05-83ef-b292d023d14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:51.027846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-12c3458a-7eaa-4f05-83ef-b292d023d14a None None] MFA Rules not processed for user `2b29439f50a842da8d9a5ee9575a912d`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:00:51.029317 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-12c3458a-7eaa-4f05-83ef-b292d023d14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:51.097149 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1277/2517] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:00:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:00.204314 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=25 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:01.093665 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=50 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:51.150484 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083fa88-04b1-43b1-b9f2-414aed9548da None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:51.151894 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d083fa88-04b1-43b1-b9f2-414aed9548da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:51.208134 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083fa88-04b1-43b1-b9f2-414aed9548da None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:51.211737 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bb2b7-976e-459f-a4e7-a9d6f2dc868d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00c13f10b14449cea284eb629a316d83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:51.212380 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bb2b7-976e-459f-a4e7-a9d6f2dc868d service glance] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:51.212696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bb2b7-976e-459f-a4e7-a9d6f2dc868d service glance] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:51.212976 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bb2b7-976e-459f-a4e7-a9d6f2dc868d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:51.214726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-838bb2b7-976e-459f-a4e7-a9d6f2dc868d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:51.283642 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bb2b7-976e-459f-a4e7-a9d6f2dc868d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:51.285119 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bb2b7-976e-459f-a4e7-a9d6f2dc868d service glance] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:51.296805 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1241/2518] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:01:52.777518 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3458a-7eaa-4f05-83ef-b292d023d14a None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:52.789315 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3458a-7eaa-4f05-83ef-b292d023d14a None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:52.793138 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6bbf3-278b-410b-92cf-a95722e756ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:52.793970 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6bbf3-278b-410b-92cf-a95722e756ae service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:52.794264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6bbf3-278b-410b-92cf-a95722e756ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:52.794569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6bbf3-278b-410b-92cf-a95722e756ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:52.803431 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-74e6bbf3-278b-410b-92cf-a95722e756ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:52.818925 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6bbf3-278b-410b-92cf-a95722e756ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:52.821085 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6bbf3-278b-410b-92cf-a95722e756ae service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:52.844326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1278/2519] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:01:54.303266 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bb2b7-976e-459f-a4e7-a9d6f2dc868d service glance] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:54.312838 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bb2b7-976e-459f-a4e7-a9d6f2dc868d service glance] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:54.316541 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72757179-bdf0-412c-86c5-0cd249e8b605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:54.317260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72757179-bdf0-412c-86c5-0cd249e8b605 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:54.317545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72757179-bdf0-412c-86c5-0cd249e8b605 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:54.317821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72757179-bdf0-412c-86c5-0cd249e8b605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:54.319606 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-72757179-bdf0-412c-86c5-0cd249e8b605 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:54.385556 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72757179-bdf0-412c-86c5-0cd249e8b605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:54.386730 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72757179-bdf0-412c-86c5-0cd249e8b605 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:54.401478 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1242/2520] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:01:58.860094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6bbf3-278b-410b-92cf-a95722e756ae service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:58.864322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-74e6bbf3-278b-410b-92cf-a95722e756ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:58.876340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6bbf3-278b-410b-92cf-a95722e756ae service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:58.882064 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608336a2-5ab0-4f89-a153-a1f01419cdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:58.883074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608336a2-5ab0-4f89-a153-a1f01419cdce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:58.883373 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608336a2-5ab0-4f89-a153-a1f01419cdce admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:58.883655 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608336a2-5ab0-4f89-a153-a1f01419cdce admin admin] PATH_INFO: `/v3/users/3c407a688b8948ed9c26aa2995678107` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:58.884903 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608336a2-5ab0-4f89-a153-a1f01419cdce admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c407a688b8948ed9c26aa2995678107)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:58.886871 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608336a2-5ab0-4f89-a153-a1f01419cdce admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:59.083086 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-608336a2-5ab0-4f89-a153-a1f01419cdce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c407a688b8948ed9c26aa2995678107'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:59.083810 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-608336a2-5ab0-4f89-a153-a1f01419cdce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c407a688b8948ed9c26aa2995678107'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:59.177407 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-608336a2-5ab0-4f89-a153-a1f01419cdce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c407a688b8948ed9c26aa2995678107'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:59.184786 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-608336a2-5ab0-4f89-a153-a1f01419cdce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c407a688b8948ed9c26aa2995678107'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:59.185418 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-608336a2-5ab0-4f89-a153-a1f01419cdce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c407a688b8948ed9c26aa2995678107'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:59.203333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1279/2521] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:01:58 2022] DELETE /identity/v3/users/3c407a688b8948ed9c26aa2995678107 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:59.475625 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72757179-bdf0-412c-86c5-0cd249e8b605 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:59.486214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72757179-bdf0-412c-86c5-0cd249e8b605 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:59.520024 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:59.545674 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3e138-491e-4902-831f-fb79ee575c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:59.546555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3e138-491e-4902-831f-fb79ee575c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:59.546840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3e138-491e-4902-831f-fb79ee575c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:59.547146 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3e138-491e-4902-831f-fb79ee575c8f admin admin] PATH_INFO: `/v3/projects/49764ca2dd464b908befc973a04d867a` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:59.548411 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3e138-491e-4902-831f-fb79ee575c8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=49764ca2dd464b908befc973a04d867a)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:59.550354 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3e138-491e-4902-831f-fb79ee575c8f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:59.641596 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c9b3e138-491e-4902-831f-fb79ee575c8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49764ca2dd464b908befc973a04d867a', 'request_id': 'req-c9b3e138-491e-4902-831f-fb79ee575c8f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:59.647766 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c9b3e138-491e-4902-831f-fb79ee575c8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49764ca2dd464b908befc973a04d867a', 'request_id': 'req-c9b3e138-491e-4902-831f-fb79ee575c8f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:59.654155 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c9b3e138-491e-4902-831f-fb79ee575c8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49764ca2dd464b908befc973a04d867a', 'request_id': 'req-c9b3e138-491e-4902-831f-fb79ee575c8f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:59.754885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c9b3e138-491e-4902-831f-fb79ee575c8f admin admin] The token cache is being invalidate because project 49764ca2dd464b908befc973a04d867a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:01:59.754885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c9b3e138-491e-4902-831f-fb79ee575c8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:59.754885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c9b3e138-491e-4902-831f-fb79ee575c8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:59.754885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1243/2522] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:01:59 2022] DELETE /identity/v3/projects/49764ca2dd464b908befc973a04d867a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:59.759393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bc0f4-1db6-4795-9855-395d130c2fc0 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:59.760835 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bc0f4-1db6-4795-9855-395d130c2fc0 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:59.761129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bc0f4-1db6-4795-9855-395d130c2fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:59.783080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-042bc0f4-1db6-4795-9855-395d130c2fc0 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:59.784287 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-042bc0f4-1db6-4795-9855-395d130c2fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:59.845539 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1280/2523] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:59.854623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14730c1-954b-4b23-914e-785235965212 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:59.854920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14730c1-954b-4b23-914e-785235965212 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:59.855205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14730c1-954b-4b23-914e-785235965212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:59.874074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f14730c1-954b-4b23-914e-785235965212 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:59.876936 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f14730c1-954b-4b23-914e-785235965212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:59.883722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1244/2524] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:59.888139 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bc0f4-1db6-4795-9855-395d130c2fc0 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:59.899089 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bc0f4-1db6-4795-9855-395d130c2fc0 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:59.903850 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f20cd1-5ab0-42c4-aaa6-b1ac37ea89c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:59.908772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f20cd1-5ab0-42c4-aaa6-b1ac37ea89c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:59.908772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f20cd1-5ab0-42c4-aaa6-b1ac37ea89c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:59.908772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f20cd1-5ab0-42c4-aaa6-b1ac37ea89c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:59.908772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f20cd1-5ab0-42c4-aaa6-b1ac37ea89c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:01:59.908772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f20cd1-5ab0-42c4-aaa6-b1ac37ea89c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:59.908772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f20cd1-5ab0-42c4-aaa6-b1ac37ea89c5 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:59.924341 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1281/2525] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 19:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 19:01:59.928837 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14730c1-954b-4b23-914e-785235965212 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:59.938725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14730c1-954b-4b23-914e-785235965212 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:59.943700 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f779c-53b2-451f-9078-d798b1b68bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:59.944400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f779c-53b2-451f-9078-d798b1b68bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:59.944720 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f779c-53b2-451f-9078-d798b1b68bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:59.945004 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f779c-53b2-451f-9078-d798b1b68bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:59.945749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f779c-53b2-451f-9078-d798b1b68bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:59.947761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f779c-53b2-451f-9078-d798b1b68bd4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:00.046793 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1245/2526] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:01:59 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:02:00.048133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f20cd1-5ab0-42c4-aaa6-b1ac37ea89c5 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:00.058652 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f20cd1-5ab0-42c4-aaa6-b1ac37ea89c5 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:00.123454 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:00.123454 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50546f85-cf75-40e5-a07d-2cc476bc0c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:00.123454 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50546f85-cf75-40e5-a07d-2cc476bc0c4f admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:00.123454 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50546f85-cf75-40e5-a07d-2cc476bc0c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:00.124468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50546f85-cf75-40e5-a07d-2cc476bc0c4f admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:00.124468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50546f85-cf75-40e5-a07d-2cc476bc0c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:00.124468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50546f85-cf75-40e5-a07d-2cc476bc0c4f admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:00.230014 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1282/2527] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:02:00 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:02:00.231247 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f779c-53b2-451f-9078-d798b1b68bd4 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:00.241829 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f779c-53b2-451f-9078-d798b1b68bd4 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:00.246910 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9538d18-ace9-4ec0-8682-ebdbb96af699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:00.247586 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9538d18-ace9-4ec0-8682-ebdbb96af699 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:00.247880 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9538d18-ace9-4ec0-8682-ebdbb96af699 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:00.248164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9538d18-ace9-4ec0-8682-ebdbb96af699 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:00.248953 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9538d18-ace9-4ec0-8682-ebdbb96af699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:00.250568 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9538d18-ace9-4ec0-8682-ebdbb96af699 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:00.262745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1246/2528] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:02:00.269371 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50546f85-cf75-40e5-a07d-2cc476bc0c4f admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:00.280555 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50546f85-cf75-40e5-a07d-2cc476bc0c4f admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:00.285658 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb05b5e-c255-4805-ba93-26a96c0a48d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:00.286340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb05b5e-c255-4805-ba93-26a96c0a48d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:00.286625 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb05b5e-c255-4805-ba93-26a96c0a48d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:00.286900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb05b5e-c255-4805-ba93-26a96c0a48d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:00.287640 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb05b5e-c255-4805-ba93-26a96c0a48d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:00.289441 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb05b5e-c255-4805-ba93-26a96c0a48d8 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:00.300741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1283/2529] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:02:00.304921 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9538d18-ace9-4ec0-8682-ebdbb96af699 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:00.315249 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9538d18-ace9-4ec0-8682-ebdbb96af699 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:00.320670 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d847c2-81e5-4701-8414-1e03eceb95c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:00.321510 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d847c2-81e5-4701-8414-1e03eceb95c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:00.321790 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d847c2-81e5-4701-8414-1e03eceb95c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:00.322063 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d847c2-81e5-4701-8414-1e03eceb95c6 admin admin] PATH_INFO: `/v3/projects/caaf21e7cdd44bb8ac97f61f1dc8f646/users/0988bb8d8f1d41d98247ed11b1127813/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:00.340376 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d847c2-81e5-4701-8414-1e03eceb95c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caaf21e7cdd44bb8ac97f61f1dc8f646, user_id=0988bb8d8f1d41d98247ed11b1127813, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:00.343852 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d847c2-81e5-4701-8414-1e03eceb95c6 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:00.435483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1247/2530] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:02:00 2022] PUT /identity/v3/projects/caaf21e7cdd44bb8ac97f61f1dc8f646/users/0988bb8d8f1d41d98247ed11b1127813/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:00.446598 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c06094-3f5f-47b7-803f-1e16eb78aac2 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:00.446945 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c06094-3f5f-47b7-803f-1e16eb78aac2 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:00.447238 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c06094-3f5f-47b7-803f-1e16eb78aac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:00.475606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-d8c06094-3f5f-47b7-803f-1e16eb78aac2 None None] MFA Rules not processed for user `0988bb8d8f1d41d98247ed11b1127813`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:00.476921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-d8c06094-3f5f-47b7-803f-1e16eb78aac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:00.556264 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1284/2531] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:02:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:02:00.561137 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d847c2-81e5-4701-8414-1e03eceb95c6 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:00.663637 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d847c2-81e5-4701-8414-1e03eceb95c6 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:00.684988 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5837d0-ce37-434f-8025-b21dd56e691c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:00.684988 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5837d0-ce37-434f-8025-b21dd56e691c admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:00.684988 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5837d0-ce37-434f-8025-b21dd56e691c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:00.684988 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5837d0-ce37-434f-8025-b21dd56e691c admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:00.685305 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5837d0-ce37-434f-8025-b21dd56e691c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:00.686735 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5837d0-ce37-434f-8025-b21dd56e691c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:00.716467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:00.805095 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1248/2532] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:02:00 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:02:00.808955 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c06094-3f5f-47b7-803f-1e16eb78aac2 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:00.821201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c06094-3f5f-47b7-803f-1e16eb78aac2 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:00.900398 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2eabfd-61f6-405f-bfef-b93d9e42e35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:00.901296 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eabfd-61f6-405f-bfef-b93d9e42e35e admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:00.901983 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eabfd-61f6-405f-bfef-b93d9e42e35e admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:00.902107 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eabfd-61f6-405f-bfef-b93d9e42e35e admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:00.902914 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2eabfd-61f6-405f-bfef-b93d9e42e35e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:00.905108 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2eabfd-61f6-405f-bfef-b93d9e42e35e admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:00.999788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1285/2533] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:02:00 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:02:01.001239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5837d0-ce37-434f-8025-b21dd56e691c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:01.015677 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5837d0-ce37-434f-8025-b21dd56e691c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:01.022489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eba09c-0e78-4246-8137-1615c8f558a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:01.023431 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eba09c-0e78-4246-8137-1615c8f558a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:01.023730 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eba09c-0e78-4246-8137-1615c8f558a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:01.024013 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eba09c-0e78-4246-8137-1615c8f558a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:01.025230 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eba09c-0e78-4246-8137-1615c8f558a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:01.026553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eba09c-0e78-4246-8137-1615c8f558a7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:01.048248 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2eabfd-61f6-405f-bfef-b93d9e42e35e admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:01.048836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1249/2534] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:02:01.068797 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2eabfd-61f6-405f-bfef-b93d9e42e35e admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:01.077393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206b85e-4bf8-48ce-8247-cbe6510f12cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:01.078704 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206b85e-4bf8-48ce-8247-cbe6510f12cc admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:01.079758 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206b85e-4bf8-48ce-8247-cbe6510f12cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:01.080942 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206b85e-4bf8-48ce-8247-cbe6510f12cc admin admin] PATH_INFO: `/v3/projects/acbf286e9b0e483088a1c843985d569b/users/36c00d5be5304e0c9f7f6481f497f11e/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:01.100615 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206b85e-4bf8-48ce-8247-cbe6510f12cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbf286e9b0e483088a1c843985d569b, user_id=36c00d5be5304e0c9f7f6481f497f11e, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:01.103365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206b85e-4bf8-48ce-8247-cbe6510f12cc admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:01.201841 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1286/2535] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:02:01 2022] PUT /identity/v3/projects/acbf286e9b0e483088a1c843985d569b/users/36c00d5be5304e0c9f7f6481f497f11e/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:01.206586 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eba09c-0e78-4246-8137-1615c8f558a7 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:01.220294 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eba09c-0e78-4246-8137-1615c8f558a7 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:01.302534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a623662-29e7-48af-b8fe-a5276c6f79f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:01.302534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a623662-29e7-48af-b8fe-a5276c6f79f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:01.302534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a623662-29e7-48af-b8fe-a5276c6f79f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:01.302534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a623662-29e7-48af-b8fe-a5276c6f79f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:01.302849 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a623662-29e7-48af-b8fe-a5276c6f79f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:01.303312 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a623662-29e7-48af-b8fe-a5276c6f79f8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:01.316504 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1250/2536] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 19:02:01.321127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206b85e-4bf8-48ce-8247-cbe6510f12cc admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:01.331999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206b85e-4bf8-48ce-8247-cbe6510f12cc admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:01.337305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299a8af-3071-4347-b050-41fcc0c9eb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:01.338211 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299a8af-3071-4347-b050-41fcc0c9eb86 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:01.338496 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299a8af-3071-4347-b050-41fcc0c9eb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:01.338774 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299a8af-3071-4347-b050-41fcc0c9eb86 admin admin] PATH_INFO: `/v3/projects/acbf286e9b0e483088a1c843985d569b/users/36c00d5be5304e0c9f7f6481f497f11e/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:01.341843 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299a8af-3071-4347-b050-41fcc0c9eb86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbf286e9b0e483088a1c843985d569b, user_id=36c00d5be5304e0c9f7f6481f497f11e, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:01.344255 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299a8af-3071-4347-b050-41fcc0c9eb86 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:01.357380 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1287/2537] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:02:01 2022] PUT /identity/v3/projects/acbf286e9b0e483088a1c843985d569b/users/36c00d5be5304e0c9f7f6481f497f11e/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 19:02:01.369430 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aa83c-8ed2-4579-9178-019005e90504 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:01.371451 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aa83c-8ed2-4579-9178-019005e90504 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:01.371451 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aa83c-8ed2-4579-9178-019005e90504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:01.402144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-e76aa83c-8ed2-4579-9178-019005e90504 None None] MFA Rules not processed for user `36c00d5be5304e0c9f7f6481f497f11e`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:01.403355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e76aa83c-8ed2-4579-9178-019005e90504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:01.497762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1251/2538] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:02:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:01.509478 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299a8af-3071-4347-b050-41fcc0c9eb86 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:01.511098 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-a299a8af-3071-4347-b050-41fcc0c9eb86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:01.522423 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:01.578918 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299a8af-3071-4347-b050-41fcc0c9eb86 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:01.583124 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995a251-5b80-4556-ba4f-fd64a9e9ca38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:01.583797 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995a251-5b80-4556-ba4f-fd64a9e9ca38 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:01.584087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995a251-5b80-4556-ba4f-fd64a9e9ca38 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:01.584396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995a251-5b80-4556-ba4f-fd64a9e9ca38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:01.594515 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995a251-5b80-4556-ba4f-fd64a9e9ca38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:01.595969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995a251-5b80-4556-ba4f-fd64a9e9ca38 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:01.607342 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1288/2539] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:02:01.711915 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76aa83c-8ed2-4579-9178-019005e90504 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:01.713663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e76aa83c-8ed2-4579-9178-019005e90504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:01.727792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76aa83c-8ed2-4579-9178-019005e90504 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:01.733000 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00260d3-78b5-4f24-b367-86aabbd1d838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:01.733603 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00260d3-78b5-4f24-b367-86aabbd1d838 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:01.733890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00260d3-78b5-4f24-b367-86aabbd1d838 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:01.734170 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00260d3-78b5-4f24-b367-86aabbd1d838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:01.808652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:01.811367 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00260d3-78b5-4f24-b367-86aabbd1d838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:01.812944 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00260d3-78b5-4f24-b367-86aabbd1d838 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:01.822980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1252/2540] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:02:05.056733 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995a251-5b80-4556-ba4f-fd64a9e9ca38 service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:05.159577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995a251-5b80-4556-ba4f-fd64a9e9ca38 service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:05.164819 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89271901-3b68-436f-b2de-485ab491c232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:05.172058 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89271901-3b68-436f-b2de-485ab491c232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:05.172058 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89271901-3b68-436f-b2de-485ab491c232 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:05.172058 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89271901-3b68-436f-b2de-485ab491c232 admin admin] PATH_INFO: `/v3/users/0988bb8d8f1d41d98247ed11b1127813` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:05.172058 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89271901-3b68-436f-b2de-485ab491c232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0988bb8d8f1d41d98247ed11b1127813)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:05.172058 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89271901-3b68-436f-b2de-485ab491c232 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:05.362474 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-89271901-3b68-436f-b2de-485ab491c232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0988bb8d8f1d41d98247ed11b1127813'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:05.363188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-89271901-3b68-436f-b2de-485ab491c232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0988bb8d8f1d41d98247ed11b1127813'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:05.455893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-89271901-3b68-436f-b2de-485ab491c232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0988bb8d8f1d41d98247ed11b1127813'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:05.463763 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-89271901-3b68-436f-b2de-485ab491c232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0988bb8d8f1d41d98247ed11b1127813'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:05.464630 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-89271901-3b68-436f-b2de-485ab491c232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0988bb8d8f1d41d98247ed11b1127813'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:05.482418 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1289/2541] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:02:05 2022] DELETE /identity/v3/users/0988bb8d8f1d41d98247ed11b1127813 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:05.486839 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fae02-e54d-49d0-8b32-015ec8f59e80 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:05.487650 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fae02-e54d-49d0-8b32-015ec8f59e80 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:05.488007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fae02-e54d-49d0-8b32-015ec8f59e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:05.505631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-151fae02-e54d-49d0-8b32-015ec8f59e80 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:05.506910 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-151fae02-e54d-49d0-8b32-015ec8f59e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:05.577304 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1253/2542] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:05.587434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89271901-3b68-436f-b2de-485ab491c232 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:05.589818 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-89271901-3b68-436f-b2de-485ab491c232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:05.621253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:05.648719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89271901-3b68-436f-b2de-485ab491c232 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:05.652603 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f6270-349c-4609-853f-095f792bec90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:05.653283 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f6270-349c-4609-853f-095f792bec90 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:05.653667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f6270-349c-4609-853f-095f792bec90 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:05.653998 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f6270-349c-4609-853f-095f792bec90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:05.663528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f6270-349c-4609-853f-095f792bec90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:05.665002 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f6270-349c-4609-853f-095f792bec90 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:05.675001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1290/2543] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:02:06.134096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fae02-e54d-49d0-8b32-015ec8f59e80 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:06.135677 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-151fae02-e54d-49d0-8b32-015ec8f59e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:06.151980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fae02-e54d-49d0-8b32-015ec8f59e80 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:06.160421 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded43fdb-c79d-4779-b9e8-b49ed8f4eb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:06.161412 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded43fdb-c79d-4779-b9e8-b49ed8f4eb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:06.161771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded43fdb-c79d-4779-b9e8-b49ed8f4eb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:06.162686 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded43fdb-c79d-4779-b9e8-b49ed8f4eb29 admin admin] PATH_INFO: `/v3/projects/caaf21e7cdd44bb8ac97f61f1dc8f646` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:06.164611 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded43fdb-c79d-4779-b9e8-b49ed8f4eb29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caaf21e7cdd44bb8ac97f61f1dc8f646)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:06.166254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded43fdb-c79d-4779-b9e8-b49ed8f4eb29 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:06.315705 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ded43fdb-c79d-4779-b9e8-b49ed8f4eb29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caaf21e7cdd44bb8ac97f61f1dc8f646', 'request_id': 'req-ded43fdb-c79d-4779-b9e8-b49ed8f4eb29'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:06.322286 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ded43fdb-c79d-4779-b9e8-b49ed8f4eb29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caaf21e7cdd44bb8ac97f61f1dc8f646', 'request_id': 'req-ded43fdb-c79d-4779-b9e8-b49ed8f4eb29'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:06.328809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ded43fdb-c79d-4779-b9e8-b49ed8f4eb29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caaf21e7cdd44bb8ac97f61f1dc8f646', 'request_id': 'req-ded43fdb-c79d-4779-b9e8-b49ed8f4eb29'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:06.480464 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ded43fdb-c79d-4779-b9e8-b49ed8f4eb29 admin admin] The token cache is being invalidate because project caaf21e7cdd44bb8ac97f61f1dc8f646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:02:06.480953 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ded43fdb-c79d-4779-b9e8-b49ed8f4eb29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:06.481889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ded43fdb-c79d-4779-b9e8-b49ed8f4eb29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:06.483667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1254/2544] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:02:06 2022] DELETE /identity/v3/projects/caaf21e7cdd44bb8ac97f61f1dc8f646 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:06.487650 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f6270-349c-4609-853f-095f792bec90 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:06.500397 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f6270-349c-4609-853f-095f792bec90 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:06.563466 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61a619-c5ab-4b55-9320-bde896a3dfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:06.564343 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61a619-c5ab-4b55-9320-bde896a3dfb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:06.564654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61a619-c5ab-4b55-9320-bde896a3dfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:06.564926 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61a619-c5ab-4b55-9320-bde896a3dfb9 admin admin] PATH_INFO: `/v3/users/36c00d5be5304e0c9f7f6481f497f11e` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:06.566190 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61a619-c5ab-4b55-9320-bde896a3dfb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c00d5be5304e0c9f7f6481f497f11e)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:06.568564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61a619-c5ab-4b55-9320-bde896a3dfb9 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:06.807085 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-bc61a619-c5ab-4b55-9320-bde896a3dfb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c00d5be5304e0c9f7f6481f497f11e'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:06.807729 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-bc61a619-c5ab-4b55-9320-bde896a3dfb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c00d5be5304e0c9f7f6481f497f11e'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:06.902550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-bc61a619-c5ab-4b55-9320-bde896a3dfb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c00d5be5304e0c9f7f6481f497f11e'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:06.910652 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-bc61a619-c5ab-4b55-9320-bde896a3dfb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c00d5be5304e0c9f7f6481f497f11e'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:06.913003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-bc61a619-c5ab-4b55-9320-bde896a3dfb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c00d5be5304e0c9f7f6481f497f11e'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:06.929511 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1291/2545] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:02:06 2022] DELETE /identity/v3/users/36c00d5be5304e0c9f7f6481f497f11e => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:07.447663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded43fdb-c79d-4779-b9e8-b49ed8f4eb29 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:07.449185 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ded43fdb-c79d-4779-b9e8-b49ed8f4eb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:07.462382 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded43fdb-c79d-4779-b9e8-b49ed8f4eb29 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:07.531274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c131a-43ac-47f3-9c70-b4c1923fcdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:07.532145 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c131a-43ac-47f3-9c70-b4c1923fcdf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:07.532460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c131a-43ac-47f3-9c70-b4c1923fcdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:07.532740 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c131a-43ac-47f3-9c70-b4c1923fcdf7 admin admin] PATH_INFO: `/v3/projects/acbf286e9b0e483088a1c843985d569b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:07.533938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c131a-43ac-47f3-9c70-b4c1923fcdf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acbf286e9b0e483088a1c843985d569b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:07.535892 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c131a-43ac-47f3-9c70-b4c1923fcdf7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:07.565968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:07.685060 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-867c131a-43ac-47f3-9c70-b4c1923fcdf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acbf286e9b0e483088a1c843985d569b', 'request_id': 'req-867c131a-43ac-47f3-9c70-b4c1923fcdf7'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:07.690503 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-867c131a-43ac-47f3-9c70-b4c1923fcdf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acbf286e9b0e483088a1c843985d569b', 'request_id': 'req-867c131a-43ac-47f3-9c70-b4c1923fcdf7'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:07.696703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-867c131a-43ac-47f3-9c70-b4c1923fcdf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acbf286e9b0e483088a1c843985d569b', 'request_id': 'req-867c131a-43ac-47f3-9c70-b4c1923fcdf7'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:07.799605 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-867c131a-43ac-47f3-9c70-b4c1923fcdf7 admin admin] The token cache is being invalidate because project acbf286e9b0e483088a1c843985d569b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:02:07.799898 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-867c131a-43ac-47f3-9c70-b4c1923fcdf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:07.800569 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-867c131a-43ac-47f3-9c70-b4c1923fcdf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:07.802850 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1255/2546] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:02:07 2022] DELETE /identity/v3/projects/acbf286e9b0e483088a1c843985d569b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:07.807857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbc537-447f-41fe-8bad-40ff77d4e63b None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:07.813626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbc537-447f-41fe-8bad-40ff77d4e63b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:07.813626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbc537-447f-41fe-8bad-40ff77d4e63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:07.826542 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-59fbc537-447f-41fe-8bad-40ff77d4e63b None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:07.827777 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-59fbc537-447f-41fe-8bad-40ff77d4e63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:07.886455 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:07.903289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1292/2547] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:07.911645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea37d9-e0d2-4212-a8bb-5d2307346a1d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:07.911931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea37d9-e0d2-4212-a8bb-5d2307346a1d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:07.912218 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea37d9-e0d2-4212-a8bb-5d2307346a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:07.931669 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f4ea37d9-e0d2-4212-a8bb-5d2307346a1d None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:07.933044 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f4ea37d9-e0d2-4212-a8bb-5d2307346a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:07.941294 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1256/2548] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:07.959141 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbc537-447f-41fe-8bad-40ff77d4e63b None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:07.968808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbc537-447f-41fe-8bad-40ff77d4e63b None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:07.974251 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a035f29-17c8-40a9-98d6-2e6d854be5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:07.974913 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a035f29-17c8-40a9-98d6-2e6d854be5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:07.975201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a035f29-17c8-40a9-98d6-2e6d854be5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:07.975503 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a035f29-17c8-40a9-98d6-2e6d854be5b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:07.976234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a035f29-17c8-40a9-98d6-2e6d854be5b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:02:07.976576 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a035f29-17c8-40a9-98d6-2e6d854be5b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:07.978351 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a035f29-17c8-40a9-98d6-2e6d854be5b6 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:07.990463 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1293/2549] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 19:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 19:02:07.994689 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea37d9-e0d2-4212-a8bb-5d2307346a1d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:08.004261 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea37d9-e0d2-4212-a8bb-5d2307346a1d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:08.009001 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0173e4-7d58-4b63-bf50-65ed7ee8700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:08.009659 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0173e4-7d58-4b63-bf50-65ed7ee8700e admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:08.009999 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0173e4-7d58-4b63-bf50-65ed7ee8700e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:08.010233 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0173e4-7d58-4b63-bf50-65ed7ee8700e admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:08.010945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0173e4-7d58-4b63-bf50-65ed7ee8700e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:08.012881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0173e4-7d58-4b63-bf50-65ed7ee8700e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:08.089676 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a035f29-17c8-40a9-98d6-2e6d854be5b6 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:08.091392 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-7a035f29-17c8-40a9-98d6-2e6d854be5b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:08.113024 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1257/2550] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:02:07 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:02:08.114400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0173e4-7d58-4b63-bf50-65ed7ee8700e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:08.171428 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a035f29-17c8-40a9-98d6-2e6d854be5b6 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:08.177987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0173e4-7d58-4b63-bf50-65ed7ee8700e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:08.182727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb810715-8029-43cb-9e1e-10db7530b24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:08.183399 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb810715-8029-43cb-9e1e-10db7530b24e admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:08.183685 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb810715-8029-43cb-9e1e-10db7530b24e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:08.183964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb810715-8029-43cb-9e1e-10db7530b24e admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:08.184695 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb810715-8029-43cb-9e1e-10db7530b24e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:08.186611 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb810715-8029-43cb-9e1e-10db7530b24e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:08.235954 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e22eb7-cdff-469a-acc5-fc48a9e0eece service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:08.236559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e22eb7-cdff-469a-acc5-fc48a9e0eece service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:08.236848 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e22eb7-cdff-469a-acc5-fc48a9e0eece service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:08.237126 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e22eb7-cdff-469a-acc5-fc48a9e0eece service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:08.238949 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c4e22eb7-cdff-469a-acc5-fc48a9e0eece service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:08.297639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e22eb7-cdff-469a-acc5-fc48a9e0eece service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:08.299250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e22eb7-cdff-469a-acc5-fc48a9e0eece service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:08.308733 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1294/2551] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 19:02:08.309480 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1258/2552] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:02:08 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:02:08.313692 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e22eb7-cdff-469a-acc5-fc48a9e0eece service nova] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:08.329129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e22eb7-cdff-469a-acc5-fc48a9e0eece service nova] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:08.329129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c00e6-8474-4bf4-908f-0f0fb2b39030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:08.329454 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c00e6-8474-4bf4-908f-0f0fb2b39030 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:08.329744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c00e6-8474-4bf4-908f-0f0fb2b39030 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:08.330031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c00e6-8474-4bf4-908f-0f0fb2b39030 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:08.330761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c00e6-8474-4bf4-908f-0f0fb2b39030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:08.332353 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c00e6-8474-4bf4-908f-0f0fb2b39030 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:08.343097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1295/2553] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 19:02:08.347429 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb810715-8029-43cb-9e1e-10db7530b24e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:08.358680 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb810715-8029-43cb-9e1e-10db7530b24e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:08.363356 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44461d90-fdef-4b21-85b6-4c638cbaa05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:08.364055 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44461d90-fdef-4b21-85b6-4c638cbaa05d admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:08.364345 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44461d90-fdef-4b21-85b6-4c638cbaa05d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:08.364650 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44461d90-fdef-4b21-85b6-4c638cbaa05d admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:08.365461 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44461d90-fdef-4b21-85b6-4c638cbaa05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:08.367098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44461d90-fdef-4b21-85b6-4c638cbaa05d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:08.377880 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1259/2554] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:02:08.382572 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c00e6-8474-4bf4-908f-0f0fb2b39030 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:08.387934 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:08.393363 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c00e6-8474-4bf4-908f-0f0fb2b39030 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:08.398802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85ecd0-19c1-461d-a4f7-9151780c007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:08.399768 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85ecd0-19c1-461d-a4f7-9151780c007d admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:08.400124 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85ecd0-19c1-461d-a4f7-9151780c007d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:08.400500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85ecd0-19c1-461d-a4f7-9151780c007d admin admin] PATH_INFO: `/v3/projects/7bc4be9ef41048ddacab92dee4623b4d/users/a63ee0269d6d43d4b649b0766a691da5/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:08.415976 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85ecd0-19c1-461d-a4f7-9151780c007d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bc4be9ef41048ddacab92dee4623b4d, user_id=a63ee0269d6d43d4b649b0766a691da5, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:08.418690 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85ecd0-19c1-461d-a4f7-9151780c007d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:08.538369 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1296/2555] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:02:08 2022] PUT /identity/v3/projects/7bc4be9ef41048ddacab92dee4623b4d/users/a63ee0269d6d43d4b649b0766a691da5/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:08.548604 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ace57-4a3c-4d5a-8c89-ec3984492943 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:08.549132 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ace57-4a3c-4d5a-8c89-ec3984492943 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:08.549240 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ace57-4a3c-4d5a-8c89-ec3984492943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:08.576907 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-cd4ace57-4a3c-4d5a-8c89-ec3984492943 None None] MFA Rules not processed for user `a63ee0269d6d43d4b649b0766a691da5`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:08.578243 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cd4ace57-4a3c-4d5a-8c89-ec3984492943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:08.625800 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:08.643928 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1260/2556] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:02:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:08.656078 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85ecd0-19c1-461d-a4f7-9151780c007d admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:08.657863 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-ae85ecd0-19c1-461d-a4f7-9151780c007d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:08.717019 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85ecd0-19c1-461d-a4f7-9151780c007d admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:08.720905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27359299-a356-4088-9856-b6116d7e8b53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:08.721555 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27359299-a356-4088-9856-b6116d7e8b53 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:08.721840 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27359299-a356-4088-9856-b6116d7e8b53 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:08.722117 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27359299-a356-4088-9856-b6116d7e8b53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:08.730556 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27359299-a356-4088-9856-b6116d7e8b53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:08.731992 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27359299-a356-4088-9856-b6116d7e8b53 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:08.741592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1297/2557] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:02:08.761456 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ace57-4a3c-4d5a-8c89-ec3984492943 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:08.823199 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ace57-4a3c-4d5a-8c89-ec3984492943 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:08.827728 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df58a0-285e-4cfd-ae8f-a87e781cfd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:08.828634 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df58a0-285e-4cfd-ae8f-a87e781cfd45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:08.828917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df58a0-285e-4cfd-ae8f-a87e781cfd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:08.829190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df58a0-285e-4cfd-ae8f-a87e781cfd45 admin admin] PATH_INFO: `/v3/users/a63ee0269d6d43d4b649b0766a691da5` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:08.830389 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df58a0-285e-4cfd-ae8f-a87e781cfd45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a63ee0269d6d43d4b649b0766a691da5)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:08.832367 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df58a0-285e-4cfd-ae8f-a87e781cfd45 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:09.007843 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-80df58a0-285e-4cfd-ae8f-a87e781cfd45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a63ee0269d6d43d4b649b0766a691da5'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:09.008540 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-80df58a0-285e-4cfd-ae8f-a87e781cfd45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a63ee0269d6d43d4b649b0766a691da5'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:09.056765 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-80df58a0-285e-4cfd-ae8f-a87e781cfd45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a63ee0269d6d43d4b649b0766a691da5'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:09.064613 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-80df58a0-285e-4cfd-ae8f-a87e781cfd45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a63ee0269d6d43d4b649b0766a691da5'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:09.077745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-80df58a0-285e-4cfd-ae8f-a87e781cfd45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a63ee0269d6d43d4b649b0766a691da5'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:09.084068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1261/2558] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:02:08 2022] DELETE /identity/v3/users/a63ee0269d6d43d4b649b0766a691da5 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:09.088668 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26332170-14de-487a-bebb-87b3a5f4aa89 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:09.089148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26332170-14de-487a-bebb-87b3a5f4aa89 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:09.089246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26332170-14de-487a-bebb-87b3a5f4aa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:09.107459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-26332170-14de-487a-bebb-87b3a5f4aa89 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:09.108660 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-26332170-14de-487a-bebb-87b3a5f4aa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:09.167714 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1298/2559] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:09.178932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df58a0-285e-4cfd-ae8f-a87e781cfd45 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:09.180698 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-80df58a0-285e-4cfd-ae8f-a87e781cfd45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:09.237038 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df58a0-285e-4cfd-ae8f-a87e781cfd45 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:09.241517 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab1e25-5d7c-40d5-83df-1edd3c7c5f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:09.242268 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab1e25-5d7c-40d5-83df-1edd3c7c5f36 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:09.242556 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab1e25-5d7c-40d5-83df-1edd3c7c5f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:09.242965 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab1e25-5d7c-40d5-83df-1edd3c7c5f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:09.252643 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab1e25-5d7c-40d5-83df-1edd3c7c5f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:09.254068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab1e25-5d7c-40d5-83df-1edd3c7c5f36 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:09.263502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1262/2560] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:02:09.778667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26332170-14de-487a-bebb-87b3a5f4aa89 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:09.780663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-26332170-14de-487a-bebb-87b3a5f4aa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:09.795573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26332170-14de-487a-bebb-87b3a5f4aa89 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:09.804107 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b75395-214a-4c9d-98be-7b6a7b9f54ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:09.806169 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b75395-214a-4c9d-98be-7b6a7b9f54ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:09.806478 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b75395-214a-4c9d-98be-7b6a7b9f54ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:09.806767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b75395-214a-4c9d-98be-7b6a7b9f54ab admin admin] PATH_INFO: `/v3/projects/7bc4be9ef41048ddacab92dee4623b4d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:09.809221 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b75395-214a-4c9d-98be-7b6a7b9f54ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bc4be9ef41048ddacab92dee4623b4d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:09.813667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b75395-214a-4c9d-98be-7b6a7b9f54ab admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:09.967058 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-44b75395-214a-4c9d-98be-7b6a7b9f54ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bc4be9ef41048ddacab92dee4623b4d', 'request_id': 'req-44b75395-214a-4c9d-98be-7b6a7b9f54ab'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:10.062749 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-44b75395-214a-4c9d-98be-7b6a7b9f54ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bc4be9ef41048ddacab92dee4623b4d', 'request_id': 'req-44b75395-214a-4c9d-98be-7b6a7b9f54ab'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:10.070450 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-44b75395-214a-4c9d-98be-7b6a7b9f54ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bc4be9ef41048ddacab92dee4623b4d', 'request_id': 'req-44b75395-214a-4c9d-98be-7b6a7b9f54ab'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:10.081303 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-44b75395-214a-4c9d-98be-7b6a7b9f54ab admin admin] The token cache is being invalidate because project 7bc4be9ef41048ddacab92dee4623b4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:02:10.081597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-44b75395-214a-4c9d-98be-7b6a7b9f54ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:10.082259 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-44b75395-214a-4c9d-98be-7b6a7b9f54ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:10.085189 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1299/2561] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:02:09 2022] DELETE /identity/v3/projects/7bc4be9ef41048ddacab92dee4623b4d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:10.090592 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621184a-4f9c-4809-86a9-0d82bf520883 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:10.091107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621184a-4f9c-4809-86a9-0d82bf520883 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:10.091206 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621184a-4f9c-4809-86a9-0d82bf520883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:10.109809 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6621184a-4f9c-4809-86a9-0d82bf520883 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:10.111011 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6621184a-4f9c-4809-86a9-0d82bf520883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:10.117709 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:10.185040 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1263/2562] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:10.194700 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8a622-b135-4374-af78-19bb2dcd1694 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:10.195245 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8a622-b135-4374-af78-19bb2dcd1694 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:10.195373 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8a622-b135-4374-af78-19bb2dcd1694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:10.203825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:10.216994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-4dd8a622-b135-4374-af78-19bb2dcd1694 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:10.218408 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-4dd8a622-b135-4374-af78-19bb2dcd1694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:10.232111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1300/2563] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:10.237918 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621184a-4f9c-4809-86a9-0d82bf520883 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:10.244738 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621184a-4f9c-4809-86a9-0d82bf520883 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:10.250324 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9be301-993a-4398-a247-28cf1b5730c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:10.251094 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9be301-993a-4398-a247-28cf1b5730c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:10.251450 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9be301-993a-4398-a247-28cf1b5730c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:10.252057 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9be301-993a-4398-a247-28cf1b5730c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:10.253047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9be301-993a-4398-a247-28cf1b5730c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:02:10.253432 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9be301-993a-4398-a247-28cf1b5730c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:10.255823 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9be301-993a-4398-a247-28cf1b5730c7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:10.271896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1264/2564] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 19:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 19:02:10.273292 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8a622-b135-4374-af78-19bb2dcd1694 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:10.296804 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8a622-b135-4374-af78-19bb2dcd1694 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:10.304516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca581421-5250-4fca-86a4-8f9a943c31f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:10.305214 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca581421-5250-4fca-86a4-8f9a943c31f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:10.305506 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca581421-5250-4fca-86a4-8f9a943c31f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:10.308911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca581421-5250-4fca-86a4-8f9a943c31f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:10.308911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca581421-5250-4fca-86a4-8f9a943c31f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:10.308911 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca581421-5250-4fca-86a4-8f9a943c31f1 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:10.390219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1301/2565] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:02:10 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:02:10.394381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9be301-993a-4398-a247-28cf1b5730c7 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:10.404757 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9be301-993a-4398-a247-28cf1b5730c7 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:10.464685 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf94758-cebf-41be-a98f-cbe1e223c4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:10.465821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf94758-cebf-41be-a98f-cbe1e223c4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:10.466233 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf94758-cebf-41be-a98f-cbe1e223c4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:10.466514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf94758-cebf-41be-a98f-cbe1e223c4c2 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:10.467217 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf94758-cebf-41be-a98f-cbe1e223c4c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:10.469241 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf94758-cebf-41be-a98f-cbe1e223c4c2 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:10.591384 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1265/2566] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:02:10 2022] POST /identity/v3/users => generated 285 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:02:10.592790 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca581421-5250-4fca-86a4-8f9a943c31f1 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:10.604253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca581421-5250-4fca-86a4-8f9a943c31f1 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:10.609474 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17840d7-72b7-49c5-a33d-d89b01540db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:10.610179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17840d7-72b7-49c5-a33d-d89b01540db4 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:10.610467 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17840d7-72b7-49c5-a33d-d89b01540db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:10.610746 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17840d7-72b7-49c5-a33d-d89b01540db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:10.611484 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17840d7-72b7-49c5-a33d-d89b01540db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:10.613131 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17840d7-72b7-49c5-a33d-d89b01540db4 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:10.624540 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1302/2567] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:02:10.631386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf94758-cebf-41be-a98f-cbe1e223c4c2 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:10.642070 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf94758-cebf-41be-a98f-cbe1e223c4c2 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:10.646930 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76016aeb-0b9b-40ff-841a-a7fa43a4a948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:10.647599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76016aeb-0b9b-40ff-841a-a7fa43a4a948 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:10.647894 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76016aeb-0b9b-40ff-841a-a7fa43a4a948 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:10.648176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76016aeb-0b9b-40ff-841a-a7fa43a4a948 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:10.648958 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76016aeb-0b9b-40ff-841a-a7fa43a4a948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:10.650562 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76016aeb-0b9b-40ff-841a-a7fa43a4a948 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:10.661689 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1266/2568] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:02:10.665810 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17840d7-72b7-49c5-a33d-d89b01540db4 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:10.676256 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17840d7-72b7-49c5-a33d-d89b01540db4 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:10.682049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088c7fd-bb7a-4d2f-8e73-ca02b82a259e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:10.683079 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088c7fd-bb7a-4d2f-8e73-ca02b82a259e admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:10.683371 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088c7fd-bb7a-4d2f-8e73-ca02b82a259e admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:10.683651 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088c7fd-bb7a-4d2f-8e73-ca02b82a259e admin admin] PATH_INFO: `/v3/projects/191c1693306f4c568f8c49dbe85a1c53/users/20025b47ef2444a89b3bdde17f35c8b3/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:10.699354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088c7fd-bb7a-4d2f-8e73-ca02b82a259e admin admin] RBAC: Authorizing `identity:create_grant(project_id=191c1693306f4c568f8c49dbe85a1c53, user_id=20025b47ef2444a89b3bdde17f35c8b3, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:10.702137 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088c7fd-bb7a-4d2f-8e73-ca02b82a259e admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:10.830707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1303/2569] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:02:10 2022] PUT /identity/v3/projects/191c1693306f4c568f8c49dbe85a1c53/users/20025b47ef2444a89b3bdde17f35c8b3/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:10.840686 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06800b-2cbc-4587-b28a-c4ce913b9fd1 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:10.840982 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06800b-2cbc-4587-b28a-c4ce913b9fd1 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:10.841258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06800b-2cbc-4587-b28a-c4ce913b9fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:10.883440 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-df06800b-2cbc-4587-b28a-c4ce913b9fd1 None None] MFA Rules not processed for user `20025b47ef2444a89b3bdde17f35c8b3`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:10.884911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-df06800b-2cbc-4587-b28a-c4ce913b9fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:10.959021 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1267/2570] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:02:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:10.970748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088c7fd-bb7a-4d2f-8e73-ca02b82a259e admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:10.972464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f088c7fd-bb7a-4d2f-8e73-ca02b82a259e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:11.052209 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088c7fd-bb7a-4d2f-8e73-ca02b82a259e admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:11.057684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1d4fe-9bcb-49c8-b831-e729aaa9aeab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00c13f10b14449cea284eb629a316d83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:11.058714 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1d4fe-9bcb-49c8-b831-e729aaa9aeab service glance] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:11.058714 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1d4fe-9bcb-49c8-b831-e729aaa9aeab service glance] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:11.059061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1d4fe-9bcb-49c8-b831-e729aaa9aeab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:11.083163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1d4fe-9bcb-49c8-b831-e729aaa9aeab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:11.085026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1d4fe-9bcb-49c8-b831-e729aaa9aeab service glance] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:11.095565 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1304/2571] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:02:12.587404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa36c0-ef6d-43a7-88d4-75ffc40abf22 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:12.587896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa36c0-ef6d-43a7-88d4-75ffc40abf22 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:12.588001 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa36c0-ef6d-43a7-88d4-75ffc40abf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:12.601014 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:12.608114 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f7aa36c0-ef6d-43a7-88d4-75ffc40abf22 None None] MFA Rules not processed for user `1eefe0d721484433b72afca03a2c1bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:12.609468 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f7aa36c0-ef6d-43a7-88d4-75ffc40abf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:12.666406 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1268/2572] 10.222.0.93 () {58 vars in 967 bytes} [Thu Jun 16 19:02:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:12.710451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1d4fe-9bcb-49c8-b831-e729aaa9aeab service glance] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:12.711864 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-34c1d4fe-9bcb-49c8-b831-e729aaa9aeab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:12.720516 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a057ced-2323-457d-906b-07facaaff33e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:12.720821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a057ced-2323-457d-906b-07facaaff33e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:12.721109 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a057ced-2323-457d-906b-07facaaff33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:12.740651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-8a057ced-2323-457d-906b-07facaaff33e None None] MFA Rules not processed for user `1eefe0d721484433b72afca03a2c1bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:12.741885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8a057ced-2323-457d-906b-07facaaff33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:12.749275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1269/2573] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Jun 16 19:02:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:02:12.768355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a057ced-2323-457d-906b-07facaaff33e None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:12.768355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8a057ced-2323-457d-906b-07facaaff33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:12.786469 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1d4fe-9bcb-49c8-b831-e729aaa9aeab service glance] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:12.791907 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96b7d4-bff3-4bf1-a570-54ac457e5954 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b45db002889846eda5b2a3e6917fcbe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:12.792757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96b7d4-bff3-4bf1-a570-54ac457e5954 service swift] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:12.792862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96b7d4-bff3-4bf1-a570-54ac457e5954 service swift] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:12.793139 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96b7d4-bff3-4bf1-a570-54ac457e5954 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:12.804193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96b7d4-bff3-4bf1-a570-54ac457e5954 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:12.806265 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96b7d4-bff3-4bf1-a570-54ac457e5954 service swift] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:12.815543 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1305/2574] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Jun 16 19:02:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 19:02:12.846601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a057ced-2323-457d-906b-07facaaff33e None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:12.856515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fc5ff-4c11-4aba-ba1a-fa7e6b844209 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b45db002889846eda5b2a3e6917fcbe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:12.857184 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fc5ff-4c11-4aba-ba1a-fa7e6b844209 service swift] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:12.857469 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fc5ff-4c11-4aba-ba1a-fa7e6b844209 service swift] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:12.857744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fc5ff-4c11-4aba-ba1a-fa7e6b844209 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:12.866697 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fc5ff-4c11-4aba-ba1a-fa7e6b844209 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:12.868370 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fc5ff-4c11-4aba-ba1a-fa7e6b844209 service swift] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:12.877707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1270/2575] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Jun 16 19:02:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 19:02:15.789158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96b7d4-bff3-4bf1-a570-54ac457e5954 service swift] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:15.797922 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-3a96b7d4-bff3-4bf1-a570-54ac457e5954 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:15.842161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:15.886602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96b7d4-bff3-4bf1-a570-54ac457e5954 service swift] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:15.892733 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73444657-19df-4c1e-a99e-66756af2e382 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:15.893434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73444657-19df-4c1e-a99e-66756af2e382 service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:15.893804 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73444657-19df-4c1e-a99e-66756af2e382 service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:15.894369 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73444657-19df-4c1e-a99e-66756af2e382 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:15.896594 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-73444657-19df-4c1e-a99e-66756af2e382 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:15.979118 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73444657-19df-4c1e-a99e-66756af2e382 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:15.981132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73444657-19df-4c1e-a99e-66756af2e382 service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:15.993824 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1306/2576] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:02:18.763806 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fc5ff-4c11-4aba-ba1a-fa7e6b844209 service swift] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:18.767250 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-de0fc5ff-4c11-4aba-ba1a-fa7e6b844209 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:18.891478 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fc5ff-4c11-4aba-ba1a-fa7e6b844209 service swift] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:18.895987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6820e99-204a-4bb7-ba01-a6f7bd4afe07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:18.897019 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6820e99-204a-4bb7-ba01-a6f7bd4afe07 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:18.897441 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6820e99-204a-4bb7-ba01-a6f7bd4afe07 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:18.898169 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6820e99-204a-4bb7-ba01-a6f7bd4afe07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:18.900210 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d6820e99-204a-4bb7-ba01-a6f7bd4afe07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:18.973645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:18.994954 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6820e99-204a-4bb7-ba01-a6f7bd4afe07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:18.996583 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6820e99-204a-4bb7-ba01-a6f7bd4afe07 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:19.025447 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1271/2577] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:02:26.216858 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=41 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:26.297146 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73444657-19df-4c1e-a99e-66756af2e382 service nova] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:26.298650 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-73444657-19df-4c1e-a99e-66756af2e382 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:26.313070 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73444657-19df-4c1e-a99e-66756af2e382 service nova] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:26.319570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60491f5-e23a-4a48-8759-56c4a352002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:26.320635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60491f5-e23a-4a48-8759-56c4a352002c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:26.324063 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60491f5-e23a-4a48-8759-56c4a352002c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:26.324063 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60491f5-e23a-4a48-8759-56c4a352002c admin admin] PATH_INFO: `/v3/users/2b29439f50a842da8d9a5ee9575a912d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:26.324063 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60491f5-e23a-4a48-8759-56c4a352002c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b29439f50a842da8d9a5ee9575a912d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:26.325070 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60491f5-e23a-4a48-8759-56c4a352002c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:26.469924 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b60491f5-e23a-4a48-8759-56c4a352002c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b29439f50a842da8d9a5ee9575a912d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:26.470981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b60491f5-e23a-4a48-8759-56c4a352002c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b29439f50a842da8d9a5ee9575a912d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:26.558723 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b60491f5-e23a-4a48-8759-56c4a352002c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b29439f50a842da8d9a5ee9575a912d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:26.566761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b60491f5-e23a-4a48-8759-56c4a352002c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b29439f50a842da8d9a5ee9575a912d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:26.567874 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-b60491f5-e23a-4a48-8759-56c4a352002c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b29439f50a842da8d9a5ee9575a912d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:26.589342 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1307/2578] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:02:26 2022] DELETE /identity/v3/users/2b29439f50a842da8d9a5ee9575a912d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:26.673457 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6820e99-204a-4bb7-ba01-a6f7bd4afe07 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:26.675163 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d6820e99-204a-4bb7-ba01-a6f7bd4afe07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:26.689038 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6820e99-204a-4bb7-ba01-a6f7bd4afe07 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:26.750905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a12a0-729f-4d54-9555-5064d44a2a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:26.752204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a12a0-729f-4d54-9555-5064d44a2a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:26.752516 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a12a0-729f-4d54-9555-5064d44a2a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:26.752801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a12a0-729f-4d54-9555-5064d44a2a2a admin admin] PATH_INFO: `/v3/users/8cd43532b520400e969b1929a6d0ed38` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:26.754032 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a12a0-729f-4d54-9555-5064d44a2a2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cd43532b520400e969b1929a6d0ed38)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:26.755965 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a12a0-729f-4d54-9555-5064d44a2a2a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:26.871701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60491f5-e23a-4a48-8759-56c4a352002c admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:26.873244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b60491f5-e23a-4a48-8759-56c4a352002c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:26.942414 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60491f5-e23a-4a48-8759-56c4a352002c admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:26.946643 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bc957-a3ca-4be3-bcc4-35fc5dcde9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:26.947422 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bc957-a3ca-4be3-bcc4-35fc5dcde9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:26.947637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bc957-a3ca-4be3-bcc4-35fc5dcde9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:26.947981 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bc957-a3ca-4be3-bcc4-35fc5dcde9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:26.950098 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-4e7bc957-a3ca-4be3-bcc4-35fc5dcde9b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:26.973497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7bc957-a3ca-4be3-bcc4-35fc5dcde9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:26.973497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7bc957-a3ca-4be3-bcc4-35fc5dcde9b4 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:26.975588 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1308/2579] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:02:26.976613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bc957-a3ca-4be3-bcc4-35fc5dcde9b4 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:26.978156 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-4e7bc957-a3ca-4be3-bcc4-35fc5dcde9b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:26.994746 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bc957-a3ca-4be3-bcc4-35fc5dcde9b4 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:26.999687 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a7715-8ff8-4798-a37d-cfdba6dc8674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:27.000692 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a7715-8ff8-4798-a37d-cfdba6dc8674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:27.000940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a7715-8ff8-4798-a37d-cfdba6dc8674 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:27.001521 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a7715-8ff8-4798-a37d-cfdba6dc8674 admin admin] PATH_INFO: `/v3/projects/d4ce09ed100f4358b3a030d7faf5179d` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:27.002626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a7715-8ff8-4798-a37d-cfdba6dc8674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ce09ed100f4358b3a030d7faf5179d)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:27.004788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a7715-8ff8-4798-a37d-cfdba6dc8674 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:27.009808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-694a12a0-729f-4d54-9555-5064d44a2a2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cd43532b520400e969b1929a6d0ed38'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:27.010577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-694a12a0-729f-4d54-9555-5064d44a2a2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cd43532b520400e969b1929a6d0ed38'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:27.090443 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-694a12a0-729f-4d54-9555-5064d44a2a2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cd43532b520400e969b1929a6d0ed38'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:27.100943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-694a12a0-729f-4d54-9555-5064d44a2a2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cd43532b520400e969b1929a6d0ed38'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:27.111075 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-330a7715-8ff8-4798-a37d-cfdba6dc8674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ce09ed100f4358b3a030d7faf5179d', 'request_id': 'req-330a7715-8ff8-4798-a37d-cfdba6dc8674'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:27.116303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-694a12a0-729f-4d54-9555-5064d44a2a2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cd43532b520400e969b1929a6d0ed38'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:27.123046 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1272/2580] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:02:26 2022] DELETE /identity/v3/users/8cd43532b520400e969b1929a6d0ed38 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:27.164732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-330a7715-8ff8-4798-a37d-cfdba6dc8674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ce09ed100f4358b3a030d7faf5179d', 'request_id': 'req-330a7715-8ff8-4798-a37d-cfdba6dc8674'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:27.171792 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-330a7715-8ff8-4798-a37d-cfdba6dc8674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ce09ed100f4358b3a030d7faf5179d', 'request_id': 'req-330a7715-8ff8-4798-a37d-cfdba6dc8674'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:27.178274 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:27.182842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-330a7715-8ff8-4798-a37d-cfdba6dc8674 admin admin] The token cache is being invalidate because project d4ce09ed100f4358b3a030d7faf5179d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:02:27.183128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-330a7715-8ff8-4798-a37d-cfdba6dc8674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:27.183814 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-330a7715-8ff8-4798-a37d-cfdba6dc8674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:27.185697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1309/2581] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:02:26 2022] DELETE /identity/v3/projects/d4ce09ed100f4358b3a030d7faf5179d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:27.190481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8b72c-5c6a-498e-9d7b-99a5644e3945 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:27.191295 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8b72c-5c6a-498e-9d7b-99a5644e3945 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:27.191853 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8b72c-5c6a-498e-9d7b-99a5644e3945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:27.211393 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-6de8b72c-5c6a-498e-9d7b-99a5644e3945 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:27.212656 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6de8b72c-5c6a-498e-9d7b-99a5644e3945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:27.279808 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1273/2582] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:27.287569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d9352-7f30-4c6d-9174-719ad0dc963b None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:27.288076 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d9352-7f30-4c6d-9174-719ad0dc963b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:27.288160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d9352-7f30-4c6d-9174-719ad0dc963b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:27.307199 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-f10d9352-7f30-4c6d-9174-719ad0dc963b None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:27.308934 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f10d9352-7f30-4c6d-9174-719ad0dc963b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:27.319040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1310/2583] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:27.323206 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8b72c-5c6a-498e-9d7b-99a5644e3945 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:27.331416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:27.336521 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8b72c-5c6a-498e-9d7b-99a5644e3945 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:27.344375 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f1210-907f-416c-ab0d-47f1a0b10199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:27.345083 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f1210-907f-416c-ab0d-47f1a0b10199 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:27.345366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f1210-907f-416c-ab0d-47f1a0b10199 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:27.345637 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f1210-907f-416c-ab0d-47f1a0b10199 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:27.346372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f1210-907f-416c-ab0d-47f1a0b10199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:02:27.346677 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f1210-907f-416c-ab0d-47f1a0b10199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:27.348360 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f1210-907f-416c-ab0d-47f1a0b10199 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:27.368689 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1274/2584] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 19:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 19:02:27.369397 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d9352-7f30-4c6d-9174-719ad0dc963b None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:27.379972 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d9352-7f30-4c6d-9174-719ad0dc963b None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:27.385517 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaced5-9e91-48f0-a2c4-758892bdb61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:27.387667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaced5-9e91-48f0-a2c4-758892bdb61b admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:27.387667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaced5-9e91-48f0-a2c4-758892bdb61b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:27.387667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaced5-9e91-48f0-a2c4-758892bdb61b admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:27.387667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaced5-9e91-48f0-a2c4-758892bdb61b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:27.389485 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaced5-9e91-48f0-a2c4-758892bdb61b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:27.480742 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1311/2585] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:02:27 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:02:27.485068 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f1210-907f-416c-ab0d-47f1a0b10199 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:27.498644 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f1210-907f-416c-ab0d-47f1a0b10199 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:27.559013 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4933a-1910-448f-a248-33f83dd41089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:27.559695 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4933a-1910-448f-a248-33f83dd41089 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:27.559981 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4933a-1910-448f-a248-33f83dd41089 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:27.560260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4933a-1910-448f-a248-33f83dd41089 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:27.560997 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4933a-1910-448f-a248-33f83dd41089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:27.563078 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4933a-1910-448f-a248-33f83dd41089 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:27.578014 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaced5-9e91-48f0-a2c4-758892bdb61b admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:27.579956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-dedaced5-9e91-48f0-a2c4-758892bdb61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:27.593623 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaced5-9e91-48f0-a2c4-758892bdb61b admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:27.598862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eab24c-ec44-46c5-8cf1-0ef70b4b073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:27.599740 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eab24c-ec44-46c5-8cf1-0ef70b4b073e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:27.600024 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eab24c-ec44-46c5-8cf1-0ef70b4b073e admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:27.601744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eab24c-ec44-46c5-8cf1-0ef70b4b073e admin admin] PATH_INFO: `/v3/projects/d70fdd7a643245659a616680072560f4` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:27.601744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eab24c-ec44-46c5-8cf1-0ef70b4b073e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70fdd7a643245659a616680072560f4)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:27.603502 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eab24c-ec44-46c5-8cf1-0ef70b4b073e admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:27.652771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1275/2586] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:02:27 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:02:27.656905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4933a-1910-448f-a248-33f83dd41089 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:27.667127 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4933a-1910-448f-a248-33f83dd41089 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:27.671854 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca4a3f-8793-4387-a8b4-ffec922c6ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:27.672565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca4a3f-8793-4387-a8b4-ffec922c6ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:27.672852 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca4a3f-8793-4387-a8b4-ffec922c6ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:27.673128 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca4a3f-8793-4387-a8b4-ffec922c6ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:27.673889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca4a3f-8793-4387-a8b4-ffec922c6ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:27.676022 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca4a3f-8793-4387-a8b4-ffec922c6ab5 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:27.686514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1276/2587] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 19:02:27.690357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca4a3f-8793-4387-a8b4-ffec922c6ab5 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:27.700258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca4a3f-8793-4387-a8b4-ffec922c6ab5 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:27.704840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b48d29-7ebe-48c3-bcc4-6d78fa1b83bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:27.705460 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b48d29-7ebe-48c3-bcc4-6d78fa1b83bf admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:27.709242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b48d29-7ebe-48c3-bcc4-6d78fa1b83bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:27.709242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b48d29-7ebe-48c3-bcc4-6d78fa1b83bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:27.709242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b48d29-7ebe-48c3-bcc4-6d78fa1b83bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:27.709242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b48d29-7ebe-48c3-bcc4-6d78fa1b83bf admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:27.719664 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1277/2588] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 19:02:27.723496 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b48d29-7ebe-48c3-bcc4-6d78fa1b83bf admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:27.738221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b48d29-7ebe-48c3-bcc4-6d78fa1b83bf admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:27.738221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45ee79-a469-4d4a-8220-6136bb9b195a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:27.738836 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45ee79-a469-4d4a-8220-6136bb9b195a admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:27.739123 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45ee79-a469-4d4a-8220-6136bb9b195a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:27.739413 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45ee79-a469-4d4a-8220-6136bb9b195a admin admin] PATH_INFO: `/v3/projects/e1d838ea03144ce78c1d3016b6386484/users/5a6dd8542964410a93e944ed1c0b3743/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:27.750818 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-96eab24c-ec44-46c5-8cf1-0ef70b4b073e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70fdd7a643245659a616680072560f4', 'request_id': 'req-96eab24c-ec44-46c5-8cf1-0ef70b4b073e'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:27.755930 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45ee79-a469-4d4a-8220-6136bb9b195a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1d838ea03144ce78c1d3016b6386484, user_id=5a6dd8542964410a93e944ed1c0b3743, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:27.758653 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45ee79-a469-4d4a-8220-6136bb9b195a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:27.849201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-96eab24c-ec44-46c5-8cf1-0ef70b4b073e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70fdd7a643245659a616680072560f4', 'request_id': 'req-96eab24c-ec44-46c5-8cf1-0ef70b4b073e'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:27.856703 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-96eab24c-ec44-46c5-8cf1-0ef70b4b073e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70fdd7a643245659a616680072560f4', 'request_id': 'req-96eab24c-ec44-46c5-8cf1-0ef70b4b073e'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:27.867758 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-96eab24c-ec44-46c5-8cf1-0ef70b4b073e admin admin] The token cache is being invalidate because project d70fdd7a643245659a616680072560f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:02:27.868046 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-96eab24c-ec44-46c5-8cf1-0ef70b4b073e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:27.868717 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-96eab24c-ec44-46c5-8cf1-0ef70b4b073e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:27.870359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1312/2589] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:02:27 2022] DELETE /identity/v3/projects/d70fdd7a643245659a616680072560f4 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:27.874198 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eab24c-ec44-46c5-8cf1-0ef70b4b073e admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:27.875754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-96eab24c-ec44-46c5-8cf1-0ef70b4b073e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:27.878450 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1278/2590] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:02:27 2022] PUT /identity/v3/projects/e1d838ea03144ce78c1d3016b6386484/users/5a6dd8542964410a93e944ed1c0b3743/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 19:02:27.890950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b00903-16b5-487e-92dc-03b2f6044f64 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:27.891249 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b00903-16b5-487e-92dc-03b2f6044f64 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:27.891533 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b00903-16b5-487e-92dc-03b2f6044f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:27.908416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-87b00903-16b5-487e-92dc-03b2f6044f64 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:27.910218 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-87b00903-16b5-487e-92dc-03b2f6044f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:27.940834 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eab24c-ec44-46c5-8cf1-0ef70b4b073e admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:27.972465 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1279/2591] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:27.982231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b00903-16b5-487e-92dc-03b2f6044f64 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:27.983654 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-87b00903-16b5-487e-92dc-03b2f6044f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:28.005069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521d7bf-b6b2-46ea-ab7e-dac75ead5ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:28.005960 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521d7bf-b6b2-46ea-ab7e-dac75ead5ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:28.006239 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521d7bf-b6b2-46ea-ab7e-dac75ead5ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:28.006682 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521d7bf-b6b2-46ea-ab7e-dac75ead5ab4 admin admin] PATH_INFO: `/v3/users/c6934275ec3448588ae7cf63ae3314d6` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:28.007955 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521d7bf-b6b2-46ea-ab7e-dac75ead5ab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6934275ec3448588ae7cf63ae3314d6)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:28.010538 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521d7bf-b6b2-46ea-ab7e-dac75ead5ab4 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:28.012397 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:28.029919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:28.049580 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b00903-16b5-487e-92dc-03b2f6044f64 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:28.053891 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ed6fa-e19b-4995-a7ac-dc17c53a76fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:28.054552 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ed6fa-e19b-4995-a7ac-dc17c53a76fa service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:28.054839 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ed6fa-e19b-4995-a7ac-dc17c53a76fa service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:28.055121 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ed6fa-e19b-4995-a7ac-dc17c53a76fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:28.064502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ed6fa-e19b-4995-a7ac-dc17c53a76fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:28.066101 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ed6fa-e19b-4995-a7ac-dc17c53a76fa service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:28.076008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1280/2592] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 19:02:28.223274 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-6521d7bf-b6b2-46ea-ab7e-dac75ead5ab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6934275ec3448588ae7cf63ae3314d6'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:28.223948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-6521d7bf-b6b2-46ea-ab7e-dac75ead5ab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6934275ec3448588ae7cf63ae3314d6'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:28.328919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-6521d7bf-b6b2-46ea-ab7e-dac75ead5ab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6934275ec3448588ae7cf63ae3314d6'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:28.337111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-6521d7bf-b6b2-46ea-ab7e-dac75ead5ab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6934275ec3448588ae7cf63ae3314d6'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:28.337773 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-6521d7bf-b6b2-46ea-ab7e-dac75ead5ab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6934275ec3448588ae7cf63ae3314d6'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:28.355274 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1313/2593] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:02:27 2022] DELETE /identity/v3/users/c6934275ec3448588ae7cf63ae3314d6 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:28.748290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ed6fa-e19b-4995-a7ac-dc17c53a76fa service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:28.758927 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ed6fa-e19b-4995-a7ac-dc17c53a76fa service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:28.821998 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47c22a-4d7d-4187-8292-1aee61aca685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:28.822964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47c22a-4d7d-4187-8292-1aee61aca685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:28.823327 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47c22a-4d7d-4187-8292-1aee61aca685 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:28.823744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47c22a-4d7d-4187-8292-1aee61aca685 admin admin] PATH_INFO: `/v3/projects/fe03db22944a474dabac8e2ac4ca8bde` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:28.825043 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47c22a-4d7d-4187-8292-1aee61aca685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe03db22944a474dabac8e2ac4ca8bde)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:28.826962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47c22a-4d7d-4187-8292-1aee61aca685 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:28.941782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ee47c22a-4d7d-4187-8292-1aee61aca685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe03db22944a474dabac8e2ac4ca8bde', 'request_id': 'req-ee47c22a-4d7d-4187-8292-1aee61aca685'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:28.947342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ee47c22a-4d7d-4187-8292-1aee61aca685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe03db22944a474dabac8e2ac4ca8bde', 'request_id': 'req-ee47c22a-4d7d-4187-8292-1aee61aca685'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:28.954104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ee47c22a-4d7d-4187-8292-1aee61aca685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe03db22944a474dabac8e2ac4ca8bde', 'request_id': 'req-ee47c22a-4d7d-4187-8292-1aee61aca685'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:29.020281 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ee47c22a-4d7d-4187-8292-1aee61aca685 admin admin] The token cache is being invalidate because project fe03db22944a474dabac8e2ac4ca8bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:02:29.020629 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ee47c22a-4d7d-4187-8292-1aee61aca685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:29.021272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-ee47c22a-4d7d-4187-8292-1aee61aca685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:29.022840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1281/2594] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:02:28 2022] DELETE /identity/v3/projects/fe03db22944a474dabac8e2ac4ca8bde => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:33.164919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521d7bf-b6b2-46ea-ab7e-dac75ead5ab4 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:33.166374 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6521d7bf-b6b2-46ea-ab7e-dac75ead5ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:33.240292 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521d7bf-b6b2-46ea-ab7e-dac75ead5ab4 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:33.295082 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d803c-8b6c-4895-b629-ec28ae2c63e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:33.306449 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d803c-8b6c-4895-b629-ec28ae2c63e4 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:33.306741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d803c-8b6c-4895-b629-ec28ae2c63e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:33.307019 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d803c-8b6c-4895-b629-ec28ae2c63e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:33.318897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-de6d803c-8b6c-4895-b629-ec28ae2c63e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:33.332557 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d803c-8b6c-4895-b629-ec28ae2c63e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:33.334384 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d803c-8b6c-4895-b629-ec28ae2c63e4 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:33.344052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1314/2595] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:02:34.016543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8e416-6506-4d8a-8f3e-b45d5e9bf632 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:34.017997 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8e416-6506-4d8a-8f3e-b45d5e9bf632 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:34.018557 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8e416-6506-4d8a-8f3e-b45d5e9bf632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:34.049399 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-e4e8e416-6506-4d8a-8f3e-b45d5e9bf632 None None] MFA Rules not processed for user `5a6dd8542964410a93e944ed1c0b3743`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:34.051386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e4e8e416-6506-4d8a-8f3e-b45d5e9bf632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:34.136523 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:34.144689 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1282/2596] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:02:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:34.156000 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d803c-8b6c-4895-b629-ec28ae2c63e4 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:34.157964 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-de6d803c-8b6c-4895-b629-ec28ae2c63e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:34.163102 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8e416-6506-4d8a-8f3e-b45d5e9bf632 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:34.163102 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e4e8e416-6506-4d8a-8f3e-b45d5e9bf632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:34.222300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:34.246305 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8e416-6506-4d8a-8f3e-b45d5e9bf632 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:34.251736 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e5cc3-c277-41dc-a257-511184661288 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3abe1d47a1164776bf3a82fe4b129d9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:34.252564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e5cc3-c277-41dc-a257-511184661288 service placement] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:34.252974 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e5cc3-c277-41dc-a257-511184661288 service placement] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:34.253749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e5cc3-c277-41dc-a257-511184661288 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:34.255540 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f19e5cc3-c277-41dc-a257-511184661288 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:34.271076 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d803c-8b6c-4895-b629-ec28ae2c63e4 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:34.271626 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e5cc3-c277-41dc-a257-511184661288 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:34.273307 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e5cc3-c277-41dc-a257-511184661288 service placement] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:34.276866 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec500221-9de2-4bee-923a-122557105968 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:34.277658 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec500221-9de2-4bee-923a-122557105968 service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:34.278025 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec500221-9de2-4bee-923a-122557105968 service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:34.278471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec500221-9de2-4bee-923a-122557105968 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:34.284872 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1283/2597] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:02:34.288815 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec500221-9de2-4bee-923a-122557105968 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:34.290836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec500221-9de2-4bee-923a-122557105968 service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:34.301931 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1315/2598] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:02:37.245788 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b7693-dcad-42db-8b35-b0b3fe744cdb None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:37.246681 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b7693-dcad-42db-8b35-b0b3fe744cdb None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:37.247343 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b7693-dcad-42db-8b35-b0b3fe744cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:37.267097 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d30b7693-dcad-42db-8b35-b0b3fe744cdb None None] MFA Rules not processed for user `1eefe0d721484433b72afca03a2c1bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:37.268951 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d30b7693-dcad-42db-8b35-b0b3fe744cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:37.360663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1284/2599] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Jun 16 19:02:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:37.375364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec500221-9de2-4bee-923a-122557105968 service nova] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:37.377246 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-ec500221-9de2-4bee-923a-122557105968 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:37.490838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec500221-9de2-4bee-923a-122557105968 service nova] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:37.497776 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d759d1-42dc-4f81-8097-b2230cb701e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b45db002889846eda5b2a3e6917fcbe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:37.498559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d759d1-42dc-4f81-8097-b2230cb701e9 service swift] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:37.499030 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d759d1-42dc-4f81-8097-b2230cb701e9 service swift] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:37.499386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d759d1-42dc-4f81-8097-b2230cb701e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:37.525295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d759d1-42dc-4f81-8097-b2230cb701e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:37.526979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d759d1-42dc-4f81-8097-b2230cb701e9 service swift] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:37.544122 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1316/2600] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Jun 16 19:02:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 19:02:37.799078 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dfcd2-99e5-4c9a-949c-5dc7df4a3319 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:37.799437 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dfcd2-99e5-4c9a-949c-5dc7df4a3319 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:37.799737 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dfcd2-99e5-4c9a-949c-5dc7df4a3319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:37.833578 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f37dfcd2-99e5-4c9a-949c-5dc7df4a3319 None None] MFA Rules not processed for user `5a6dd8542964410a93e944ed1c0b3743`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:37.834807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f37dfcd2-99e5-4c9a-949c-5dc7df4a3319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:37.857612 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1285/2601] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:02:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:38.347613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d759d1-42dc-4f81-8097-b2230cb701e9 service swift] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:38.350537 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-27d759d1-42dc-4f81-8097-b2230cb701e9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:38.488716 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d759d1-42dc-4f81-8097-b2230cb701e9 service swift] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:38.495002 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77fd37-45fd-4de6-8257-4d53c04582dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:38.496273 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77fd37-45fd-4de6-8257-4d53c04582dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:38.504282 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77fd37-45fd-4de6-8257-4d53c04582dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:38.504607 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77fd37-45fd-4de6-8257-4d53c04582dd admin admin] PATH_INFO: `/v3/users/20025b47ef2444a89b3bdde17f35c8b3` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:38.506023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77fd37-45fd-4de6-8257-4d53c04582dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=20025b47ef2444a89b3bdde17f35c8b3)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:38.508006 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77fd37-45fd-4de6-8257-4d53c04582dd admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:38.763213 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7e77fd37-45fd-4de6-8257-4d53c04582dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20025b47ef2444a89b3bdde17f35c8b3'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:38.764509 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7e77fd37-45fd-4de6-8257-4d53c04582dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20025b47ef2444a89b3bdde17f35c8b3'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:38.843734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7e77fd37-45fd-4de6-8257-4d53c04582dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20025b47ef2444a89b3bdde17f35c8b3'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:38.845511 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:38.853090 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7e77fd37-45fd-4de6-8257-4d53c04582dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20025b47ef2444a89b3bdde17f35c8b3'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:38.854152 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7e77fd37-45fd-4de6-8257-4d53c04582dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20025b47ef2444a89b3bdde17f35c8b3'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:38.874469 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1317/2602] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:02:38 2022] DELETE /identity/v3/users/20025b47ef2444a89b3bdde17f35c8b3 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:38.879928 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3a047-3dfd-4cbd-a070-16f9eabd95d7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:38.880769 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3a047-3dfd-4cbd-a070-16f9eabd95d7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:38.881206 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3a047-3dfd-4cbd-a070-16f9eabd95d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:38.905945 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c3b3a047-3dfd-4cbd-a070-16f9eabd95d7 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:38.907693 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c3b3a047-3dfd-4cbd-a070-16f9eabd95d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:39.030373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1286/2603] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:39.041778 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77fd37-45fd-4de6-8257-4d53c04582dd admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:39.043259 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-7e77fd37-45fd-4de6-8257-4d53c04582dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:39.136209 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77fd37-45fd-4de6-8257-4d53c04582dd admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:39.140145 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2ad20-d3ee-432c-9c4e-fcb18f3509e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:39.142349 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2ad20-d3ee-432c-9c4e-fcb18f3509e5 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:39.142349 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2ad20-d3ee-432c-9c4e-fcb18f3509e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:39.142349 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2ad20-d3ee-432c-9c4e-fcb18f3509e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:39.157351 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2ad20-d3ee-432c-9c4e-fcb18f3509e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:39.161951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2ad20-d3ee-432c-9c4e-fcb18f3509e5 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:39.181845 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1318/2604] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 19:02:39.679259 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3a047-3dfd-4cbd-a070-16f9eabd95d7 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:39.680762 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c3b3a047-3dfd-4cbd-a070-16f9eabd95d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:39.705290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3a047-3dfd-4cbd-a070-16f9eabd95d7 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:39.711519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374cd87-9e68-4535-a4d8-569583034f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:39.712458 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374cd87-9e68-4535-a4d8-569583034f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:39.712788 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374cd87-9e68-4535-a4d8-569583034f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:39.713245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374cd87-9e68-4535-a4d8-569583034f46 admin admin] PATH_INFO: `/v3/projects/191c1693306f4c568f8c49dbe85a1c53` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:39.715059 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374cd87-9e68-4535-a4d8-569583034f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=191c1693306f4c568f8c49dbe85a1c53)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:39.719885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374cd87-9e68-4535-a4d8-569583034f46 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:39.751614 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:39.920633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5374cd87-9e68-4535-a4d8-569583034f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '191c1693306f4c568f8c49dbe85a1c53', 'request_id': 'req-5374cd87-9e68-4535-a4d8-569583034f46'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:39.926975 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5374cd87-9e68-4535-a4d8-569583034f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '191c1693306f4c568f8c49dbe85a1c53', 'request_id': 'req-5374cd87-9e68-4535-a4d8-569583034f46'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:39.933520 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5374cd87-9e68-4535-a4d8-569583034f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '191c1693306f4c568f8c49dbe85a1c53', 'request_id': 'req-5374cd87-9e68-4535-a4d8-569583034f46'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:40.043902 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5374cd87-9e68-4535-a4d8-569583034f46 admin admin] The token cache is being invalidate because project 191c1693306f4c568f8c49dbe85a1c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:02:40.044196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5374cd87-9e68-4535-a4d8-569583034f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:40.045229 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-5374cd87-9e68-4535-a4d8-569583034f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:40.048958 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1287/2605] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:02:39 2022] DELETE /identity/v3/projects/191c1693306f4c568f8c49dbe85a1c53 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:40.053819 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df17eb2-567a-4c44-9b27-d7b96073475c None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:40.054326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df17eb2-567a-4c44-9b27-d7b96073475c None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:40.054422 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df17eb2-567a-4c44-9b27-d7b96073475c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:40.075658 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-3df17eb2-567a-4c44-9b27-d7b96073475c None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:40.080703 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-3df17eb2-567a-4c44-9b27-d7b96073475c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:40.172294 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1319/2606] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:40.173128 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8599c8-ddda-452f-af1f-f27aeae77a8e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:40.173515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8599c8-ddda-452f-af1f-f27aeae77a8e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:40.173868 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8599c8-ddda-452f-af1f-f27aeae77a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:40.201006 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-1a8599c8-ddda-452f-af1f-f27aeae77a8e None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:40.207124 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1a8599c8-ddda-452f-af1f-f27aeae77a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:40.213588 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1288/2607] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:40.218301 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df17eb2-567a-4c44-9b27-d7b96073475c None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:40.229857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df17eb2-567a-4c44-9b27-d7b96073475c None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:40.236317 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d019d3-c261-4a47-9151-63e0cc7d1139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:40.237919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d019d3-c261-4a47-9151-63e0cc7d1139 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:40.238448 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d019d3-c261-4a47-9151-63e0cc7d1139 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:40.238884 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d019d3-c261-4a47-9151-63e0cc7d1139 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:40.240129 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d019d3-c261-4a47-9151-63e0cc7d1139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:02:40.240749 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d019d3-c261-4a47-9151-63e0cc7d1139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:40.242846 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d019d3-c261-4a47-9151-63e0cc7d1139 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:40.279827 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1320/2608] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 19:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 19:02:40.283699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8599c8-ddda-452f-af1f-f27aeae77a8e None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:40.299223 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8599c8-ddda-452f-af1f-f27aeae77a8e None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:40.304726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c5fae-bf48-427f-a27c-16c13d270e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:40.305527 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c5fae-bf48-427f-a27c-16c13d270e06 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:40.305818 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c5fae-bf48-427f-a27c-16c13d270e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:40.306156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c5fae-bf48-427f-a27c-16c13d270e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:40.306884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c5fae-bf48-427f-a27c-16c13d270e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:40.309058 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c5fae-bf48-427f-a27c-16c13d270e06 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:40.415321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1289/2609] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:02:40 2022] POST /identity/v3/projects => generated 363 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:02:40.416758 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d019d3-c261-4a47-9151-63e0cc7d1139 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:40.427719 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d019d3-c261-4a47-9151-63e0cc7d1139 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:40.496898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbf3c5-99f4-4766-8243-8c9a142e3088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:40.497837 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbf3c5-99f4-4766-8243-8c9a142e3088 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:40.498289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbf3c5-99f4-4766-8243-8c9a142e3088 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:40.499830 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbf3c5-99f4-4766-8243-8c9a142e3088 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:40.501116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbf3c5-99f4-4766-8243-8c9a142e3088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:40.503259 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbf3c5-99f4-4766-8243-8c9a142e3088 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:40.512197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:40.609784 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1321/2610] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:02:40 2022] POST /identity/v3/users => generated 282 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:02:40.614023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c5fae-bf48-427f-a27c-16c13d270e06 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:40.625257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c5fae-bf48-427f-a27c-16c13d270e06 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:40.631456 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9b4ef-4bbb-4313-b0b8-5abceeaa2d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:40.632136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9b4ef-4bbb-4313-b0b8-5abceeaa2d27 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:40.632419 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9b4ef-4bbb-4313-b0b8-5abceeaa2d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:40.632779 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9b4ef-4bbb-4313-b0b8-5abceeaa2d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:40.633526 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9b4ef-4bbb-4313-b0b8-5abceeaa2d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:40.635216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9b4ef-4bbb-4313-b0b8-5abceeaa2d27 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:40.646918 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1290/2611] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:02:40.651161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbf3c5-99f4-4766-8243-8c9a142e3088 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:40.663028 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbf3c5-99f4-4766-8243-8c9a142e3088 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:40.667941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5cbe2-1820-46c6-b2e2-880dfee6e304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:40.668667 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5cbe2-1820-46c6-b2e2-880dfee6e304 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:40.668951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5cbe2-1820-46c6-b2e2-880dfee6e304 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:40.673806 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5cbe2-1820-46c6-b2e2-880dfee6e304 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:40.673806 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5cbe2-1820-46c6-b2e2-880dfee6e304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:40.673806 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5cbe2-1820-46c6-b2e2-880dfee6e304 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:40.682268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1322/2612] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:02:40.686942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9b4ef-4bbb-4313-b0b8-5abceeaa2d27 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:40.698090 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9b4ef-4bbb-4313-b0b8-5abceeaa2d27 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:40.702884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50449e-e1c8-4422-90fa-c4a8339de941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:40.703783 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50449e-e1c8-4422-90fa-c4a8339de941 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:40.704066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50449e-e1c8-4422-90fa-c4a8339de941 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:40.704345 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50449e-e1c8-4422-90fa-c4a8339de941 admin admin] PATH_INFO: `/v3/projects/9ad92e34dc2140d6831eb7597f7c9bab/users/9dd695f6b72b4758960ce5d8e83cdee5/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:40.723826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50449e-e1c8-4422-90fa-c4a8339de941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad92e34dc2140d6831eb7597f7c9bab, user_id=9dd695f6b72b4758960ce5d8e83cdee5, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:40.727016 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50449e-e1c8-4422-90fa-c4a8339de941 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:40.855556 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1291/2613] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:02:40 2022] PUT /identity/v3/projects/9ad92e34dc2140d6831eb7597f7c9bab/users/9dd695f6b72b4758960ce5d8e83cdee5/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:40.869451 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f8caf-1069-4a74-a878-eb0ded70e7ae None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:40.870012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f8caf-1069-4a74-a878-eb0ded70e7ae None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:40.870968 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f8caf-1069-4a74-a878-eb0ded70e7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:40.905681 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-f97f8caf-1069-4a74-a878-eb0ded70e7ae None None] MFA Rules not processed for user `9dd695f6b72b4758960ce5d8e83cdee5`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:40.910179 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f97f8caf-1069-4a74-a878-eb0ded70e7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:40.985470 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1323/2614] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:02:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:40.997513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50449e-e1c8-4422-90fa-c4a8339de941 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:41.008812 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5a50449e-e1c8-4422-90fa-c4a8339de941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:41.086642 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50449e-e1c8-4422-90fa-c4a8339de941 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:41.090887 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f32096-10ec-4196-8d78-554c3fea6e88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:41.091730 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f32096-10ec-4196-8d78-554c3fea6e88 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:41.092027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f32096-10ec-4196-8d78-554c3fea6e88 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:41.092356 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f32096-10ec-4196-8d78-554c3fea6e88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:41.107968 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f32096-10ec-4196-8d78-554c3fea6e88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:41.109585 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f32096-10ec-4196-8d78-554c3fea6e88 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:41.122247 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1292/2615] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:40 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:02:49.763754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f8caf-1069-4a74-a878-eb0ded70e7ae None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:49.765959 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f97f8caf-1069-4a74-a878-eb0ded70e7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:49.848708 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f8caf-1069-4a74-a878-eb0ded70e7ae None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:49.855090 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2106e-4324-4e5e-9f24-4105dd8e1bf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:49.855587 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2106e-4324-4e5e-9f24-4105dd8e1bf6 service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:49.855925 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2106e-4324-4e5e-9f24-4105dd8e1bf6 service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:49.856205 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2106e-4324-4e5e-9f24-4105dd8e1bf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:49.858147 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2ec2106e-4324-4e5e-9f24-4105dd8e1bf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:49.872490 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2106e-4324-4e5e-9f24-4105dd8e1bf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:49.874495 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2106e-4324-4e5e-9f24-4105dd8e1bf6 service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:49.887275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f32096-10ec-4196-8d78-554c3fea6e88 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:49.892117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-70f32096-10ec-4196-8d78-554c3fea6e88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:49.892367 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1324/2616] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:02:49.924067 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f32096-10ec-4196-8d78-554c3fea6e88 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:49.941744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a52c2f-4fbf-40f2-8f3e-7eb8bf20e58a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:49.944362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a52c2f-4fbf-40f2-8f3e-7eb8bf20e58a service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:49.944686 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a52c2f-4fbf-40f2-8f3e-7eb8bf20e58a service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:49.947767 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a52c2f-4fbf-40f2-8f3e-7eb8bf20e58a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:49.949872 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a4a52c2f-4fbf-40f2-8f3e-7eb8bf20e58a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:49.965300 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a52c2f-4fbf-40f2-8f3e-7eb8bf20e58a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:49.967368 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a52c2f-4fbf-40f2-8f3e-7eb8bf20e58a service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:49.984889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1293/2617] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 19:02:51.519348 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e485c-7058-4359-af1d-ae9eec2bdc1a None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:51.519834 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e485c-7058-4359-af1d-ae9eec2bdc1a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:51.520013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e485c-7058-4359-af1d-ae9eec2bdc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:51.538158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-af9e485c-7058-4359-af1d-ae9eec2bdc1a None None] MFA Rules not processed for user `1eefe0d721484433b72afca03a2c1bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:51.539300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-af9e485c-7058-4359-af1d-ae9eec2bdc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:51.588780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:51.596721 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1325/2618] 10.222.0.93 () {58 vars in 967 bytes} [Thu Jun 16 19:02:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:51.609286 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a52c2f-4fbf-40f2-8f3e-7eb8bf20e58a service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:51.610752 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a4a52c2f-4fbf-40f2-8f3e-7eb8bf20e58a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:51.652640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:51.682642 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a52c2f-4fbf-40f2-8f3e-7eb8bf20e58a service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:51.687800 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5297a-81f2-4eb4-a3ac-e08362371e6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b45db002889846eda5b2a3e6917fcbe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:51.691990 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5297a-81f2-4eb4-a3ac-e08362371e6e service swift] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:51.691990 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5297a-81f2-4eb4-a3ac-e08362371e6e service swift] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:51.691990 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5297a-81f2-4eb4-a3ac-e08362371e6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:51.697751 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5297a-81f2-4eb4-a3ac-e08362371e6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:51.699323 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5297a-81f2-4eb4-a3ac-e08362371e6e service swift] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:51.708249 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1294/2619] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Jun 16 19:02:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 19:02:59.876601 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e485c-7058-4359-af1d-ae9eec2bdc1a None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:59.889657 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e485c-7058-4359-af1d-ae9eec2bdc1a None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:59.895739 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411fd74-173f-4a10-9509-8edd2e74088a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:59.897560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411fd74-173f-4a10-9509-8edd2e74088a service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:59.897560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411fd74-173f-4a10-9509-8edd2e74088a service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:59.897560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411fd74-173f-4a10-9509-8edd2e74088a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:59.898851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-7411fd74-173f-4a10-9509-8edd2e74088a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:59.912584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411fd74-173f-4a10-9509-8edd2e74088a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:59.914208 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411fd74-173f-4a10-9509-8edd2e74088a service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:59.925985 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1326/2620] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:03:02.190608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=16 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:09.920901 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=6 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:18.376427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5297a-81f2-4eb4-a3ac-e08362371e6e service swift] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:18.444978 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5297a-81f2-4eb4-a3ac-e08362371e6e service swift] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:18.449710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f05584-d75f-40e7-882f-696d1594c2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:18.450617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f05584-d75f-40e7-882f-696d1594c2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:18.450907 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f05584-d75f-40e7-882f-696d1594c2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:18.451188 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f05584-d75f-40e7-882f-696d1594c2f7 admin admin] PATH_INFO: `/v3/users/9dd695f6b72b4758960ce5d8e83cdee5` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:18.452389 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f05584-d75f-40e7-882f-696d1594c2f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd695f6b72b4758960ce5d8e83cdee5)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:18.454360 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f05584-d75f-40e7-882f-696d1594c2f7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:18.826679 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-60f05584-d75f-40e7-882f-696d1594c2f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd695f6b72b4758960ce5d8e83cdee5'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:18.831046 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-60f05584-d75f-40e7-882f-696d1594c2f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd695f6b72b4758960ce5d8e83cdee5'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:18.892699 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-60f05584-d75f-40e7-882f-696d1594c2f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd695f6b72b4758960ce5d8e83cdee5'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:18.900059 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-60f05584-d75f-40e7-882f-696d1594c2f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd695f6b72b4758960ce5d8e83cdee5'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:18.912533 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-60f05584-d75f-40e7-882f-696d1594c2f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd695f6b72b4758960ce5d8e83cdee5'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:18.918711 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1295/2621] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:03:18 2022] DELETE /identity/v3/users/9dd695f6b72b4758960ce5d8e83cdee5 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:18.923201 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a0804-a8c2-4c3d-91c6-63474f05bca8 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:18.923726 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a0804-a8c2-4c3d-91c6-63474f05bca8 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:18.923830 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a0804-a8c2-4c3d-91c6-63474f05bca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:18.942411 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-a26a0804-a8c2-4c3d-91c6-63474f05bca8 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:18.946070 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-a26a0804-a8c2-4c3d-91c6-63474f05bca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:19.003936 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1327/2622] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:19.013543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f05584-d75f-40e7-882f-696d1594c2f7 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:19.014928 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-60f05584-d75f-40e7-882f-696d1594c2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:19.071202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f05584-d75f-40e7-882f-696d1594c2f7 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:19.074635 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cffd7f-1a5a-4008-b7d9-5a155c1af8bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:19.075273 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cffd7f-1a5a-4008-b7d9-5a155c1af8bb service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:19.075556 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cffd7f-1a5a-4008-b7d9-5a155c1af8bb service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:19.075831 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cffd7f-1a5a-4008-b7d9-5a155c1af8bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:19.085482 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cffd7f-1a5a-4008-b7d9-5a155c1af8bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:19.086862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cffd7f-1a5a-4008-b7d9-5a155c1af8bb service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:19.096386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1296/2623] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:03:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:03:19.562952 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a0804-a8c2-4c3d-91c6-63474f05bca8 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:19.564465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-a26a0804-a8c2-4c3d-91c6-63474f05bca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:19.577768 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a0804-a8c2-4c3d-91c6-63474f05bca8 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:19.582309 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1d84c-1788-49ce-8787-7baab0bfc4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:19.583213 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1d84c-1788-49ce-8787-7baab0bfc4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:19.584080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1d84c-1788-49ce-8787-7baab0bfc4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:19.584362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1d84c-1788-49ce-8787-7baab0bfc4cb admin admin] PATH_INFO: `/v3/projects/9ad92e34dc2140d6831eb7597f7c9bab` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:19.585633 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1d84c-1788-49ce-8787-7baab0bfc4cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad92e34dc2140d6831eb7597f7c9bab)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:19.587785 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1d84c-1788-49ce-8787-7baab0bfc4cb admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:19.722050 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-baf1d84c-1788-49ce-8787-7baab0bfc4cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad92e34dc2140d6831eb7597f7c9bab', 'request_id': 'req-baf1d84c-1788-49ce-8787-7baab0bfc4cb'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:19.827932 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-baf1d84c-1788-49ce-8787-7baab0bfc4cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad92e34dc2140d6831eb7597f7c9bab', 'request_id': 'req-baf1d84c-1788-49ce-8787-7baab0bfc4cb'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:19.835323 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-baf1d84c-1788-49ce-8787-7baab0bfc4cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad92e34dc2140d6831eb7597f7c9bab', 'request_id': 'req-baf1d84c-1788-49ce-8787-7baab0bfc4cb'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:19.845886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-baf1d84c-1788-49ce-8787-7baab0bfc4cb admin admin] The token cache is being invalidate because project 9ad92e34dc2140d6831eb7597f7c9bab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:03:19.846117 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-baf1d84c-1788-49ce-8787-7baab0bfc4cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:19.846756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-baf1d84c-1788-49ce-8787-7baab0bfc4cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:19.848383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1328/2624] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:03:19 2022] DELETE /identity/v3/projects/9ad92e34dc2140d6831eb7597f7c9bab => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:19.853396 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1d67c-077b-4d44-ac3f-0d5208a22243 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:19.853918 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1d67c-077b-4d44-ac3f-0d5208a22243 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:19.854028 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1d67c-077b-4d44-ac3f-0d5208a22243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:19.871814 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-55d1d67c-077b-4d44-ac3f-0d5208a22243 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:19.873033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-55d1d67c-077b-4d44-ac3f-0d5208a22243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:19.890260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:19.932142 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1297/2625] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:19.940407 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a0948-d3ce-4751-af2a-c22245880463 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:19.940945 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a0948-d3ce-4751-af2a-c22245880463 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:19.941065 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a0948-d3ce-4751-af2a-c22245880463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:19.959968 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-2c2a0948-d3ce-4751-af2a-c22245880463 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:19.963670 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2c2a0948-d3ce-4751-af2a-c22245880463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:19.969465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1329/2626] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:19.973617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1d67c-077b-4d44-ac3f-0d5208a22243 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:19.983395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1d67c-077b-4d44-ac3f-0d5208a22243 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:19.988816 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db832d21-b3a1-43e7-9778-a2153d2622f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:19.989534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db832d21-b3a1-43e7-9778-a2153d2622f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:19.989807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db832d21-b3a1-43e7-9778-a2153d2622f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:19.990089 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db832d21-b3a1-43e7-9778-a2153d2622f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:19.991335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db832d21-b3a1-43e7-9778-a2153d2622f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:03:19.991648 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db832d21-b3a1-43e7-9778-a2153d2622f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:19.993296 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db832d21-b3a1-43e7-9778-a2153d2622f0 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:20.005303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1298/2627] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 19:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 19:03:20.010094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a0948-d3ce-4751-af2a-c22245880463 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:20.019519 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a0948-d3ce-4751-af2a-c22245880463 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:20.024298 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22b520-26bd-405f-8561-e6a9f5c10147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:20.024986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22b520-26bd-405f-8561-e6a9f5c10147 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:20.025274 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22b520-26bd-405f-8561-e6a9f5c10147 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:20.025551 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22b520-26bd-405f-8561-e6a9f5c10147 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:20.026244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22b520-26bd-405f-8561-e6a9f5c10147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:20.028212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22b520-26bd-405f-8561-e6a9f5c10147 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:20.145751 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1330/2628] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:03:20 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:03:20.149805 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db832d21-b3a1-43e7-9778-a2153d2622f0 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:20.159815 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db832d21-b3a1-43e7-9778-a2153d2622f0 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:20.216758 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b045-66d4-460f-a604-32fd4875d1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:20.217421 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b045-66d4-460f-a604-32fd4875d1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:20.217704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b045-66d4-460f-a604-32fd4875d1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:20.217985 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b045-66d4-460f-a604-32fd4875d1c3 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:20.218721 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3b045-66d4-460f-a604-32fd4875d1c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:20.220728 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3b045-66d4-460f-a604-32fd4875d1c3 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:20.321873 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1299/2629] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:03:20 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:03:20.326094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22b520-26bd-405f-8561-e6a9f5c10147 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:20.336590 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22b520-26bd-405f-8561-e6a9f5c10147 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:20.341454 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f6621-d866-4428-9d97-2c42bb4f9073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:20.342110 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f6621-d866-4428-9d97-2c42bb4f9073 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:20.342393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f6621-d866-4428-9d97-2c42bb4f9073 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:20.342699 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f6621-d866-4428-9d97-2c42bb4f9073 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:20.343455 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f6621-d866-4428-9d97-2c42bb4f9073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:20.345101 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f6621-d866-4428-9d97-2c42bb4f9073 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:20.356697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1331/2630] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 19:03:20.360381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b045-66d4-460f-a604-32fd4875d1c3 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:20.370890 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b045-66d4-460f-a604-32fd4875d1c3 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:20.375841 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a2e1a-5313-4cb1-8452-7d7468537a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:20.376534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a2e1a-5313-4cb1-8452-7d7468537a8e admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:20.376816 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a2e1a-5313-4cb1-8452-7d7468537a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:20.377094 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a2e1a-5313-4cb1-8452-7d7468537a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:20.377820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a2e1a-5313-4cb1-8452-7d7468537a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:20.379406 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a2e1a-5313-4cb1-8452-7d7468537a8e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:20.389566 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1300/2631] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:03:20.393482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f6621-d866-4428-9d97-2c42bb4f9073 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:20.403317 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f6621-d866-4428-9d97-2c42bb4f9073 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:20.407817 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45789daf-36e8-471b-b1e9-cfd33398c8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:20.408723 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45789daf-36e8-471b-b1e9-cfd33398c8bd admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:20.409010 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45789daf-36e8-471b-b1e9-cfd33398c8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:20.409291 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45789daf-36e8-471b-b1e9-cfd33398c8bd admin admin] PATH_INFO: `/v3/projects/f0eb05ed20c948fbad5e916d6549b01a/users/6f8cb1b5da4a4ab0a6bf46475bf32d66/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:20.424158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45789daf-36e8-471b-b1e9-cfd33398c8bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0eb05ed20c948fbad5e916d6549b01a, user_id=6f8cb1b5da4a4ab0a6bf46475bf32d66, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:20.426823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45789daf-36e8-471b-b1e9-cfd33398c8bd admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:20.504510 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1332/2632] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:03:20 2022] PUT /identity/v3/projects/f0eb05ed20c948fbad5e916d6549b01a/users/6f8cb1b5da4a4ab0a6bf46475bf32d66/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:20.515577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a2e92-3718-43fe-9465-bee97369c7ce None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:20.515870 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a2e92-3718-43fe-9465-bee97369c7ce None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:20.516153 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a2e92-3718-43fe-9465-bee97369c7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:20.542781 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-a85a2e92-3718-43fe-9465-bee97369c7ce None None] MFA Rules not processed for user `6f8cb1b5da4a4ab0a6bf46475bf32d66`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:20.543969 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a85a2e92-3718-43fe-9465-bee97369c7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:20.607455 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1301/2633] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:20.619041 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45789daf-36e8-471b-b1e9-cfd33398c8bd admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:20.620970 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-45789daf-36e8-471b-b1e9-cfd33398c8bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:20.634633 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:20.680082 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45789daf-36e8-471b-b1e9-cfd33398c8bd admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:20.683619 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2ab05-50c8-4937-81f1-3f72c82a0f01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:20.684265 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2ab05-50c8-4937-81f1-3f72c82a0f01 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:20.684578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2ab05-50c8-4937-81f1-3f72c82a0f01 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:20.684856 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2ab05-50c8-4937-81f1-3f72c82a0f01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:20.692940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2ab05-50c8-4937-81f1-3f72c82a0f01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:20.694436 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2ab05-50c8-4937-81f1-3f72c82a0f01 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:20.703261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1333/2634] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:03:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:03:22.484073 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352ca8c-95ab-4cd4-9d3f-e58c7d0cf5b0 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:22.484608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352ca8c-95ab-4cd4-9d3f-e58c7d0cf5b0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:22.484716 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352ca8c-95ab-4cd4-9d3f-e58c7d0cf5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:22.502326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-0352ca8c-95ab-4cd4-9d3f-e58c7d0cf5b0 None None] MFA Rules not processed for user `6f8cb1b5da4a4ab0a6bf46475bf32d66`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:22.503531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0352ca8c-95ab-4cd4-9d3f-e58c7d0cf5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:22.511040 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1302/2635] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:30.699661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=21 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:32.496692 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:36.624783 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2ab05-50c8-4937-81f1-3f72c82a0f01 service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:36.626191 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-e9c2ab05-50c8-4937-81f1-3f72c82a0f01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:36.691987 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2ab05-50c8-4937-81f1-3f72c82a0f01 service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:36.696183 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a93c78-dbb2-4138-afec-beb79c2030d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:36.696901 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a93c78-dbb2-4138-afec-beb79c2030d6 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:36.697192 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a93c78-dbb2-4138-afec-beb79c2030d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:36.697473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a93c78-dbb2-4138-afec-beb79c2030d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:36.699368 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-76a93c78-dbb2-4138-afec-beb79c2030d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:36.768046 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a93c78-dbb2-4138-afec-beb79c2030d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:36.769530 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a93c78-dbb2-4138-afec-beb79c2030d6 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:36.779800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1334/2636] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:03:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:03:38.965642 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99f9a3-90e4-4147-93db-f95f989c2a66 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:38.966153 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99f9a3-90e4-4147-93db-f95f989c2a66 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:38.966399 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99f9a3-90e4-4147-93db-f95f989c2a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:38.990503 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-1f99f9a3-90e4-4147-93db-f95f989c2a66 None None] MFA Rules not processed for user `1eefe0d721484433b72afca03a2c1bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:38.992154 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1f99f9a3-90e4-4147-93db-f95f989c2a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:39.052882 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1303/2637] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Jun 16 19:03:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:39.075442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a93c78-dbb2-4138-afec-beb79c2030d6 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:39.077057 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-76a93c78-dbb2-4138-afec-beb79c2030d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:39.169361 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a93c78-dbb2-4138-afec-beb79c2030d6 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:39.174586 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6990f-d95e-4903-bb36-98d68393ddfa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b45db002889846eda5b2a3e6917fcbe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:39.175343 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6990f-d95e-4903-bb36-98d68393ddfa service swift] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:39.175696 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6990f-d95e-4903-bb36-98d68393ddfa service swift] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:39.176042 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6990f-d95e-4903-bb36-98d68393ddfa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:39.186799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6990f-d95e-4903-bb36-98d68393ddfa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:39.189995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6990f-d95e-4903-bb36-98d68393ddfa service swift] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:39.204037 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1335/2638] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Jun 16 19:03:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 19:03:40.323162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fe779-d349-499f-8446-f6755817246c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:40.323631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fe779-d349-499f-8446-f6755817246c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:40.323725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fe779-d349-499f-8446-f6755817246c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:40.342065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-859fe779-d349-499f-8446-f6755817246c None None] MFA Rules not processed for user `1eefe0d721484433b72afca03a2c1bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:40.343234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-859fe779-d349-499f-8446-f6755817246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:40.351530 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1304/2639] 10.222.0.93 () {58 vars in 967 bytes} [Thu Jun 16 19:03:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:40.364388 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6990f-d95e-4903-bb36-98d68393ddfa service swift] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:40.376583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6990f-d95e-4903-bb36-98d68393ddfa service swift] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:40.383359 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1851fd5-594c-449d-ac5d-899180fa2cfa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b45db002889846eda5b2a3e6917fcbe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:40.384132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1851fd5-594c-449d-ac5d-899180fa2cfa service swift] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:40.384529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1851fd5-594c-449d-ac5d-899180fa2cfa service swift] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:40.384879 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1851fd5-594c-449d-ac5d-899180fa2cfa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:40.394058 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1851fd5-594c-449d-ac5d-899180fa2cfa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:40.396268 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1851fd5-594c-449d-ac5d-899180fa2cfa service swift] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:40.415031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1336/2640] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Jun 16 19:03:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 19:03:40.575732 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fe779-d349-499f-8446-f6755817246c None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:40.577168 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-859fe779-d349-499f-8446-f6755817246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:40.657211 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fe779-d349-499f-8446-f6755817246c None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:40.662317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5384d9-18ba-42b0-95ba-faeb5f2ee96c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3abe1d47a1164776bf3a82fe4b129d9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:40.662959 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5384d9-18ba-42b0-95ba-faeb5f2ee96c service placement] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:40.663247 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5384d9-18ba-42b0-95ba-faeb5f2ee96c service placement] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:40.663529 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5384d9-18ba-42b0-95ba-faeb5f2ee96c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:40.667716 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6b5384d9-18ba-42b0-95ba-faeb5f2ee96c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:40.677162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5384d9-18ba-42b0-95ba-faeb5f2ee96c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:40.678757 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5384d9-18ba-42b0-95ba-faeb5f2ee96c service placement] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:40.690515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1305/2641] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:03:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:03:40.730590 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1851fd5-594c-449d-ac5d-899180fa2cfa service swift] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:40.732477 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-d1851fd5-594c-449d-ac5d-899180fa2cfa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:40.751260 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1851fd5-594c-449d-ac5d-899180fa2cfa service swift] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:40.757144 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11f0d1-c23a-4090-83e8-ccd92d48ed77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:40.758028 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11f0d1-c23a-4090-83e8-ccd92d48ed77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:40.758314 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11f0d1-c23a-4090-83e8-ccd92d48ed77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:40.758720 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11f0d1-c23a-4090-83e8-ccd92d48ed77 admin admin] PATH_INFO: `/v3/users/9813c801a8274c1abe49a0ff7457f119` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:40.760664 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11f0d1-c23a-4090-83e8-ccd92d48ed77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9813c801a8274c1abe49a0ff7457f119)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:40.762979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11f0d1-c23a-4090-83e8-ccd92d48ed77 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:40.791097 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:40.982390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4c11f0d1-c23a-4090-83e8-ccd92d48ed77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9813c801a8274c1abe49a0ff7457f119'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:40.983164 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4c11f0d1-c23a-4090-83e8-ccd92d48ed77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9813c801a8274c1abe49a0ff7457f119'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:41.040853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4c11f0d1-c23a-4090-83e8-ccd92d48ed77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9813c801a8274c1abe49a0ff7457f119'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:41.049928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4c11f0d1-c23a-4090-83e8-ccd92d48ed77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9813c801a8274c1abe49a0ff7457f119'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:41.050602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-4c11f0d1-c23a-4090-83e8-ccd92d48ed77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9813c801a8274c1abe49a0ff7457f119'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:41.067784 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1337/2642] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:03:40 2022] DELETE /identity/v3/users/9813c801a8274c1abe49a0ff7457f119 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:41.158473 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0724c9-7b2a-41d5-b754-736be024f0c6 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:41.158775 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0724c9-7b2a-41d5-b754-736be024f0c6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:41.159064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0724c9-7b2a-41d5-b754-736be024f0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:41.178034 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-8a0724c9-7b2a-41d5-b754-736be024f0c6 None None] MFA Rules not processed for user `1eefe0d721484433b72afca03a2c1bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:41.179632 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8a0724c9-7b2a-41d5-b754-736be024f0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:41.236866 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1306/2643] 10.222.0.93 () {58 vars in 1009 bytes} [Thu Jun 16 19:03:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:41.250400 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11f0d1-c23a-4090-83e8-ccd92d48ed77 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:41.251844 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-4c11f0d1-c23a-4090-83e8-ccd92d48ed77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:41.331085 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11f0d1-c23a-4090-83e8-ccd92d48ed77 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:41.331535 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0724c9-7b2a-41d5-b754-736be024f0c6 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:41.337485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8a0724c9-7b2a-41d5-b754-736be024f0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:41.337622 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe52a4-32ab-4394-a579-99c8bda20135 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b45db002889846eda5b2a3e6917fcbe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:41.338115 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe52a4-32ab-4394-a579-99c8bda20135 service swift] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:41.338393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe52a4-32ab-4394-a579-99c8bda20135 service swift] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:41.338734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe52a4-32ab-4394-a579-99c8bda20135 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:41.352095 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe52a4-32ab-4394-a579-99c8bda20135 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:41.354195 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe52a4-32ab-4394-a579-99c8bda20135 service swift] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:41.375413 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1338/2644] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Jun 16 19:03:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 19:03:41.389158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:41.425449 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0724c9-7b2a-41d5-b754-736be024f0c6 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:41.426259 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9603be0-c90d-41a2-bef3-3e9523e029cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:41.427209 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9603be0-c90d-41a2-bef3-3e9523e029cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:41.427495 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9603be0-c90d-41a2-bef3-3e9523e029cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:41.427773 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9603be0-c90d-41a2-bef3-3e9523e029cf admin admin] PATH_INFO: `/v3/projects/e29336a47ed64a5a9af091e3fab06cd6` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:41.429042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9603be0-c90d-41a2-bef3-3e9523e029cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e29336a47ed64a5a9af091e3fab06cd6)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:41.431145 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9603be0-c90d-41a2-bef3-3e9523e029cf admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:41.574632 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d9603be0-c90d-41a2-bef3-3e9523e029cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e29336a47ed64a5a9af091e3fab06cd6', 'request_id': 'req-d9603be0-c90d-41a2-bef3-3e9523e029cf'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:41.580052 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d9603be0-c90d-41a2-bef3-3e9523e029cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e29336a47ed64a5a9af091e3fab06cd6', 'request_id': 'req-d9603be0-c90d-41a2-bef3-3e9523e029cf'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:41.586837 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d9603be0-c90d-41a2-bef3-3e9523e029cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e29336a47ed64a5a9af091e3fab06cd6', 'request_id': 'req-d9603be0-c90d-41a2-bef3-3e9523e029cf'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:41.658250 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d9603be0-c90d-41a2-bef3-3e9523e029cf admin admin] The token cache is being invalidate because project e29336a47ed64a5a9af091e3fab06cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:03:41.658555 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d9603be0-c90d-41a2-bef3-3e9523e029cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:41.659251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-d9603be0-c90d-41a2-bef3-3e9523e029cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:41.661148 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1307/2645] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:03:41 2022] DELETE /identity/v3/projects/e29336a47ed64a5a9af091e3fab06cd6 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:41.666933 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50a887-f987-4c49-910a-ecec4a8a314a None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:41.667293 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50a887-f987-4c49-910a-ecec4a8a314a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:41.667583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50a887-f987-4c49-910a-ecec4a8a314a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:41.686754 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-7f50a887-f987-4c49-910a-ecec4a8a314a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:41.687928 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-7f50a887-f987-4c49-910a-ecec4a8a314a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:41.759683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1339/2646] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:41.761276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854f5c2-5970-40e6-9c17-dfcc101d0ca7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:41.761575 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854f5c2-5970-40e6-9c17-dfcc101d0ca7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:41.761861 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854f5c2-5970-40e6-9c17-dfcc101d0ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:41.781191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-3854f5c2-5970-40e6-9c17-dfcc101d0ca7 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:41.782440 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3854f5c2-5970-40e6-9c17-dfcc101d0ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:41.791875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1308/2647] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:41.796334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50a887-f987-4c49-910a-ecec4a8a314a None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:41.811492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50a887-f987-4c49-910a-ecec4a8a314a None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:41.814243 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787158a-9767-4be6-8eb3-82e4e4adb153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:41.814957 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787158a-9767-4be6-8eb3-82e4e4adb153 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:41.815245 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787158a-9767-4be6-8eb3-82e4e4adb153 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:41.815576 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787158a-9767-4be6-8eb3-82e4e4adb153 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:41.816266 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787158a-9767-4be6-8eb3-82e4e4adb153 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:03:41.816619 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787158a-9767-4be6-8eb3-82e4e4adb153 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:41.819206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787158a-9767-4be6-8eb3-82e4e4adb153 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:41.833332 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1340/2648] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 19:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 19:03:41.838056 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854f5c2-5970-40e6-9c17-dfcc101d0ca7 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:41.847704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854f5c2-5970-40e6-9c17-dfcc101d0ca7 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:41.852735 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09d78a-0cec-48e1-8024-8afa8d46e0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:41.853402 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09d78a-0cec-48e1-8024-8afa8d46e0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:41.853692 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09d78a-0cec-48e1-8024-8afa8d46e0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:41.854085 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09d78a-0cec-48e1-8024-8afa8d46e0c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:41.854799 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09d78a-0cec-48e1-8024-8afa8d46e0c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:41.856858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09d78a-0cec-48e1-8024-8afa8d46e0c2 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:41.940408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1309/2649] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:03:41 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:03:41.945450 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787158a-9767-4be6-8eb3-82e4e4adb153 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:41.956899 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787158a-9767-4be6-8eb3-82e4e4adb153 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:41.971885 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:41.998095 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915ea8b-c8ca-4651-916e-79e04c6f550d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:41.998246 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915ea8b-c8ca-4651-916e-79e04c6f550d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:41.998848 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915ea8b-c8ca-4651-916e-79e04c6f550d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:42.018368 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-4915ea8b-c8ca-4651-916e-79e04c6f550d None None] MFA Rules not processed for user `1eefe0d721484433b72afca03a2c1bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:42.019637 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4915ea8b-c8ca-4651-916e-79e04c6f550d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:42.026624 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5452a32-1f65-47d4-8c65-87f3c2e48fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:42.027566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5452a32-1f65-47d4-8c65-87f3c2e48fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:42.027925 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5452a32-1f65-47d4-8c65-87f3c2e48fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:42.028278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5452a32-1f65-47d4-8c65-87f3c2e48fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:42.029087 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5452a32-1f65-47d4-8c65-87f3c2e48fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:42.031145 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5452a32-1f65-47d4-8c65-87f3c2e48fe1 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:42.077216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1310/2650] 10.222.0.93 () {58 vars in 967 bytes} [Thu Jun 16 19:03:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:03:42.089298 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915ea8b-c8ca-4651-916e-79e04c6f550d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:42.090721 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4915ea8b-c8ca-4651-916e-79e04c6f550d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:42.134425 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:42.146822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1341/2651] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:03:41 2022] POST /identity/v3/users => generated 285 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:03:42.148041 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5452a32-1f65-47d4-8c65-87f3c2e48fe1 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:42.161305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5452a32-1f65-47d4-8c65-87f3c2e48fe1 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:42.164651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915ea8b-c8ca-4651-916e-79e04c6f550d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:42.166684 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5fa89-0001-4476-b859-d036fc09bddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:42.167468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5fa89-0001-4476-b859-d036fc09bddd admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:42.167857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5fa89-0001-4476-b859-d036fc09bddd admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:42.168271 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5fa89-0001-4476-b859-d036fc09bddd admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:42.169302 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5fa89-0001-4476-b859-d036fc09bddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:42.171190 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5fa89-0001-4476-b859-d036fc09bddd admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:42.171321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be43afd-5255-4e7a-86db-399a27829e84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b45db002889846eda5b2a3e6917fcbe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:42.171889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be43afd-5255-4e7a-86db-399a27829e84 service swift] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:42.172186 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be43afd-5255-4e7a-86db-399a27829e84 service swift] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:42.172495 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be43afd-5255-4e7a-86db-399a27829e84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:42.182165 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be43afd-5255-4e7a-86db-399a27829e84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:42.182741 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1342/2652] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 19:03:42.183744 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be43afd-5255-4e7a-86db-399a27829e84 service swift] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:42.186513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5fa89-0001-4476-b859-d036fc09bddd admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:42.192339 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1311/2653] 10.222.0.93 () {60 vars in 1384 bytes} [Thu Jun 16 19:03:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 19:03:42.207859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5fa89-0001-4476-b859-d036fc09bddd admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:42.207859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702648d3-7663-4fda-b79b-f1e78c2b47a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:42.207859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702648d3-7663-4fda-b79b-f1e78c2b47a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:42.207859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702648d3-7663-4fda-b79b-f1e78c2b47a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:42.208326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702648d3-7663-4fda-b79b-f1e78c2b47a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:42.208326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702648d3-7663-4fda-b79b-f1e78c2b47a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:42.208326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702648d3-7663-4fda-b79b-f1e78c2b47a6 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:42.219361 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1343/2654] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 19:03:42.224384 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be43afd-5255-4e7a-86db-399a27829e84 service swift] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:42.234615 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be43afd-5255-4e7a-86db-399a27829e84 service swift] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:42.239798 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91032e0-ba14-42e2-b681-97406aa51481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:42.240757 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91032e0-ba14-42e2-b681-97406aa51481 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:42.241070 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91032e0-ba14-42e2-b681-97406aa51481 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:42.241349 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91032e0-ba14-42e2-b681-97406aa51481 admin admin] PATH_INFO: `/v3/projects/c34134d934cd442097d2343dd60d2e32/users/a5459e44c265457886e79c7ec44d731c/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:42.256771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91032e0-ba14-42e2-b681-97406aa51481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34134d934cd442097d2343dd60d2e32, user_id=a5459e44c265457886e79c7ec44d731c, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:42.259538 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91032e0-ba14-42e2-b681-97406aa51481 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:42.338273 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1312/2655] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:03:42 2022] PUT /identity/v3/projects/c34134d934cd442097d2343dd60d2e32/users/a5459e44c265457886e79c7ec44d731c/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:42.350125 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194390c-d64c-486c-b28e-15f3af732cc9 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:42.350424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194390c-d64c-486c-b28e-15f3af732cc9 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:42.350756 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194390c-d64c-486c-b28e-15f3af732cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:42.376651 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-c194390c-d64c-486c-b28e-15f3af732cc9 None None] MFA Rules not processed for user `a5459e44c265457886e79c7ec44d731c`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:42.377859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c194390c-d64c-486c-b28e-15f3af732cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:42.448643 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1344/2656] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:42.453037 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91032e0-ba14-42e2-b681-97406aa51481 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:42.524673 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91032e0-ba14-42e2-b681-97406aa51481 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:42.529509 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95efa5-e9e1-4d89-9a04-c063360ae03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:42.530177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95efa5-e9e1-4d89-9a04-c063360ae03a admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:42.530669 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95efa5-e9e1-4d89-9a04-c063360ae03a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:42.530948 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95efa5-e9e1-4d89-9a04-c063360ae03a admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:42.531682 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95efa5-e9e1-4d89-9a04-c063360ae03a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:42.533778 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95efa5-e9e1-4d89-9a04-c063360ae03a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:42.614525 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1313/2657] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:03:42 2022] POST /identity/v3/projects => generated 369 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:03:42.619526 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194390c-d64c-486c-b28e-15f3af732cc9 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:42.633294 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194390c-d64c-486c-b28e-15f3af732cc9 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:42.715356 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b672e2c-75e6-4b67-bb0e-63e8ce71e931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:42.716062 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b672e2c-75e6-4b67-bb0e-63e8ce71e931 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:42.716353 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b672e2c-75e6-4b67-bb0e-63e8ce71e931 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:42.716689 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b672e2c-75e6-4b67-bb0e-63e8ce71e931 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:42.717392 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b672e2c-75e6-4b67-bb0e-63e8ce71e931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:42.719351 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b672e2c-75e6-4b67-bb0e-63e8ce71e931 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:42.840521 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1345/2658] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:03:42 2022] POST /identity/v3/users => generated 291 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:03:42.844617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95efa5-e9e1-4d89-9a04-c063360ae03a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:42.855407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95efa5-e9e1-4d89-9a04-c063360ae03a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:42.860477 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fb475-b3b3-45f8-afdd-1ec7e27a426c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:42.861390 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fb475-b3b3-45f8-afdd-1ec7e27a426c admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:42.862183 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fb475-b3b3-45f8-afdd-1ec7e27a426c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:42.862566 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fb475-b3b3-45f8-afdd-1ec7e27a426c admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:42.863430 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fb475-b3b3-45f8-afdd-1ec7e27a426c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:42.865396 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fb475-b3b3-45f8-afdd-1ec7e27a426c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:42.877571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1314/2659] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:03:42.882104 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b672e2c-75e6-4b67-bb0e-63e8ce71e931 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:42.896508 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:42.905403 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b672e2c-75e6-4b67-bb0e-63e8ce71e931 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:42.910853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910b135-e19e-4f61-a59c-a4e1de8c155b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:42.911832 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910b135-e19e-4f61-a59c-a4e1de8c155b admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:42.912227 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910b135-e19e-4f61-a59c-a4e1de8c155b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:42.912617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910b135-e19e-4f61-a59c-a4e1de8c155b admin admin] PATH_INFO: `/v3/projects/4447934f86b342d8ab734d775e350a2a/users/362026b4d62044649712f741dc89e0de/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:42.931316 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910b135-e19e-4f61-a59c-a4e1de8c155b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4447934f86b342d8ab734d775e350a2a, user_id=362026b4d62044649712f741dc89e0de, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:42.936253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910b135-e19e-4f61-a59c-a4e1de8c155b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:43.014166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1346/2660] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:03:42 2022] PUT /identity/v3/projects/4447934f86b342d8ab734d775e350a2a/users/362026b4d62044649712f741dc89e0de/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 19:03:43.018191 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fb475-b3b3-45f8-afdd-1ec7e27a426c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:43.029092 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fb475-b3b3-45f8-afdd-1ec7e27a426c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:43.094618 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50bd9d-9fb0-4631-9479-52bac9b5554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:43.095442 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50bd9d-9fb0-4631-9479-52bac9b5554e admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:43.095806 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50bd9d-9fb0-4631-9479-52bac9b5554e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:43.096218 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50bd9d-9fb0-4631-9479-52bac9b5554e admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:43.097161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50bd9d-9fb0-4631-9479-52bac9b5554e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:43.099210 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50bd9d-9fb0-4631-9479-52bac9b5554e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:43.111128 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1315/2661] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 19:03:43.115948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910b135-e19e-4f61-a59c-a4e1de8c155b admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:43.127639 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910b135-e19e-4f61-a59c-a4e1de8c155b admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:43.133415 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a96ff9-9727-4517-a6ee-d8b6ee73f38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:43.134606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a96ff9-9727-4517-a6ee-d8b6ee73f38c admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:43.134864 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a96ff9-9727-4517-a6ee-d8b6ee73f38c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:43.135207 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a96ff9-9727-4517-a6ee-d8b6ee73f38c admin admin] PATH_INFO: `/v3/projects/4447934f86b342d8ab734d775e350a2a/users/362026b4d62044649712f741dc89e0de/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:43.137239 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a96ff9-9727-4517-a6ee-d8b6ee73f38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4447934f86b342d8ab734d775e350a2a, user_id=362026b4d62044649712f741dc89e0de, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:43.139869 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a96ff9-9727-4517-a6ee-d8b6ee73f38c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:43.151546 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1347/2662] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:03:43 2022] PUT /identity/v3/projects/4447934f86b342d8ab734d775e350a2a/users/362026b4d62044649712f741dc89e0de/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:43.162069 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc456ab1-c8ec-440c-be98-b432ff2d0f19 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:43.162355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc456ab1-c8ec-440c-be98-b432ff2d0f19 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:43.162632 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc456ab1-c8ec-440c-be98-b432ff2d0f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:43.188978 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-dc456ab1-c8ec-440c-be98-b432ff2d0f19 None None] MFA Rules not processed for user `362026b4d62044649712f741dc89e0de`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:43.190184 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-dc456ab1-c8ec-440c-be98-b432ff2d0f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:43.195620 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:43.271081 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1316/2663] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:43 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:43.282941 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a96ff9-9727-4517-a6ee-d8b6ee73f38c admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:43.284532 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-04a96ff9-9727-4517-a6ee-d8b6ee73f38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:43.344280 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a96ff9-9727-4517-a6ee-d8b6ee73f38c admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:43.348001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406f71c-85d3-4b67-9d40-37e8afa97e8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:43.348681 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406f71c-85d3-4b67-9d40-37e8afa97e8c service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:43.348969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406f71c-85d3-4b67-9d40-37e8afa97e8c service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:43.349245 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406f71c-85d3-4b67-9d40-37e8afa97e8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:43.359231 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406f71c-85d3-4b67-9d40-37e8afa97e8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:43.360715 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406f71c-85d3-4b67-9d40-37e8afa97e8c service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:43.371831 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1348/2664] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:03:43 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:03:43.521811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc456ab1-c8ec-440c-be98-b432ff2d0f19 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:43.532617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc456ab1-c8ec-440c-be98-b432ff2d0f19 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:43.539089 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a2008-4148-4c9c-9c81-87b7bfb1f7a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:43.542327 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a2008-4148-4c9c-9c81-87b7bfb1f7a5 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:43.542327 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a2008-4148-4c9c-9c81-87b7bfb1f7a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:43.542327 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a2008-4148-4c9c-9c81-87b7bfb1f7a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:43.547968 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c623e-76e8-436b-b4d8-a6851ca77ec0 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:43.548486 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c623e-76e8-436b-b4d8-a6851ca77ec0 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:43.548687 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c623e-76e8-436b-b4d8-a6851ca77ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:43.573212 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-8d8c623e-76e8-436b-b4d8-a6851ca77ec0 None None] MFA Rules not processed for user `5a6dd8542964410a93e944ed1c0b3743`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:43.574416 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-8d8c623e-76e8-436b-b4d8-a6851ca77ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:43.606360 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a2008-4148-4c9c-9c81-87b7bfb1f7a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:43.608927 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a2008-4148-4c9c-9c81-87b7bfb1f7a5 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:43.624698 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1317/2665] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:03:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:03:43.651904 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1349/2666] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:43.963712 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a2008-4148-4c9c-9c81-87b7bfb1f7a5 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:43.965860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-626a2008-4148-4c9c-9c81-87b7bfb1f7a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:44.029678 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a2008-4148-4c9c-9c81-87b7bfb1f7a5 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:44.033472 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e8d04-bf3c-439a-b508-b9c4dff30ca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:44.034122 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e8d04-bf3c-439a-b508-b9c4dff30ca6 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:44.034408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e8d04-bf3c-439a-b508-b9c4dff30ca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:44.034687 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e8d04-bf3c-439a-b508-b9c4dff30ca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:44.036785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-1f9e8d04-bf3c-439a-b508-b9c4dff30ca6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:44.046363 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e8d04-bf3c-439a-b508-b9c4dff30ca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:44.047798 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e8d04-bf3c-439a-b508-b9c4dff30ca6 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:44.056344 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1318/2667] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:03:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:03:45.008966 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c623e-76e8-436b-b4d8-a6851ca77ec0 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:45.010361 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-8d8c623e-76e8-436b-b4d8-a6851ca77ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:45.081940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c623e-76e8-436b-b4d8-a6851ca77ec0 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:45.086295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8992a-5b54-424a-bd57-1e396a384825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:45.087165 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8992a-5b54-424a-bd57-1e396a384825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:45.087445 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8992a-5b54-424a-bd57-1e396a384825 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:45.087823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8992a-5b54-424a-bd57-1e396a384825 admin admin] PATH_INFO: `/v3/users/6f8cb1b5da4a4ab0a6bf46475bf32d66` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:45.088919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8992a-5b54-424a-bd57-1e396a384825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f8cb1b5da4a4ab0a6bf46475bf32d66)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:45.090821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8992a-5b54-424a-bd57-1e396a384825 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:45.104549 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:45.336997 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ead8992a-5b54-424a-bd57-1e396a384825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f8cb1b5da4a4ab0a6bf46475bf32d66'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:45.337580 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ead8992a-5b54-424a-bd57-1e396a384825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f8cb1b5da4a4ab0a6bf46475bf32d66'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:45.405337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ead8992a-5b54-424a-bd57-1e396a384825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f8cb1b5da4a4ab0a6bf46475bf32d66'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:45.413935 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ead8992a-5b54-424a-bd57-1e396a384825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f8cb1b5da4a4ab0a6bf46475bf32d66'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:45.414608 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ead8992a-5b54-424a-bd57-1e396a384825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f8cb1b5da4a4ab0a6bf46475bf32d66'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:45.433275 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1350/2668] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:03:45 2022] DELETE /identity/v3/users/6f8cb1b5da4a4ab0a6bf46475bf32d66 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:45.437763 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12425caa-c62c-4028-ad90-55eac79b4bea None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:45.438222 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12425caa-c62c-4028-ad90-55eac79b4bea None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:45.438588 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12425caa-c62c-4028-ad90-55eac79b4bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:45.456540 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-12425caa-c62c-4028-ad90-55eac79b4bea None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:45.458341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-12425caa-c62c-4028-ad90-55eac79b4bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:45.499870 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:45.521492 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1319/2669] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:45.531255 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8992a-5b54-424a-bd57-1e396a384825 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:45.532670 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-ead8992a-5b54-424a-bd57-1e396a384825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:45.592572 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8992a-5b54-424a-bd57-1e396a384825 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:45.596314 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39655dc-07f3-4328-a60c-6ec187dede3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:45.597012 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39655dc-07f3-4328-a60c-6ec187dede3e service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:45.597345 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39655dc-07f3-4328-a60c-6ec187dede3e service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:45.597591 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39655dc-07f3-4328-a60c-6ec187dede3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:45.608672 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39655dc-07f3-4328-a60c-6ec187dede3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:45.610195 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39655dc-07f3-4328-a60c-6ec187dede3e service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:45.632314 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1351/2670] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:03:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:03:45.870177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12425caa-c62c-4028-ad90-55eac79b4bea None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:45.871694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-12425caa-c62c-4028-ad90-55eac79b4bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:45.885302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12425caa-c62c-4028-ad90-55eac79b4bea None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:45.890400 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f0506-581f-4b68-9434-0d832b1f8804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:45.891309 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f0506-581f-4b68-9434-0d832b1f8804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:45.891623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f0506-581f-4b68-9434-0d832b1f8804 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:45.891909 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f0506-581f-4b68-9434-0d832b1f8804 admin admin] PATH_INFO: `/v3/projects/f0eb05ed20c948fbad5e916d6549b01a` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:45.893235 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f0506-581f-4b68-9434-0d832b1f8804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0eb05ed20c948fbad5e916d6549b01a)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:45.895884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f0506-581f-4b68-9434-0d832b1f8804 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:46.034948 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8e5f0506-581f-4b68-9434-0d832b1f8804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0eb05ed20c948fbad5e916d6549b01a', 'request_id': 'req-8e5f0506-581f-4b68-9434-0d832b1f8804'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:46.040851 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8e5f0506-581f-4b68-9434-0d832b1f8804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0eb05ed20c948fbad5e916d6549b01a', 'request_id': 'req-8e5f0506-581f-4b68-9434-0d832b1f8804'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:46.049232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8e5f0506-581f-4b68-9434-0d832b1f8804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0eb05ed20c948fbad5e916d6549b01a', 'request_id': 'req-8e5f0506-581f-4b68-9434-0d832b1f8804'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:46.142226 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8e5f0506-581f-4b68-9434-0d832b1f8804 admin admin] The token cache is being invalidate because project f0eb05ed20c948fbad5e916d6549b01a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:03:46.142451 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8e5f0506-581f-4b68-9434-0d832b1f8804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:46.143066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-8e5f0506-581f-4b68-9434-0d832b1f8804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:46.144630 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1320/2671] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:03:45 2022] DELETE /identity/v3/projects/f0eb05ed20c948fbad5e916d6549b01a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:46.149697 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3029e-ce66-4256-9e8a-44dd3b6411ce None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:46.150228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3029e-ce66-4256-9e8a-44dd3b6411ce None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:46.150392 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3029e-ce66-4256-9e8a-44dd3b6411ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:46.168507 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-15e3029e-ce66-4256-9e8a-44dd3b6411ce None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:46.169795 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-15e3029e-ce66-4256-9e8a-44dd3b6411ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:46.229470 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1352/2672] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:46.238930 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f7029-c45f-4605-a223-c4c9efcfb2e0 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:46.239260 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f7029-c45f-4605-a223-c4c9efcfb2e0 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:46.239545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f7029-c45f-4605-a223-c4c9efcfb2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:46.259859 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-fb9f7029-c45f-4605-a223-c4c9efcfb2e0 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:46.261131 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fb9f7029-c45f-4605-a223-c4c9efcfb2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:46.278008 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1321/2673] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:46.282348 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3029e-ce66-4256-9e8a-44dd3b6411ce None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:46.292191 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3029e-ce66-4256-9e8a-44dd3b6411ce None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:46.297293 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b7d9f-e96d-480a-a654-80af8e86b156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:46.297962 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b7d9f-e96d-480a-a654-80af8e86b156 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:46.298250 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b7d9f-e96d-480a-a654-80af8e86b156 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:46.298528 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b7d9f-e96d-480a-a654-80af8e86b156 admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:46.299375 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b7d9f-e96d-480a-a654-80af8e86b156 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:03:46.299661 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b7d9f-e96d-480a-a654-80af8e86b156 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:46.301944 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b7d9f-e96d-480a-a654-80af8e86b156 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:46.314066 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1353/2674] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 19:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 19:03:46.322676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f7029-c45f-4605-a223-c4c9efcfb2e0 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:46.332283 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f7029-c45f-4605-a223-c4c9efcfb2e0 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:46.337681 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b53bd-3285-4359-af14-f5fac9a8423a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:46.338325 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b53bd-3285-4359-af14-f5fac9a8423a admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:46.338694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b53bd-3285-4359-af14-f5fac9a8423a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:46.338920 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b53bd-3285-4359-af14-f5fac9a8423a admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:46.339586 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b53bd-3285-4359-af14-f5fac9a8423a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:46.341571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b53bd-3285-4359-af14-f5fac9a8423a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:46.453279 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1322/2675] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:03:46 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:03:46.457098 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b7d9f-e96d-480a-a654-80af8e86b156 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:46.467091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b7d9f-e96d-480a-a654-80af8e86b156 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:46.489258 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:46.533656 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc1b99-1671-4700-b91a-1b22accfb679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:46.534346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc1b99-1671-4700-b91a-1b22accfb679 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:46.534636 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc1b99-1671-4700-b91a-1b22accfb679 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:46.534917 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc1b99-1671-4700-b91a-1b22accfb679 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:46.536180 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc1b99-1671-4700-b91a-1b22accfb679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:46.538527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc1b99-1671-4700-b91a-1b22accfb679 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:46.641274 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1354/2676] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:03:46 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:03:46.642581 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b53bd-3285-4359-af14-f5fac9a8423a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:46.653052 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b53bd-3285-4359-af14-f5fac9a8423a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:46.658020 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377e619-a459-4741-9e00-7aac0a3d7a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:46.659065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377e619-a459-4741-9e00-7aac0a3d7a7c admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:46.659065 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377e619-a459-4741-9e00-7aac0a3d7a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:46.659305 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377e619-a459-4741-9e00-7aac0a3d7a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:46.661034 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377e619-a459-4741-9e00-7aac0a3d7a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:46.662115 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377e619-a459-4741-9e00-7aac0a3d7a7c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:46.680086 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1323/2677] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:03:46.681098 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc1b99-1671-4700-b91a-1b22accfb679 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:46.691083 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc1b99-1671-4700-b91a-1b22accfb679 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:46.695886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cb55f-5084-4ddc-ba20-76e316966c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:46.696622 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cb55f-5084-4ddc-ba20-76e316966c0e admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:46.696859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cb55f-5084-4ddc-ba20-76e316966c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:46.697136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cb55f-5084-4ddc-ba20-76e316966c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:46.697868 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cb55f-5084-4ddc-ba20-76e316966c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:46.705123 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cb55f-5084-4ddc-ba20-76e316966c0e admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:46.709724 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1355/2678] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:03:46.713854 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377e619-a459-4741-9e00-7aac0a3d7a7c admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:46.724420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377e619-a459-4741-9e00-7aac0a3d7a7c admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:46.730018 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cff23-645d-4277-a45a-74f0dc5dec1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:46.731026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cff23-645d-4277-a45a-74f0dc5dec1a admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:46.731317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cff23-645d-4277-a45a-74f0dc5dec1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:46.731587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cff23-645d-4277-a45a-74f0dc5dec1a admin admin] PATH_INFO: `/v3/projects/7d0c0f17da8d483ca0a26da401a20029/users/bb055af2fca84739a7b5d3b373ab7298/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:46.749654 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cff23-645d-4277-a45a-74f0dc5dec1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d0c0f17da8d483ca0a26da401a20029, user_id=bb055af2fca84739a7b5d3b373ab7298, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:46.752322 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cff23-645d-4277-a45a-74f0dc5dec1a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:46.876162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1324/2679] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:03:46 2022] PUT /identity/v3/projects/7d0c0f17da8d483ca0a26da401a20029/users/bb055af2fca84739a7b5d3b373ab7298/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:46.881621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dba1fe-d1eb-41ee-a215-abe81f8a19ae None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:46.881974 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dba1fe-d1eb-41ee-a215-abe81f8a19ae None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:46.882297 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dba1fe-d1eb-41ee-a215-abe81f8a19ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:46.900429 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-b4dba1fe-d1eb-41ee-a215-abe81f8a19ae None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:46.901714 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b4dba1fe-d1eb-41ee-a215-abe81f8a19ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:46.963744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1356/2680] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:46.974340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cff23-645d-4277-a45a-74f0dc5dec1a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:46.976121 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6d4cff23-645d-4277-a45a-74f0dc5dec1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:47.034565 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cff23-645d-4277-a45a-74f0dc5dec1a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:47.038514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5d7b2-7f8e-4a46-b8d3-38f40e9619df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:47.039147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5d7b2-7f8e-4a46-b8d3-38f40e9619df service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:47.039361 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5d7b2-7f8e-4a46-b8d3-38f40e9619df service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:47.039635 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5d7b2-7f8e-4a46-b8d3-38f40e9619df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:47.049133 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5d7b2-7f8e-4a46-b8d3-38f40e9619df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:47.050558 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5d7b2-7f8e-4a46-b8d3-38f40e9619df service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:47.069485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1325/2681] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:03:48.934533 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dba1fe-d1eb-41ee-a215-abe81f8a19ae None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:48.936079 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-b4dba1fe-d1eb-41ee-a215-abe81f8a19ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:48.948858 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dba1fe-d1eb-41ee-a215-abe81f8a19ae None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:48.954257 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ca36e-de3d-4edd-ab29-1ca352236d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:48.955139 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ca36e-de3d-4edd-ab29-1ca352236d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:48.955459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ca36e-de3d-4edd-ab29-1ca352236d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:48.955744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ca36e-de3d-4edd-ab29-1ca352236d23 admin admin] PATH_INFO: `/v3/users/a5459e44c265457886e79c7ec44d731c` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:48.957566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ca36e-de3d-4edd-ab29-1ca352236d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5459e44c265457886e79c7ec44d731c)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:48.959521 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ca36e-de3d-4edd-ab29-1ca352236d23 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:49.292105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-945ca36e-de3d-4edd-ab29-1ca352236d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5459e44c265457886e79c7ec44d731c'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:49.292958 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-945ca36e-de3d-4edd-ab29-1ca352236d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5459e44c265457886e79c7ec44d731c'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:49.362161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-945ca36e-de3d-4edd-ab29-1ca352236d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5459e44c265457886e79c7ec44d731c'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:49.373104 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-945ca36e-de3d-4edd-ab29-1ca352236d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5459e44c265457886e79c7ec44d731c'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:49.374193 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-945ca36e-de3d-4edd-ab29-1ca352236d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5459e44c265457886e79c7ec44d731c'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:49.406148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1357/2682] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:03:48 2022] DELETE /identity/v3/users/a5459e44c265457886e79c7ec44d731c => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:49.411520 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d62d0f-00f4-4074-ab3b-d1a23c523b49 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:49.412060 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d62d0f-00f4-4074-ab3b-d1a23c523b49 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:49.412176 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d62d0f-00f4-4074-ab3b-d1a23c523b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:49.421177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:49.436384 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-21d62d0f-00f4-4074-ab3b-d1a23c523b49 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:49.437722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-21d62d0f-00f4-4074-ab3b-d1a23c523b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:49.515279 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1326/2683] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:49.531897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ca36e-de3d-4edd-ab29-1ca352236d23 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:49.531897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-945ca36e-de3d-4edd-ab29-1ca352236d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:49.554909 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:49.611660 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ca36e-de3d-4edd-ab29-1ca352236d23 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:49.616552 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f821c-12ea-4888-8334-a3286051a109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:49.618950 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f821c-12ea-4888-8334-a3286051a109 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:49.618950 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f821c-12ea-4888-8334-a3286051a109 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:49.618950 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f821c-12ea-4888-8334-a3286051a109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:49.628116 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f821c-12ea-4888-8334-a3286051a109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:49.629700 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f821c-12ea-4888-8334-a3286051a109 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:49.642082 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1358/2684] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:03:50.410617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d62d0f-00f4-4074-ab3b-d1a23c523b49 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:50.412614 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-21d62d0f-00f4-4074-ab3b-d1a23c523b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:50.425345 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d62d0f-00f4-4074-ab3b-d1a23c523b49 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:50.444208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172be383-c7fa-4c4e-a469-7446cea28c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:50.445394 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172be383-c7fa-4c4e-a469-7446cea28c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:50.445695 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172be383-c7fa-4c4e-a469-7446cea28c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:50.446172 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172be383-c7fa-4c4e-a469-7446cea28c0b admin admin] PATH_INFO: `/v3/projects/c34134d934cd442097d2343dd60d2e32` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:50.447514 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172be383-c7fa-4c4e-a469-7446cea28c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34134d934cd442097d2343dd60d2e32)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:50.450172 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172be383-c7fa-4c4e-a469-7446cea28c0b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:50.618557 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-172be383-c7fa-4c4e-a469-7446cea28c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34134d934cd442097d2343dd60d2e32', 'request_id': 'req-172be383-c7fa-4c4e-a469-7446cea28c0b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:50.621922 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-172be383-c7fa-4c4e-a469-7446cea28c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34134d934cd442097d2343dd60d2e32', 'request_id': 'req-172be383-c7fa-4c4e-a469-7446cea28c0b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:50.632882 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-172be383-c7fa-4c4e-a469-7446cea28c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34134d934cd442097d2343dd60d2e32', 'request_id': 'req-172be383-c7fa-4c4e-a469-7446cea28c0b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:50.684878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-172be383-c7fa-4c4e-a469-7446cea28c0b admin admin] The token cache is being invalidate because project c34134d934cd442097d2343dd60d2e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:03:50.685277 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-172be383-c7fa-4c4e-a469-7446cea28c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:50.686181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-172be383-c7fa-4c4e-a469-7446cea28c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:50.687725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1327/2685] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:03:50 2022] DELETE /identity/v3/projects/c34134d934cd442097d2343dd60d2e32 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:50.692354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f821c-12ea-4888-8334-a3286051a109 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:50.702629 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f821c-12ea-4888-8334-a3286051a109 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:50.759865 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da351332-8281-42f6-b428-dbd5e3503351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:50.760801 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da351332-8281-42f6-b428-dbd5e3503351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:50.761092 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da351332-8281-42f6-b428-dbd5e3503351 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:50.761425 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da351332-8281-42f6-b428-dbd5e3503351 admin admin] PATH_INFO: `/v3/users/362026b4d62044649712f741dc89e0de` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:50.762629 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da351332-8281-42f6-b428-dbd5e3503351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=362026b4d62044649712f741dc89e0de)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:50.764584 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da351332-8281-42f6-b428-dbd5e3503351 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:50.959892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-da351332-8281-42f6-b428-dbd5e3503351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '362026b4d62044649712f741dc89e0de'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:50.960620 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-da351332-8281-42f6-b428-dbd5e3503351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '362026b4d62044649712f741dc89e0de'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:51.031762 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-da351332-8281-42f6-b428-dbd5e3503351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '362026b4d62044649712f741dc89e0de'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:51.040337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-da351332-8281-42f6-b428-dbd5e3503351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '362026b4d62044649712f741dc89e0de'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:51.041052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-da351332-8281-42f6-b428-dbd5e3503351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '362026b4d62044649712f741dc89e0de'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:51.058807 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1359/2686] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:03:50 2022] DELETE /identity/v3/users/362026b4d62044649712f741dc89e0de => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:51.564949 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172be383-c7fa-4c4e-a469-7446cea28c0b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:51.569704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-172be383-c7fa-4c4e-a469-7446cea28c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:51.583050 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172be383-c7fa-4c4e-a469-7446cea28c0b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:51.659885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb453798-94ca-46fd-8dc8-e6b624da4646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:51.660896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb453798-94ca-46fd-8dc8-e6b624da4646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:51.661409 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb453798-94ca-46fd-8dc8-e6b624da4646 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:51.661697 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb453798-94ca-46fd-8dc8-e6b624da4646 admin admin] PATH_INFO: `/v3/projects/4447934f86b342d8ab734d775e350a2a` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:51.662923 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb453798-94ca-46fd-8dc8-e6b624da4646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4447934f86b342d8ab734d775e350a2a)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:51.664994 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb453798-94ca-46fd-8dc8-e6b624da4646 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:51.794992 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:51.808893 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bb453798-94ca-46fd-8dc8-e6b624da4646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4447934f86b342d8ab734d775e350a2a', 'request_id': 'req-bb453798-94ca-46fd-8dc8-e6b624da4646'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:51.814381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bb453798-94ca-46fd-8dc8-e6b624da4646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4447934f86b342d8ab734d775e350a2a', 'request_id': 'req-bb453798-94ca-46fd-8dc8-e6b624da4646'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:51.820946 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bb453798-94ca-46fd-8dc8-e6b624da4646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4447934f86b342d8ab734d775e350a2a', 'request_id': 'req-bb453798-94ca-46fd-8dc8-e6b624da4646'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:51.884807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bb453798-94ca-46fd-8dc8-e6b624da4646 admin admin] The token cache is being invalidate because project 4447934f86b342d8ab734d775e350a2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:03:51.885103 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bb453798-94ca-46fd-8dc8-e6b624da4646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:51.885874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-bb453798-94ca-46fd-8dc8-e6b624da4646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:51.887700 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1328/2687] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:03:51 2022] DELETE /identity/v3/projects/4447934f86b342d8ab734d775e350a2a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:51.893462 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a931036-89ea-460e-85ce-89eee043c2a3 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:51.893938 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a931036-89ea-460e-85ce-89eee043c2a3 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:51.894052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a931036-89ea-460e-85ce-89eee043c2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:51.912860 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-8a931036-89ea-460e-85ce-89eee043c2a3 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:51.914088 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-8a931036-89ea-460e-85ce-89eee043c2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:51.946356 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:51.979787 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1360/2688] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:51.988680 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ff8d3-ad9f-44e8-94b4-a8f4efd0fe9e None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:51.988976 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ff8d3-ad9f-44e8-94b4-a8f4efd0fe9e None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:51.989255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ff8d3-ad9f-44e8-94b4-a8f4efd0fe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:52.010278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d94ff8d3-ad9f-44e8-94b4-a8f4efd0fe9e None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:52.011580 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d94ff8d3-ad9f-44e8-94b4-a8f4efd0fe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:52.032255 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1329/2689] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:52.038622 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a931036-89ea-460e-85ce-89eee043c2a3 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:52.058411 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a931036-89ea-460e-85ce-89eee043c2a3 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:52.066692 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b55c5f-8a42-492f-a3ae-59916339980c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:52.067858 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b55c5f-8a42-492f-a3ae-59916339980c admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:52.068385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b55c5f-8a42-492f-a3ae-59916339980c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:52.073385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b55c5f-8a42-492f-a3ae-59916339980c admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:52.073385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b55c5f-8a42-492f-a3ae-59916339980c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:03:52.073385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b55c5f-8a42-492f-a3ae-59916339980c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:52.073385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b55c5f-8a42-492f-a3ae-59916339980c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:52.090925 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1361/2690] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 19:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 19:03:52.091586 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ff8d3-ad9f-44e8-94b4-a8f4efd0fe9e None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:52.102541 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ff8d3-ad9f-44e8-94b4-a8f4efd0fe9e None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:52.109104 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93adef-1e86-4167-84fa-a9a4e10cf4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:52.110254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93adef-1e86-4167-84fa-a9a4e10cf4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:52.110254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93adef-1e86-4167-84fa-a9a4e10cf4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:52.110519 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93adef-1e86-4167-84fa-a9a4e10cf4f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:52.111217 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93adef-1e86-4167-84fa-a9a4e10cf4f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:52.113208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93adef-1e86-4167-84fa-a9a4e10cf4f5 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:52.228254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1330/2691] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:03:52 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:03:52.228479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b55c5f-8a42-492f-a3ae-59916339980c admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:52.236367 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b55c5f-8a42-492f-a3ae-59916339980c admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:52.309783 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54143994-fdd7-49bb-90ba-b2ef558db8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:52.310539 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143994-fdd7-49bb-90ba-b2ef558db8fa admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:52.310898 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143994-fdd7-49bb-90ba-b2ef558db8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:52.311243 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143994-fdd7-49bb-90ba-b2ef558db8fa admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:52.312046 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54143994-fdd7-49bb-90ba-b2ef558db8fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:52.314940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54143994-fdd7-49bb-90ba-b2ef558db8fa admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:52.402166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1362/2692] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:03:52 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:03:52.403767 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93adef-1e86-4167-84fa-a9a4e10cf4f5 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:52.416109 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93adef-1e86-4167-84fa-a9a4e10cf4f5 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:52.422553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0bdb5-588b-4508-8700-f84fed30315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:52.423250 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0bdb5-588b-4508-8700-f84fed30315a admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:52.423536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0bdb5-588b-4508-8700-f84fed30315a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:52.423815 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0bdb5-588b-4508-8700-f84fed30315a admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:52.424602 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0bdb5-588b-4508-8700-f84fed30315a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:52.426330 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0bdb5-588b-4508-8700-f84fed30315a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:52.438595 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1331/2693] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:03:52.443936 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54143994-fdd7-49bb-90ba-b2ef558db8fa admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:52.457692 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54143994-fdd7-49bb-90ba-b2ef558db8fa admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:52.464498 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaaee76-0ac1-41f7-8524-a28becc0a82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:52.465294 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaaee76-0ac1-41f7-8524-a28becc0a82d admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:52.465750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaaee76-0ac1-41f7-8524-a28becc0a82d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:52.466103 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaaee76-0ac1-41f7-8524-a28becc0a82d admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:52.466924 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaaee76-0ac1-41f7-8524-a28becc0a82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:52.469016 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaaee76-0ac1-41f7-8524-a28becc0a82d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:52.486082 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1363/2694] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:03:52.491196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0bdb5-588b-4508-8700-f84fed30315a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:52.504979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0bdb5-588b-4508-8700-f84fed30315a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:52.510489 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec64b88-27c3-4055-9a51-3ee83c5abd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:52.511506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec64b88-27c3-4055-9a51-3ee83c5abd7e admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:52.511917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec64b88-27c3-4055-9a51-3ee83c5abd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:52.512315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec64b88-27c3-4055-9a51-3ee83c5abd7e admin admin] PATH_INFO: `/v3/projects/470728f8d0ba418d80da6414d8974966/users/da7c8c8c91834f949c6ad19282aa1155/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:52.532937 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec64b88-27c3-4055-9a51-3ee83c5abd7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=470728f8d0ba418d80da6414d8974966, user_id=da7c8c8c91834f949c6ad19282aa1155, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:52.537024 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec64b88-27c3-4055-9a51-3ee83c5abd7e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:52.617783 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1332/2695] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:03:52 2022] PUT /identity/v3/projects/470728f8d0ba418d80da6414d8974966/users/da7c8c8c91834f949c6ad19282aa1155/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 19:03:52.631818 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ba851-c12e-4872-8982-7fc6fda7637b None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:52.632123 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ba851-c12e-4872-8982-7fc6fda7637b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:52.632307 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ba851-c12e-4872-8982-7fc6fda7637b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:52.690061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-ad8ba851-c12e-4872-8982-7fc6fda7637b None None] MFA Rules not processed for user `da7c8c8c91834f949c6ad19282aa1155`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:52.692307 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-ad8ba851-c12e-4872-8982-7fc6fda7637b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:52.790681 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1364/2696] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:52.795039 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec64b88-27c3-4055-9a51-3ee83c5abd7e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:52.878059 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec64b88-27c3-4055-9a51-3ee83c5abd7e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:52.885158 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4d812-3cb3-46ed-aae2-30d5cb8843fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:52.886717 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4d812-3cb3-46ed-aae2-30d5cb8843fd admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:52.888033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4d812-3cb3-46ed-aae2-30d5cb8843fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:52.889164 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4d812-3cb3-46ed-aae2-30d5cb8843fd admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:52.889899 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4d812-3cb3-46ed-aae2-30d5cb8843fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:52.892303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4d812-3cb3-46ed-aae2-30d5cb8843fd admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:53.005894 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1333/2697] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:03:52 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:03:53.010816 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ba851-c12e-4872-8982-7fc6fda7637b None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:53.049340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ba851-c12e-4872-8982-7fc6fda7637b None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:53.093641 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:53.129743 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a34dc-7967-49e0-b1f5-32267089c9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:53.130505 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a34dc-7967-49e0-b1f5-32267089c9fd admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:53.131947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a34dc-7967-49e0-b1f5-32267089c9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:53.134017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a34dc-7967-49e0-b1f5-32267089c9fd admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:53.135577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a34dc-7967-49e0-b1f5-32267089c9fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:53.145433 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a34dc-7967-49e0-b1f5-32267089c9fd admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:53.246786 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1365/2698] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:03:53 2022] POST /identity/v3/users => generated 299 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:03:53.250044 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4d812-3cb3-46ed-aae2-30d5cb8843fd admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:53.263107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4d812-3cb3-46ed-aae2-30d5cb8843fd admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:53.278040 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c1253-ccc0-406a-8937-0b107157a9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:53.282470 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c1253-ccc0-406a-8937-0b107157a9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:53.282470 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c1253-ccc0-406a-8937-0b107157a9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:53.282470 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c1253-ccc0-406a-8937-0b107157a9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:53.282470 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c1253-ccc0-406a-8937-0b107157a9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:53.282470 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c1253-ccc0-406a-8937-0b107157a9b8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:53.297789 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1334/2699] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:03:53.298977 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a34dc-7967-49e0-b1f5-32267089c9fd admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:53.320282 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b80c5-de34-435d-8f2c-c702a7916b6f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:53.320624 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b80c5-de34-435d-8f2c-c702a7916b6f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:53.320910 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b80c5-de34-435d-8f2c-c702a7916b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:53.321339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a34dc-7967-49e0-b1f5-32267089c9fd admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:53.326487 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4d53e-293f-4c42-843e-2596ccfd0700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:53.328112 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4d53e-293f-4c42-843e-2596ccfd0700 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:53.328921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4d53e-293f-4c42-843e-2596ccfd0700 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:53.329465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4d53e-293f-4c42-843e-2596ccfd0700 admin admin] PATH_INFO: `/v3/projects/d5585c089c85412ab9ebbfddc358e057/users/25d70b9673f24a1fa3044a0bf74ef508/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:53.351584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5b2b80c5-de34-435d-8f2c-c702a7916b6f None None] MFA Rules not processed for user `bb055af2fca84739a7b5d3b373ab7298`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:53.352802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4d53e-293f-4c42-843e-2596ccfd0700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5585c089c85412ab9ebbfddc358e057, user_id=25d70b9673f24a1fa3044a0bf74ef508, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:53.352956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5b2b80c5-de34-435d-8f2c-c702a7916b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:53.360011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4d53e-293f-4c42-843e-2596ccfd0700 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:53.381250 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:53.429023 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1366/2700] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:03:53 2022] PUT /identity/v3/projects/d5585c089c85412ab9ebbfddc358e057/users/25d70b9673f24a1fa3044a0bf74ef508/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 19:03:53.432545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4d53e-293f-4c42-843e-2596ccfd0700 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:53.455386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1335/2701] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:53.460341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b80c5-de34-435d-8f2c-c702a7916b6f None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:53.464129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5b2b80c5-de34-435d-8f2c-c702a7916b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:53.481646 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b80c5-de34-435d-8f2c-c702a7916b6f None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:53.522635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4d53e-293f-4c42-843e-2596ccfd0700 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:53.529004 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13724a31-6aac-4c78-9ee6-89e3b9ec06da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:53.529820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13724a31-6aac-4c78-9ee6-89e3b9ec06da admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:53.530710 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13724a31-6aac-4c78-9ee6-89e3b9ec06da admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:53.531189 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13724a31-6aac-4c78-9ee6-89e3b9ec06da admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:53.532353 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13724a31-6aac-4c78-9ee6-89e3b9ec06da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:53.535337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13724a31-6aac-4c78-9ee6-89e3b9ec06da admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:53.552416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eda7f1-d6e8-4e0a-8a74-300facac46f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:53.553655 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eda7f1-d6e8-4e0a-8a74-300facac46f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:53.553995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1367/2702] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 19:03:53.554162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eda7f1-d6e8-4e0a-8a74-300facac46f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:53.554538 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eda7f1-d6e8-4e0a-8a74-300facac46f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:53.554892 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13724a31-6aac-4c78-9ee6-89e3b9ec06da admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:53.555601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eda7f1-d6e8-4e0a-8a74-300facac46f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:53.557875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eda7f1-d6e8-4e0a-8a74-300facac46f7 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:53.568454 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13724a31-6aac-4c78-9ee6-89e3b9ec06da admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:53.581133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6506b43-ae4b-4bee-b7df-d868a65f1a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:53.582668 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6506b43-ae4b-4bee-b7df-d868a65f1a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:53.582967 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6506b43-ae4b-4bee-b7df-d868a65f1a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:53.583234 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6506b43-ae4b-4bee-b7df-d868a65f1a69 admin admin] PATH_INFO: `/v3/projects/d5585c089c85412ab9ebbfddc358e057/users/25d70b9673f24a1fa3044a0bf74ef508/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:53.585365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6506b43-ae4b-4bee-b7df-d868a65f1a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5585c089c85412ab9ebbfddc358e057, user_id=25d70b9673f24a1fa3044a0bf74ef508, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:53.588291 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6506b43-ae4b-4bee-b7df-d868a65f1a69 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:53.599654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1368/2703] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:03:53 2022] PUT /identity/v3/projects/d5585c089c85412ab9ebbfddc358e057/users/25d70b9673f24a1fa3044a0bf74ef508/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:53.610056 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd4f8e-3b7b-473a-b78c-5389992ace8b None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:53.613404 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd4f8e-3b7b-473a-b78c-5389992ace8b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:53.613404 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd4f8e-3b7b-473a-b78c-5389992ace8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:53.641329 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-44cd4f8e-3b7b-473a-b78c-5389992ace8b None None] MFA Rules not processed for user `25d70b9673f24a1fa3044a0bf74ef508`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:53.642640 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-44cd4f8e-3b7b-473a-b78c-5389992ace8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:53.667208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1336/2704] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:03:53 2022] POST /identity/v3/projects => generated 371 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:03:53.671180 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eda7f1-d6e8-4e0a-8a74-300facac46f7 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:53.733390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1369/2705] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:53.746130 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd4f8e-3b7b-473a-b78c-5389992ace8b None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:53.751090 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-44cd4f8e-3b7b-473a-b78c-5389992ace8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:53.755659 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eda7f1-d6e8-4e0a-8a74-300facac46f7 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:53.765232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c245c12-2534-4501-a5f3-352776927bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:53.766070 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c245c12-2534-4501-a5f3-352776927bdd admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:53.766419 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c245c12-2534-4501-a5f3-352776927bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:53.766645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c245c12-2534-4501-a5f3-352776927bdd admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:53.767362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c245c12-2534-4501-a5f3-352776927bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:53.773129 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c245c12-2534-4501-a5f3-352776927bdd admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:53.777145 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:53.839716 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd4f8e-3b7b-473a-b78c-5389992ace8b None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:53.863865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1337/2706] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:03:53 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:03:53.867372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c245c12-2534-4501-a5f3-352776927bdd admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:53.879023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c245c12-2534-4501-a5f3-352776927bdd admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:53.884084 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792f749-7686-4dc4-99dd-2b04e6688409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:53.888002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792f749-7686-4dc4-99dd-2b04e6688409 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:53.888002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792f749-7686-4dc4-99dd-2b04e6688409 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:53.888002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792f749-7686-4dc4-99dd-2b04e6688409 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:53.888002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792f749-7686-4dc4-99dd-2b04e6688409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:53.888002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792f749-7686-4dc4-99dd-2b04e6688409 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:53.896873 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21100b-2186-4d72-b7b0-d08e0e8c7248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:53.897545 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21100b-2186-4d72-b7b0-d08e0e8c7248 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:53.898015 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21100b-2186-4d72-b7b0-d08e0e8c7248 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:53.898305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21100b-2186-4d72-b7b0-d08e0e8c7248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:53.902450 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1338/2707] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 19:03:53.903221 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792f749-7686-4dc4-99dd-2b04e6688409 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:53.916807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792f749-7686-4dc4-99dd-2b04e6688409 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:53.923275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb51865-57e3-4850-b2c6-905724f51ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:53.924757 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb51865-57e3-4850-b2c6-905724f51ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:53.925053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb51865-57e3-4850-b2c6-905724f51ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:53.925866 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb51865-57e3-4850-b2c6-905724f51ad9 admin admin] PATH_INFO: `/v3/projects/90fd4e9cf07242acaa01c103b5fb858c/users/23c87dc079524a6db26f600f42d8892b/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:53.946107 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb51865-57e3-4850-b2c6-905724f51ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90fd4e9cf07242acaa01c103b5fb858c, user_id=23c87dc079524a6db26f600f42d8892b, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:53.948956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb51865-57e3-4850-b2c6-905724f51ad9 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:53.971921 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21100b-2186-4d72-b7b0-d08e0e8c7248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:53.975064 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21100b-2186-4d72-b7b0-d08e0e8c7248 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:53.998533 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1370/2708] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:03:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 19:03:54.038676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:54.045432 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1339/2709] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:03:53 2022] PUT /identity/v3/projects/90fd4e9cf07242acaa01c103b5fb858c/users/23c87dc079524a6db26f600f42d8892b/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:54.049550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21100b-2186-4d72-b7b0-d08e0e8c7248 service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:54.061856 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21100b-2186-4d72-b7b0-d08e0e8c7248 service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:54.125291 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad978d3-4864-4072-8be6-c37b534f264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:54.126150 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad978d3-4864-4072-8be6-c37b534f264b admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:54.126363 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad978d3-4864-4072-8be6-c37b534f264b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:54.126582 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad978d3-4864-4072-8be6-c37b534f264b admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:54.127318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad978d3-4864-4072-8be6-c37b534f264b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:54.129348 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad978d3-4864-4072-8be6-c37b534f264b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:54.140475 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1371/2710] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 19:03:54.144528 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb51865-57e3-4850-b2c6-905724f51ad9 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:54.154846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb51865-57e3-4850-b2c6-905724f51ad9 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:54.160122 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305da5f-3c81-4887-bb10-cb59712d436d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:54.161516 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305da5f-3c81-4887-bb10-cb59712d436d admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:54.161516 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305da5f-3c81-4887-bb10-cb59712d436d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:54.161716 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305da5f-3c81-4887-bb10-cb59712d436d admin admin] PATH_INFO: `/v3/projects/90fd4e9cf07242acaa01c103b5fb858c/users/23c87dc079524a6db26f600f42d8892b/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:54.163626 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305da5f-3c81-4887-bb10-cb59712d436d admin admin] RBAC: Authorizing `identity:create_grant(project_id=90fd4e9cf07242acaa01c103b5fb858c, user_id=23c87dc079524a6db26f600f42d8892b, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:54.166289 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305da5f-3c81-4887-bb10-cb59712d436d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:54.177174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1340/2711] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:03:54 2022] PUT /identity/v3/projects/90fd4e9cf07242acaa01c103b5fb858c/users/23c87dc079524a6db26f600f42d8892b/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:55.214313 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad978d3-4864-4072-8be6-c37b534f264b admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:55.226604 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad978d3-4864-4072-8be6-c37b534f264b admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:55.231135 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:55.295024 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06982ce8-9fc7-47d9-9de5-85999b9ef0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:55.296022 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06982ce8-9fc7-47d9-9de5-85999b9ef0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:55.296377 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06982ce8-9fc7-47d9-9de5-85999b9ef0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:55.296772 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06982ce8-9fc7-47d9-9de5-85999b9ef0ed admin admin] PATH_INFO: `/v3/users/da7c8c8c91834f949c6ad19282aa1155` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:55.298038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06982ce8-9fc7-47d9-9de5-85999b9ef0ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=da7c8c8c91834f949c6ad19282aa1155)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:55.300112 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06982ce8-9fc7-47d9-9de5-85999b9ef0ed admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:55.553165 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-06982ce8-9fc7-47d9-9de5-85999b9ef0ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da7c8c8c91834f949c6ad19282aa1155'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:55.554174 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-06982ce8-9fc7-47d9-9de5-85999b9ef0ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da7c8c8c91834f949c6ad19282aa1155'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:55.671693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-06982ce8-9fc7-47d9-9de5-85999b9ef0ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da7c8c8c91834f949c6ad19282aa1155'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:55.688787 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-06982ce8-9fc7-47d9-9de5-85999b9ef0ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da7c8c8c91834f949c6ad19282aa1155'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:55.690205 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-06982ce8-9fc7-47d9-9de5-85999b9ef0ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da7c8c8c91834f949c6ad19282aa1155'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:55.718858 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1372/2712] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:03:55 2022] DELETE /identity/v3/users/da7c8c8c91834f949c6ad19282aa1155 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:55.725298 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11be8b4-c4da-41bc-94ab-182c4ada5eb6 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:55.726392 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11be8b4-c4da-41bc-94ab-182c4ada5eb6 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:55.727676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11be8b4-c4da-41bc-94ab-182c4ada5eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:55.750719 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d11be8b4-c4da-41bc-94ab-182c4ada5eb6 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:55.752498 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d11be8b4-c4da-41bc-94ab-182c4ada5eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:55.859895 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1341/2713] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:55.861070 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06982ce8-9fc7-47d9-9de5-85999b9ef0ed admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:55.865312 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-06982ce8-9fc7-47d9-9de5-85999b9ef0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:56.006862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06982ce8-9fc7-47d9-9de5-85999b9ef0ed admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:56.011458 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3985d4-c29b-4df9-841c-ab041c4d2607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:56.012599 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3985d4-c29b-4df9-841c-ab041c4d2607 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:56.013135 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3985d4-c29b-4df9-841c-ab041c4d2607 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:56.013677 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3985d4-c29b-4df9-841c-ab041c4d2607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:56.027890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3985d4-c29b-4df9-841c-ab041c4d2607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:56.029646 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3985d4-c29b-4df9-841c-ab041c4d2607 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:56.041632 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1373/2714] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:03:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:03:56.678849 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11be8b4-c4da-41bc-94ab-182c4ada5eb6 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:56.681042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d11be8b4-c4da-41bc-94ab-182c4ada5eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:56.702254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11be8b4-c4da-41bc-94ab-182c4ada5eb6 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:56.714786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406cea6-c75c-4222-ba90-376517d9359e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:56.715718 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406cea6-c75c-4222-ba90-376517d9359e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:56.716135 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406cea6-c75c-4222-ba90-376517d9359e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:56.716399 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406cea6-c75c-4222-ba90-376517d9359e admin admin] PATH_INFO: `/v3/projects/470728f8d0ba418d80da6414d8974966` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:56.717704 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6406cea6-c75c-4222-ba90-376517d9359e admin admin] RBAC: Authorizing `identity:delete_project(project_id=470728f8d0ba418d80da6414d8974966)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:56.719646 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6406cea6-c75c-4222-ba90-376517d9359e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:56.851788 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6406cea6-c75c-4222-ba90-376517d9359e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '470728f8d0ba418d80da6414d8974966', 'request_id': 'req-6406cea6-c75c-4222-ba90-376517d9359e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:56.862136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6406cea6-c75c-4222-ba90-376517d9359e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '470728f8d0ba418d80da6414d8974966', 'request_id': 'req-6406cea6-c75c-4222-ba90-376517d9359e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:56.871592 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6406cea6-c75c-4222-ba90-376517d9359e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '470728f8d0ba418d80da6414d8974966', 'request_id': 'req-6406cea6-c75c-4222-ba90-376517d9359e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:56.982527 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6406cea6-c75c-4222-ba90-376517d9359e admin admin] The token cache is being invalidate because project 470728f8d0ba418d80da6414d8974966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:03:56.982837 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6406cea6-c75c-4222-ba90-376517d9359e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:56.984286 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6406cea6-c75c-4222-ba90-376517d9359e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:56.991124 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1342/2715] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:03:56 2022] DELETE /identity/v3/projects/470728f8d0ba418d80da6414d8974966 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:56.992574 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3985d4-c29b-4df9-841c-ab041c4d2607 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:57.016513 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3985d4-c29b-4df9-841c-ab041c4d2607 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:57.086479 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:57.133564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299bfa6-640e-4bf6-a6c8-4bd7d16c2fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:57.134511 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299bfa6-640e-4bf6-a6c8-4bd7d16c2fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:57.134806 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299bfa6-640e-4bf6-a6c8-4bd7d16c2fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:57.135069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299bfa6-640e-4bf6-a6c8-4bd7d16c2fcd admin admin] PATH_INFO: `/v3/users/25d70b9673f24a1fa3044a0bf74ef508` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:57.136300 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299bfa6-640e-4bf6-a6c8-4bd7d16c2fcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d70b9673f24a1fa3044a0bf74ef508)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:57.142038 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299bfa6-640e-4bf6-a6c8-4bd7d16c2fcd admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:57.409281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9299bfa6-640e-4bf6-a6c8-4bd7d16c2fcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d70b9673f24a1fa3044a0bf74ef508'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:57.411867 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9299bfa6-640e-4bf6-a6c8-4bd7d16c2fcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d70b9673f24a1fa3044a0bf74ef508'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:57.490648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9299bfa6-640e-4bf6-a6c8-4bd7d16c2fcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d70b9673f24a1fa3044a0bf74ef508'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:57.499272 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9299bfa6-640e-4bf6-a6c8-4bd7d16c2fcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d70b9673f24a1fa3044a0bf74ef508'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:57.500215 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-9299bfa6-640e-4bf6-a6c8-4bd7d16c2fcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d70b9673f24a1fa3044a0bf74ef508'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:57.536681 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1374/2716] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:03:56 2022] DELETE /identity/v3/users/25d70b9673f24a1fa3044a0bf74ef508 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:58.340147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406cea6-c75c-4222-ba90-376517d9359e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:58.342375 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6406cea6-c75c-4222-ba90-376517d9359e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:58.356967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406cea6-c75c-4222-ba90-376517d9359e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:58.522722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8ddb4-036f-497f-92cb-07c95bb64b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:58.525978 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8ddb4-036f-497f-92cb-07c95bb64b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:58.527696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8ddb4-036f-497f-92cb-07c95bb64b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:58.528364 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8ddb4-036f-497f-92cb-07c95bb64b06 admin admin] PATH_INFO: `/v3/projects/d5585c089c85412ab9ebbfddc358e057` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:58.536742 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8ddb4-036f-497f-92cb-07c95bb64b06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5585c089c85412ab9ebbfddc358e057)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:58.539543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8ddb4-036f-497f-92cb-07c95bb64b06 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:58.567317 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:58.714327 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2bb8ddb4-036f-497f-92cb-07c95bb64b06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5585c089c85412ab9ebbfddc358e057', 'request_id': 'req-2bb8ddb4-036f-497f-92cb-07c95bb64b06'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:58.723340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2bb8ddb4-036f-497f-92cb-07c95bb64b06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5585c089c85412ab9ebbfddc358e057', 'request_id': 'req-2bb8ddb4-036f-497f-92cb-07c95bb64b06'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:58.733305 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2bb8ddb4-036f-497f-92cb-07c95bb64b06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5585c089c85412ab9ebbfddc358e057', 'request_id': 'req-2bb8ddb4-036f-497f-92cb-07c95bb64b06'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:58.832022 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2bb8ddb4-036f-497f-92cb-07c95bb64b06 admin admin] The token cache is being invalidate because project d5585c089c85412ab9ebbfddc358e057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:03:58.832361 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2bb8ddb4-036f-497f-92cb-07c95bb64b06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:58.833009 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-2bb8ddb4-036f-497f-92cb-07c95bb64b06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:03:58.834677 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1343/2717] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:03:58 2022] DELETE /identity/v3/projects/d5585c089c85412ab9ebbfddc358e057 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:58.842176 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6313e-3a2e-41b2-84e9-1b49a9ed04f1 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:58.842722 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6313e-3a2e-41b2-84e9-1b49a9ed04f1 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:58.842722 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6313e-3a2e-41b2-84e9-1b49a9ed04f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:58.883999 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-0fe6313e-3a2e-41b2-84e9-1b49a9ed04f1 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:58.885715 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-0fe6313e-3a2e-41b2-84e9-1b49a9ed04f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:58.982014 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1375/2718] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:58.990070 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a5cb3-0167-418a-9dd2-9a0f60f43ceb None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:58.990454 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a5cb3-0167-418a-9dd2-9a0f60f43ceb None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:58.990816 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a5cb3-0167-418a-9dd2-9a0f60f43ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:59.019222 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-566a5cb3-0167-418a-9dd2-9a0f60f43ceb None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:59.021119 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-566a5cb3-0167-418a-9dd2-9a0f60f43ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:03:59.030371 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1344/2719] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:03:59.035470 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6313e-3a2e-41b2-84e9-1b49a9ed04f1 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:59.045942 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6313e-3a2e-41b2-84e9-1b49a9ed04f1 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:59.051327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeda66-0a4c-4b0e-8112-4fba47bf568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:59.052292 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeda66-0a4c-4b0e-8112-4fba47bf568b admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:59.052848 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeda66-0a4c-4b0e-8112-4fba47bf568b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:59.053292 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeda66-0a4c-4b0e-8112-4fba47bf568b admin admin] PATH_INFO: `/v3/domains` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:59.054334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaeda66-0a4c-4b0e-8112-4fba47bf568b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86943) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:03:59.054820 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaeda66-0a4c-4b0e-8112-4fba47bf568b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:59.056842 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaeda66-0a4c-4b0e-8112-4fba47bf568b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:59.079777 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a5cb3-0167-418a-9dd2-9a0f60f43ceb None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:59.086945 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1376/2720] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 19:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 19:03:59.092547 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a5cb3-0167-418a-9dd2-9a0f60f43ceb None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:59.099287 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5df177-a826-4362-bf5a-161670d10128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:59.101320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5df177-a826-4362-bf5a-161670d10128 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:59.101827 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5df177-a826-4362-bf5a-161670d10128 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:59.102288 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5df177-a826-4362-bf5a-161670d10128 admin admin] PATH_INFO: `/v3/projects` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:59.105024 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5df177-a826-4362-bf5a-161670d10128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:59.110957 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5df177-a826-4362-bf5a-161670d10128 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:59.401553 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeda66-0a4c-4b0e-8112-4fba47bf568b admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:59.411878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1345/2721] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:03:59 2022] POST /identity/v3/projects => generated 389 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:03:59.420822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeda66-0a4c-4b0e-8112-4fba47bf568b admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:59.506745 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a2501-b22e-4acd-9dab-3929199d68b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:59.507596 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a2501-b22e-4acd-9dab-3929199d68b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:59.507956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a2501-b22e-4acd-9dab-3929199d68b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:59.508305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a2501-b22e-4acd-9dab-3929199d68b6 admin admin] PATH_INFO: `/v3/users` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:59.509128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a2501-b22e-4acd-9dab-3929199d68b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:59.511128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a2501-b22e-4acd-9dab-3929199d68b6 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:59.635782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1377/2722] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:03:59 2022] POST /identity/v3/users => generated 295 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:03:59.639823 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5df177-a826-4362-bf5a-161670d10128 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:59.653865 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5df177-a826-4362-bf5a-161670d10128 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:59.662817 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40663d3e-93a9-4af2-8194-17dfa94d13f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:59.663825 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40663d3e-93a9-4af2-8194-17dfa94d13f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:59.664467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40663d3e-93a9-4af2-8194-17dfa94d13f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:59.665308 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40663d3e-93a9-4af2-8194-17dfa94d13f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:59.666326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40663d3e-93a9-4af2-8194-17dfa94d13f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:59.668724 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40663d3e-93a9-4af2-8194-17dfa94d13f0 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:59.684521 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1346/2723] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:03:59.688219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a2501-b22e-4acd-9dab-3929199d68b6 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:59.699527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a2501-b22e-4acd-9dab-3929199d68b6 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:59.705236 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9d63b-1c59-4cf4-8e63-80cc629d0081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:59.710748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9d63b-1c59-4cf4-8e63-80cc629d0081 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:59.710748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9d63b-1c59-4cf4-8e63-80cc629d0081 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:59.710748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9d63b-1c59-4cf4-8e63-80cc629d0081 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:59.710748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9d63b-1c59-4cf4-8e63-80cc629d0081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:59.710748 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9d63b-1c59-4cf4-8e63-80cc629d0081 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:59.723414 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1378/2724] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:03:59.728385 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40663d3e-93a9-4af2-8194-17dfa94d13f0 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:03:59.739613 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40663d3e-93a9-4af2-8194-17dfa94d13f0 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:03:59.746070 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51324b46-87cd-4b82-ae53-58a7526ad28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:03:59.750564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51324b46-87cd-4b82-ae53-58a7526ad28d admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:59.750564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51324b46-87cd-4b82-ae53-58a7526ad28d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:59.750564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51324b46-87cd-4b82-ae53-58a7526ad28d admin admin] PATH_INFO: `/v3/projects/c8d2ed1fb0b54a92b0de648a903e661a/users/571de020036c4aa895b77da9b0beefe8/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:59.770540 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51324b46-87cd-4b82-ae53-58a7526ad28d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d2ed1fb0b54a92b0de648a903e661a, user_id=571de020036c4aa895b77da9b0beefe8, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:03:59.773602 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51324b46-87cd-4b82-ae53-58a7526ad28d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:03:59.897208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1347/2725] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:03:59 2022] PUT /identity/v3/projects/c8d2ed1fb0b54a92b0de648a903e661a/users/571de020036c4aa895b77da9b0beefe8/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:03:59.908766 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc0094-49d6-444f-8e06-75cdea66ced1 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:03:59.909885 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc0094-49d6-444f-8e06-75cdea66ced1 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:03:59.909885 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc0094-49d6-444f-8e06-75cdea66ced1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:03:59.939728 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-10fc0094-49d6-444f-8e06-75cdea66ced1 None None] MFA Rules not processed for user `571de020036c4aa895b77da9b0beefe8`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:03:59.941253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-10fc0094-49d6-444f-8e06-75cdea66ced1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:00.009891 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1379/2726] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:03:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:04:00.021427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51324b46-87cd-4b82-ae53-58a7526ad28d admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:04:00.023141 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-51324b46-87cd-4b82-ae53-58a7526ad28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:00.069443 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:00.092823 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51324b46-87cd-4b82-ae53-58a7526ad28d admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:04:00.100599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3ae67-5c38-4f00-9717-af9e7409952b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:04:00.100599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3ae67-5c38-4f00-9717-af9e7409952b service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:00.100599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3ae67-5c38-4f00-9717-af9e7409952b service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:00.100599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3ae67-5c38-4f00-9717-af9e7409952b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:00.110206 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3ae67-5c38-4f00-9717-af9e7409952b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:04:00.112128 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3ae67-5c38-4f00-9717-af9e7409952b service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:04:00.123331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1348/2727] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:04:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:04:01.121780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02866cb2-1ee9-4077-afe2-d64e9e363510 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:01.122636 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02866cb2-1ee9-4077-afe2-d64e9e363510 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:01.123337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02866cb2-1ee9-4077-afe2-d64e9e363510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:01.153067 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-02866cb2-1ee9-4077-afe2-d64e9e363510 None None] MFA Rules not processed for user `23c87dc079524a6db26f600f42d8892b`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:04:01.154773 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-02866cb2-1ee9-4077-afe2-d64e9e363510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:01.227757 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1380/2728] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:04:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:04:01.241665 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3ae67-5c38-4f00-9717-af9e7409952b service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:04:01.243126 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-eec3ae67-5c38-4f00-9717-af9e7409952b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:01.299383 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:01.332652 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3ae67-5c38-4f00-9717-af9e7409952b service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:04:01.338928 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1365b-c5cd-4247-8802-80eaecf0f7a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:04:01.339430 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1365b-c5cd-4247-8802-80eaecf0f7a1 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:01.339810 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1365b-c5cd-4247-8802-80eaecf0f7a1 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:01.340087 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1365b-c5cd-4247-8802-80eaecf0f7a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:01.341925 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-dcb1365b-c5cd-4247-8802-80eaecf0f7a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:01.404682 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1365b-c5cd-4247-8802-80eaecf0f7a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:04:01.406624 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1365b-c5cd-4247-8802-80eaecf0f7a1 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:04:01.417787 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1349/2729] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:04:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:04:04.429652 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823785f-fc6d-445a-9a64-c04523c6016a None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:04.430223 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823785f-fc6d-445a-9a64-c04523c6016a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:04.430223 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823785f-fc6d-445a-9a64-c04523c6016a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:04.449098 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-1823785f-fc6d-445a-9a64-c04523c6016a None None] MFA Rules not processed for user `bb055af2fca84739a7b5d3b373ab7298`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:04:04.458310 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-1823785f-fc6d-445a-9a64-c04523c6016a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:04.458800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1381/2730] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:04:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:04:12.020832 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1365b-c5cd-4247-8802-80eaecf0f7a1 service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:04:12.086672 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1365b-c5cd-4247-8802-80eaecf0f7a1 service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:04:12.091312 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9d404-e6c3-48ac-b1b0-582a85ee09a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:04:12.092248 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9d404-e6c3-48ac-b1b0-582a85ee09a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:12.092573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9d404-e6c3-48ac-b1b0-582a85ee09a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:12.092858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9d404-e6c3-48ac-b1b0-582a85ee09a8 admin admin] PATH_INFO: `/v3/users/571de020036c4aa895b77da9b0beefe8` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:12.094106 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9d404-e6c3-48ac-b1b0-582a85ee09a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=571de020036c4aa895b77da9b0beefe8)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:04:12.096061 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9d404-e6c3-48ac-b1b0-582a85ee09a8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:04:12.266723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6ea9d404-e6c3-48ac-b1b0-582a85ee09a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571de020036c4aa895b77da9b0beefe8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:12.267786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6ea9d404-e6c3-48ac-b1b0-582a85ee09a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571de020036c4aa895b77da9b0beefe8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:12.338550 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6ea9d404-e6c3-48ac-b1b0-582a85ee09a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571de020036c4aa895b77da9b0beefe8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:12.346077 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6ea9d404-e6c3-48ac-b1b0-582a85ee09a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571de020036c4aa895b77da9b0beefe8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:12.356275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:12.358593 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6ea9d404-e6c3-48ac-b1b0-582a85ee09a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571de020036c4aa895b77da9b0beefe8'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:12.365639 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1350/2731] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:04:12 2022] DELETE /identity/v3/users/571de020036c4aa895b77da9b0beefe8 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:04:12.370137 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a2d17-26be-4bd5-bbcf-0ee84435604a None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:12.370712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a2d17-26be-4bd5-bbcf-0ee84435604a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:12.370926 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a2d17-26be-4bd5-bbcf-0ee84435604a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:12.389583 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-7a9a2d17-26be-4bd5-bbcf-0ee84435604a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:04:12.390785 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-7a9a2d17-26be-4bd5-bbcf-0ee84435604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:12.408716 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:12.451882 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1382/2732] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:04:12.461539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9d404-e6c3-48ac-b1b0-582a85ee09a8 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:04:12.463043 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-6ea9d404-e6c3-48ac-b1b0-582a85ee09a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:12.523626 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9d404-e6c3-48ac-b1b0-582a85ee09a8 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:04:12.527181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aec757-ed3a-4acd-a664-83b44b61880e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:04:12.527830 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aec757-ed3a-4acd-a664-83b44b61880e service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:12.528116 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aec757-ed3a-4acd-a664-83b44b61880e service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:12.528395 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aec757-ed3a-4acd-a664-83b44b61880e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:12.538725 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aec757-ed3a-4acd-a664-83b44b61880e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:04:12.540193 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aec757-ed3a-4acd-a664-83b44b61880e service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:04:12.550874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1351/2733] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:04:12.972164 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a2d17-26be-4bd5-bbcf-0ee84435604a None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:04:12.973706 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-7a9a2d17-26be-4bd5-bbcf-0ee84435604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:12.989799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a2d17-26be-4bd5-bbcf-0ee84435604a None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:04:12.994705 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c255de-b8c7-4910-9a08-e6e3f8ac04f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:04:12.995578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c255de-b8c7-4910-9a08-e6e3f8ac04f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:12.995869 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c255de-b8c7-4910-9a08-e6e3f8ac04f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:12.996151 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c255de-b8c7-4910-9a08-e6e3f8ac04f8 admin admin] PATH_INFO: `/v3/projects/c8d2ed1fb0b54a92b0de648a903e661a` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:12.997640 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c255de-b8c7-4910-9a08-e6e3f8ac04f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d2ed1fb0b54a92b0de648a903e661a)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:04:12.999569 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c255de-b8c7-4910-9a08-e6e3f8ac04f8 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:04:13.100394 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-d2c255de-b8c7-4910-9a08-e6e3f8ac04f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d2ed1fb0b54a92b0de648a903e661a', 'request_id': 'req-d2c255de-b8c7-4910-9a08-e6e3f8ac04f8'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:13.159009 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-d2c255de-b8c7-4910-9a08-e6e3f8ac04f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d2ed1fb0b54a92b0de648a903e661a', 'request_id': 'req-d2c255de-b8c7-4910-9a08-e6e3f8ac04f8'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:13.166062 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-d2c255de-b8c7-4910-9a08-e6e3f8ac04f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d2ed1fb0b54a92b0de648a903e661a', 'request_id': 'req-d2c255de-b8c7-4910-9a08-e6e3f8ac04f8'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:13.176783 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-d2c255de-b8c7-4910-9a08-e6e3f8ac04f8 admin admin] The token cache is being invalidate because project c8d2ed1fb0b54a92b0de648a903e661a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:04:13.177077 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-d2c255de-b8c7-4910-9a08-e6e3f8ac04f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:13.177723 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-d2c255de-b8c7-4910-9a08-e6e3f8ac04f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:13.179351 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1383/2734] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:04:12 2022] DELETE /identity/v3/projects/c8d2ed1fb0b54a92b0de648a903e661a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:04:13.184572 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4336e-d4a9-4941-9d8b-8b88b38ec45c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:13.185064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4336e-d4a9-4941-9d8b-8b88b38ec45c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:13.185188 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4336e-d4a9-4941-9d8b-8b88b38ec45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:13.204105 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-03a4336e-d4a9-4941-9d8b-8b88b38ec45c None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:04:13.205980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-03a4336e-d4a9-4941-9d8b-8b88b38ec45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:13.266632 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1352/2735] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:04:13.275042 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1054c3c-9e20-480c-9e2d-03a233206177 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:13.275333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1054c3c-9e20-480c-9e2d-03a233206177 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:13.275614 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1054c3c-9e20-480c-9e2d-03a233206177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:13.295283 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-f1054c3c-9e20-480c-9e2d-03a233206177 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:04:13.296520 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f1054c3c-9e20-480c-9e2d-03a233206177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:13.304266 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1384/2736] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:04:13.308588 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4336e-d4a9-4941-9d8b-8b88b38ec45c None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:04:13.318919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4336e-d4a9-4941-9d8b-8b88b38ec45c None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:04:13.323624 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64c409-02ac-4686-9b8c-892e6d8d0877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:04:13.324306 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64c409-02ac-4686-9b8c-892e6d8d0877 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:13.324635 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64c409-02ac-4686-9b8c-892e6d8d0877 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:13.324924 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64c409-02ac-4686-9b8c-892e6d8d0877 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:13.325667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64c409-02ac-4686-9b8c-892e6d8d0877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:04:13.325980 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64c409-02ac-4686-9b8c-892e6d8d0877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:04:13.327594 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64c409-02ac-4686-9b8c-892e6d8d0877 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:04:13.340410 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1353/2737] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 19:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 19:04:13.344689 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1054c3c-9e20-480c-9e2d-03a233206177 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:04:13.354326 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1054c3c-9e20-480c-9e2d-03a233206177 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:04:13.359055 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2254e-1cb4-4100-a501-931eca23abbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:04:13.359722 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2254e-1cb4-4100-a501-931eca23abbe admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:13.360003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2254e-1cb4-4100-a501-931eca23abbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:13.360280 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2254e-1cb4-4100-a501-931eca23abbe admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:13.361027 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2254e-1cb4-4100-a501-931eca23abbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:04:13.363679 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2254e-1cb4-4100-a501-931eca23abbe admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:04:13.454294 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1385/2738] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:04:13 2022] POST /identity/v3/projects => generated 399 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:04:13.464251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64c409-02ac-4686-9b8c-892e6d8d0877 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:04:13.475159 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64c409-02ac-4686-9b8c-892e6d8d0877 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:04:13.533879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fe80e-5397-42a8-b6b6-b896b9f92e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:04:13.534584 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fe80e-5397-42a8-b6b6-b896b9f92e93 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:13.534871 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fe80e-5397-42a8-b6b6-b896b9f92e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:13.535151 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fe80e-5397-42a8-b6b6-b896b9f92e93 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:13.536007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fe80e-5397-42a8-b6b6-b896b9f92e93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:04:13.538022 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fe80e-5397-42a8-b6b6-b896b9f92e93 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:04:13.636250 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1354/2739] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:04:13 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:04:13.640278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2254e-1cb4-4100-a501-931eca23abbe admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:04:13.650543 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2254e-1cb4-4100-a501-931eca23abbe admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:04:13.655252 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12dbba-f4a4-4e1f-9dfb-2b914b743518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:04:13.656128 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12dbba-f4a4-4e1f-9dfb-2b914b743518 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:13.656423 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12dbba-f4a4-4e1f-9dfb-2b914b743518 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:13.656864 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12dbba-f4a4-4e1f-9dfb-2b914b743518 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:13.657727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12dbba-f4a4-4e1f-9dfb-2b914b743518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:04:13.660364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12dbba-f4a4-4e1f-9dfb-2b914b743518 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:04:13.671633 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1386/2740] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:04:13.676251 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fe80e-5397-42a8-b6b6-b896b9f92e93 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:04:13.686278 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fe80e-5397-42a8-b6b6-b896b9f92e93 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:04:13.690931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e1711-7a6b-4720-a24b-50d0c8180068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:04:13.691592 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e1711-7a6b-4720-a24b-50d0c8180068 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:13.691882 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e1711-7a6b-4720-a24b-50d0c8180068 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:13.692163 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e1711-7a6b-4720-a24b-50d0c8180068 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:13.692944 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e1711-7a6b-4720-a24b-50d0c8180068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:04:13.694540 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e1711-7a6b-4720-a24b-50d0c8180068 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:04:13.704320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1355/2741] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:04:13.708238 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12dbba-f4a4-4e1f-9dfb-2b914b743518 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:04:13.718068 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12dbba-f4a4-4e1f-9dfb-2b914b743518 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:04:13.723362 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f4bc2-7e4a-4533-abf2-ea502b31134b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:04:13.724279 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f4bc2-7e4a-4533-abf2-ea502b31134b admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:13.724602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f4bc2-7e4a-4533-abf2-ea502b31134b admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:13.724885 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f4bc2-7e4a-4533-abf2-ea502b31134b admin admin] PATH_INFO: `/v3/projects/53108d643dc647dd859ecfdf44590ec1/users/abf4b7ce5c664aef80ec41bc14902959/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:13.741077 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f4bc2-7e4a-4533-abf2-ea502b31134b admin admin] RBAC: Authorizing `identity:create_grant(project_id=53108d643dc647dd859ecfdf44590ec1, user_id=abf4b7ce5c664aef80ec41bc14902959, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:04:13.743731 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f4bc2-7e4a-4533-abf2-ea502b31134b admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:04:13.827017 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1387/2742] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:04:13 2022] PUT /identity/v3/projects/53108d643dc647dd859ecfdf44590ec1/users/abf4b7ce5c664aef80ec41bc14902959/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 19:04:13.839138 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472465b-0dc1-4ffd-b98e-61668274538a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:13.839435 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472465b-0dc1-4ffd-b98e-61668274538a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:13.839723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472465b-0dc1-4ffd-b98e-61668274538a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:13.845960 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:13.869067 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-b472465b-0dc1-4ffd-b98e-61668274538a None None] MFA Rules not processed for user `abf4b7ce5c664aef80ec41bc14902959`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:04:13.870305 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b472465b-0dc1-4ffd-b98e-61668274538a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:13.937414 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1356/2743] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:04:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:04:13.949622 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f4bc2-7e4a-4533-abf2-ea502b31134b admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:04:13.951302 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-544f4bc2-7e4a-4533-abf2-ea502b31134b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:13.998333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:14.010376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f4bc2-7e4a-4533-abf2-ea502b31134b admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:04:14.014286 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83017c8d-ccd1-4d12-9990-c46ec40dfe86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:04:14.014959 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83017c8d-ccd1-4d12-9990-c46ec40dfe86 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:14.015244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83017c8d-ccd1-4d12-9990-c46ec40dfe86 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:14.015554 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83017c8d-ccd1-4d12-9990-c46ec40dfe86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:14.024968 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83017c8d-ccd1-4d12-9990-c46ec40dfe86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:04:14.026527 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83017c8d-ccd1-4d12-9990-c46ec40dfe86 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:04:14.036136 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1388/2744] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:04:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:04:20.537766 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472465b-0dc1-4ffd-b98e-61668274538a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:04:20.599108 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472465b-0dc1-4ffd-b98e-61668274538a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:04:20.603620 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b32dbd-4a37-43f9-b0b5-937766a30b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:04:20.604506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b32dbd-4a37-43f9-b0b5-937766a30b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:20.604791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b32dbd-4a37-43f9-b0b5-937766a30b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:20.605066 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b32dbd-4a37-43f9-b0b5-937766a30b50 admin admin] PATH_INFO: `/v3/users/abf4b7ce5c664aef80ec41bc14902959` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:20.606264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b32dbd-4a37-43f9-b0b5-937766a30b50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf4b7ce5c664aef80ec41bc14902959)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:04:20.608218 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b32dbd-4a37-43f9-b0b5-937766a30b50 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:04:20.828878 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-97b32dbd-4a37-43f9-b0b5-937766a30b50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf4b7ce5c664aef80ec41bc14902959'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:20.829541 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-97b32dbd-4a37-43f9-b0b5-937766a30b50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf4b7ce5c664aef80ec41bc14902959'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:20.883250 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-97b32dbd-4a37-43f9-b0b5-937766a30b50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf4b7ce5c664aef80ec41bc14902959'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:20.890528 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-97b32dbd-4a37-43f9-b0b5-937766a30b50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf4b7ce5c664aef80ec41bc14902959'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:20.902621 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-97b32dbd-4a37-43f9-b0b5-937766a30b50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf4b7ce5c664aef80ec41bc14902959'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:20.908702 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1357/2745] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:04:20 2022] DELETE /identity/v3/users/abf4b7ce5c664aef80ec41bc14902959 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:04:20.913448 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f046fb9-221b-4efa-8fc2-188a280f030a None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:20.914004 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f046fb9-221b-4efa-8fc2-188a280f030a None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:20.914004 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f046fb9-221b-4efa-8fc2-188a280f030a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:20.931868 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-4f046fb9-221b-4efa-8fc2-188a280f030a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:04:20.934785 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-4f046fb9-221b-4efa-8fc2-188a280f030a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:21.009660 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1389/2746] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:04:21.019570 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b32dbd-4a37-43f9-b0b5-937766a30b50 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:04:21.020938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-97b32dbd-4a37-43f9-b0b5-937766a30b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:21.035027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:21.078960 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b32dbd-4a37-43f9-b0b5-937766a30b50 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:04:21.082944 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13bf66-584f-48ea-be9e-89bcd46cbf01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:04:21.083589 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13bf66-584f-48ea-be9e-89bcd46cbf01 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:21.083875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13bf66-584f-48ea-be9e-89bcd46cbf01 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:21.084162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13bf66-584f-48ea-be9e-89bcd46cbf01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:21.093881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13bf66-584f-48ea-be9e-89bcd46cbf01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:04:21.095825 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13bf66-584f-48ea-be9e-89bcd46cbf01 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:04:21.105239 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1358/2747] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 19:04:21.632027 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f046fb9-221b-4efa-8fc2-188a280f030a None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:04:21.636424 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-4f046fb9-221b-4efa-8fc2-188a280f030a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:21.647420 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f046fb9-221b-4efa-8fc2-188a280f030a None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:04:21.654889 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab0e48-c82f-4591-8016-7e0c1ff3b6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:04:21.655809 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab0e48-c82f-4591-8016-7e0c1ff3b6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:21.656071 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab0e48-c82f-4591-8016-7e0c1ff3b6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:21.656349 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab0e48-c82f-4591-8016-7e0c1ff3b6aa admin admin] PATH_INFO: `/v3/projects/53108d643dc647dd859ecfdf44590ec1` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:21.660617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab0e48-c82f-4591-8016-7e0c1ff3b6aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=53108d643dc647dd859ecfdf44590ec1)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:04:21.660617 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab0e48-c82f-4591-8016-7e0c1ff3b6aa admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:04:21.817437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7bab0e48-c82f-4591-8016-7e0c1ff3b6aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53108d643dc647dd859ecfdf44590ec1', 'request_id': 'req-7bab0e48-c82f-4591-8016-7e0c1ff3b6aa'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:21.883111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7bab0e48-c82f-4591-8016-7e0c1ff3b6aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53108d643dc647dd859ecfdf44590ec1', 'request_id': 'req-7bab0e48-c82f-4591-8016-7e0c1ff3b6aa'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:21.889744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7bab0e48-c82f-4591-8016-7e0c1ff3b6aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53108d643dc647dd859ecfdf44590ec1', 'request_id': 'req-7bab0e48-c82f-4591-8016-7e0c1ff3b6aa'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:21.900492 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7bab0e48-c82f-4591-8016-7e0c1ff3b6aa admin admin] The token cache is being invalidate because project 53108d643dc647dd859ecfdf44590ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:04:21.900788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7bab0e48-c82f-4591-8016-7e0c1ff3b6aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:21.901421 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-7bab0e48-c82f-4591-8016-7e0c1ff3b6aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:04:21.902971 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1390/2748] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:04:21 2022] DELETE /identity/v3/projects/53108d643dc647dd859ecfdf44590ec1 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:04:31.038735 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13bf66-584f-48ea-be9e-89bcd46cbf01 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:04:31.040356 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-8b13bf66-584f-48ea-be9e-89bcd46cbf01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:31.053232 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13bf66-584f-48ea-be9e-89bcd46cbf01 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:04:31.105254 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bab497-b645-4775-8f2d-f050f3e7eaee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:04:31.105904 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab497-b645-4775-8f2d-f050f3e7eaee service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:31.106189 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab497-b645-4775-8f2d-f050f3e7eaee service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:31.106467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab497-b645-4775-8f2d-f050f3e7eaee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:31.108265 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-54bab497-b645-4775-8f2d-f050f3e7eaee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:31.169521 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bab497-b645-4775-8f2d-f050f3e7eaee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:04:31.170954 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bab497-b645-4775-8f2d-f050f3e7eaee service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:04:31.181206 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1359/2749] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:04:31 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:04:31.897411 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=61,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:41.176667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=71 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:50.710281 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd41ab8-d684-49b3-9f7f-8c6488e76a81 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:50.710893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd41ab8-d684-49b3-9f7f-8c6488e76a81 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:50.710893 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd41ab8-d684-49b3-9f7f-8c6488e76a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:50.728602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-fbd41ab8-d684-49b3-9f7f-8c6488e76a81 None None] MFA Rules not processed for user `5a6dd8542964410a93e944ed1c0b3743`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:04:50.731434 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-fbd41ab8-d684-49b3-9f7f-8c6488e76a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:50.784039 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1391/2750] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:04:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:05:00.277416 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bab497-b645-4775-8f2d-f050f3e7eaee service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:05:00.279202 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-54bab497-b645-4775-8f2d-f050f3e7eaee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:05:00.347048 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bab497-b645-4775-8f2d-f050f3e7eaee service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:05:00.352405 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77a6ec-5c61-4bb4-ad72-1a84549e4771 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3abe1d47a1164776bf3a82fe4b129d9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:05:00.353094 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77a6ec-5c61-4bb4-ad72-1a84549e4771 service placement] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:05:00.353415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77a6ec-5c61-4bb4-ad72-1a84549e4771 service placement] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:05:00.353782 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77a6ec-5c61-4bb4-ad72-1a84549e4771 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:05:00.355579 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fe77a6ec-5c61-4bb4-ad72-1a84549e4771 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:05:00.368452 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77a6ec-5c61-4bb4-ad72-1a84549e4771 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:05:00.370084 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77a6ec-5c61-4bb4-ad72-1a84549e4771 service placement] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:05:00.381374 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1360/2751] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:05:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:05:00.777206 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=25 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:10.376355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=32 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:52.514965 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c90f2-4eaf-4acb-bbf0-56811913a3fb None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:05:52.515567 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c90f2-4eaf-4acb-bbf0-56811913a3fb None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:05:52.515567 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c90f2-4eaf-4acb-bbf0-56811913a3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:05:52.534133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-711c90f2-4eaf-4acb-bbf0-56811913a3fb None None] MFA Rules not processed for user `5a6dd8542964410a93e944ed1c0b3743`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:05:52.535334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-711c90f2-4eaf-4acb-bbf0-56811913a3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:05:52.543175 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1392/2752] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:05:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:06:02.528342 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:45.707237 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742defc-95ab-44c9-872b-85477653c631 None None] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:06:45.707237 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742defc-95ab-44c9-872b-85477653c631 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:06:45.707237 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742defc-95ab-44c9-872b-85477653c631 None None] PATH_INFO: `/` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:06:45.707237 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1361/2753] 10.222.0.93 () {54 vars in 921 bytes} [Thu Jun 16 19:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 19:06:45.708350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84450a0e-76ab-489a-a8a5-4ca7fd7438c6 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:06:45.708350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84450a0e-76ab-489a-a8a5-4ca7fd7438c6 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:06:45.708350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84450a0e-76ab-489a-a8a5-4ca7fd7438c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:06:45.720188 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-84450a0e-76ab-489a-a8a5-4ca7fd7438c6 None None] MFA Rules not processed for user `753728a82bdb406892015f8373932ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:06:45.721529 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-84450a0e-76ab-489a-a8a5-4ca7fd7438c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:06:45.728385 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1393/2754] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Jun 16 19:06:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:06:45.741905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742defc-95ab-44c9-872b-85477653c631 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:06:45.743858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-2742defc-95ab-44c9-872b-85477653c631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:06:45.757900 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742defc-95ab-44c9-872b-85477653c631 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:06:45.761553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15858da1-a40c-40de-831b-a6c6c723488e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:06:45.762206 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15858da1-a40c-40de-831b-a6c6c723488e service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:06:45.824001 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15858da1-a40c-40de-831b-a6c6c723488e service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:06:45.824001 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15858da1-a40c-40de-831b-a6c6c723488e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:06:45.824001 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15858da1-a40c-40de-831b-a6c6c723488e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:06:45.824001 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15858da1-a40c-40de-831b-a6c6c723488e service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:06:45.824001 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1362/2755] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:06:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:06:45.869369 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a8d66-4ef1-4a93-8324-cd7fee5fd192 None None] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:06:45.869931 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a8d66-4ef1-4a93-8324-cd7fee5fd192 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:06:45.870325 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a8d66-4ef1-4a93-8324-cd7fee5fd192 None None] PATH_INFO: `/` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:06:45.871796 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1394/2756] 10.222.0.93 () {54 vars in 921 bytes} [Thu Jun 16 19:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 19:06:45.877898 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7594e18-2647-4314-abbf-b464019af70a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:06:45.878196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7594e18-2647-4314-abbf-b464019af70a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:06:45.878485 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7594e18-2647-4314-abbf-b464019af70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:06:45.897445 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c7594e18-2647-4314-abbf-b464019af70a None None] MFA Rules not processed for user `3503ec98bea14693a17a84e686586bad`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:06:45.898729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c7594e18-2647-4314-abbf-b464019af70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:06:45.972132 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1363/2757] 10.222.0.93 () {58 vars in 1018 bytes} [Thu Jun 16 19:06:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:06:45.983883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a8d66-4ef1-4a93-8324-cd7fee5fd192 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:06:45.999825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a8d66-4ef1-4a93-8324-cd7fee5fd192 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:06:46.003473 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbc1ee-e9f4-4e52-8350-9023c424aa04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:06:46.004121 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbc1ee-e9f4-4e52-8350-9023c424aa04 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:06:46.004605 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbc1ee-e9f4-4e52-8350-9023c424aa04 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:06:46.004876 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbc1ee-e9f4-4e52-8350-9023c424aa04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:06:46.016320 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbc1ee-e9f4-4e52-8350-9023c424aa04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:06:46.018787 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbc1ee-e9f4-4e52-8350-9023c424aa04 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:06:46.030342 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1395/2758] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:06:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:06:51.531064 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7594e18-2647-4314-abbf-b464019af70a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:06:51.532651 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c7594e18-2647-4314-abbf-b464019af70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:06:51.544515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7594e18-2647-4314-abbf-b464019af70a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:06:51.548357 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47b9b2-2211-4b89-9d34-d70ae27cc97b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:06:51.549206 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47b9b2-2211-4b89-9d34-d70ae27cc97b service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:06:51.549647 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47b9b2-2211-4b89-9d34-d70ae27cc97b service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:06:51.549939 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47b9b2-2211-4b89-9d34-d70ae27cc97b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:06:51.551922 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4e47b9b2-2211-4b89-9d34-d70ae27cc97b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:06:51.567249 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47b9b2-2211-4b89-9d34-d70ae27cc97b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:06:51.568749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47b9b2-2211-4b89-9d34-d70ae27cc97b service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:06:51.581983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1364/2759] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:06:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:06:52.928069 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbc1ee-e9f4-4e52-8350-9023c424aa04 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:06:52.937317 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbc1ee-e9f4-4e52-8350-9023c424aa04 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:06:52.941162 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346df9b-1cc7-485a-8d60-4d54be7ea73b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:06:52.941813 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346df9b-1cc7-485a-8d60-4d54be7ea73b service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:06:52.942134 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346df9b-1cc7-485a-8d60-4d54be7ea73b service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:06:52.942369 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346df9b-1cc7-485a-8d60-4d54be7ea73b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:06:52.944284 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-a346df9b-1cc7-485a-8d60-4d54be7ea73b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:06:52.958963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346df9b-1cc7-485a-8d60-4d54be7ea73b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:06:52.960408 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346df9b-1cc7-485a-8d60-4d54be7ea73b service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:06:52.971963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1396/2760] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:06:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:06:59.779369 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47b9b2-2211-4b89-9d34-d70ae27cc97b service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:06:59.780944 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-4e47b9b2-2211-4b89-9d34-d70ae27cc97b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:06:59.848795 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47b9b2-2211-4b89-9d34-d70ae27cc97b service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:06:59.853439 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7e562-f6bf-4028-85b2-8de6f01a08dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:06:59.854321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7e562-f6bf-4028-85b2-8de6f01a08dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:06:59.854606 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7e562-f6bf-4028-85b2-8de6f01a08dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:06:59.854885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7e562-f6bf-4028-85b2-8de6f01a08dc admin admin] PATH_INFO: `/v3/users/5a6dd8542964410a93e944ed1c0b3743` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:06:59.856117 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7e562-f6bf-4028-85b2-8de6f01a08dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a6dd8542964410a93e944ed1c0b3743)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:06:59.858685 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7e562-f6bf-4028-85b2-8de6f01a08dc admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:00.047731 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-88b7e562-f6bf-4028-85b2-8de6f01a08dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a6dd8542964410a93e944ed1c0b3743'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:00.048351 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-88b7e562-f6bf-4028-85b2-8de6f01a08dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a6dd8542964410a93e944ed1c0b3743'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:00.123665 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-88b7e562-f6bf-4028-85b2-8de6f01a08dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a6dd8542964410a93e944ed1c0b3743'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:00.133033 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-88b7e562-f6bf-4028-85b2-8de6f01a08dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a6dd8542964410a93e944ed1c0b3743'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:00.138433 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:00.147264 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-88b7e562-f6bf-4028-85b2-8de6f01a08dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a6dd8542964410a93e944ed1c0b3743'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:00.154747 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1365/2761] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:06:59 2022] DELETE /identity/v3/users/5a6dd8542964410a93e944ed1c0b3743 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:00.436932 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346df9b-1cc7-485a-8d60-4d54be7ea73b service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:00.448606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346df9b-1cc7-485a-8d60-4d54be7ea73b service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:00.522064 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7c849-b245-48ef-8a74-5ba9696927a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:00.522951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7c849-b245-48ef-8a74-5ba9696927a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:00.523231 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7c849-b245-48ef-8a74-5ba9696927a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:00.523504 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7c849-b245-48ef-8a74-5ba9696927a0 admin admin] PATH_INFO: `/v3/projects/e1d838ea03144ce78c1d3016b6386484` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:00.524767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7c849-b245-48ef-8a74-5ba9696927a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1d838ea03144ce78c1d3016b6386484)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:00.526800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7c849-b245-48ef-8a74-5ba9696927a0 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:00.643727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-1de7c849-b245-48ef-8a74-5ba9696927a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1d838ea03144ce78c1d3016b6386484', 'request_id': 'req-1de7c849-b245-48ef-8a74-5ba9696927a0'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:00.703574 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-1de7c849-b245-48ef-8a74-5ba9696927a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1d838ea03144ce78c1d3016b6386484', 'request_id': 'req-1de7c849-b245-48ef-8a74-5ba9696927a0'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:00.710531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-1de7c849-b245-48ef-8a74-5ba9696927a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1d838ea03144ce78c1d3016b6386484', 'request_id': 'req-1de7c849-b245-48ef-8a74-5ba9696927a0'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:00.721192 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-1de7c849-b245-48ef-8a74-5ba9696927a0 admin admin] The token cache is being invalidate because project e1d838ea03144ce78c1d3016b6386484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:07:00.721485 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-1de7c849-b245-48ef-8a74-5ba9696927a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:00.722142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-1de7c849-b245-48ef-8a74-5ba9696927a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:00.723745 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1397/2762] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:07:00 2022] DELETE /identity/v3/projects/e1d838ea03144ce78c1d3016b6386484 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:00.728826 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa711e0-491b-41ee-8973-0b826578259c None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:00.729152 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa711e0-491b-41ee-8973-0b826578259c None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:00.729439 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa711e0-491b-41ee-8973-0b826578259c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:00.748217 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-eaa711e0-491b-41ee-8973-0b826578259c None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:00.749481 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-eaa711e0-491b-41ee-8973-0b826578259c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:00.807835 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1366/2763] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:07:00.816202 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a833b5-469b-46c3-8cf6-01db64de56cb None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:00.816522 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a833b5-469b-46c3-8cf6-01db64de56cb None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:00.816812 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a833b5-469b-46c3-8cf6-01db64de56cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:00.840890 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-81a833b5-469b-46c3-8cf6-01db64de56cb None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:00.842115 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-81a833b5-469b-46c3-8cf6-01db64de56cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:00.850394 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1398/2764] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:00.854862 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa711e0-491b-41ee-8973-0b826578259c None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:00.865371 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa711e0-491b-41ee-8973-0b826578259c None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:00.870567 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d4d30-19e9-4d32-8049-e00588362415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:00.871884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d4d30-19e9-4d32-8049-e00588362415 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:00.872181 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d4d30-19e9-4d32-8049-e00588362415 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:00.872902 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d4d30-19e9-4d32-8049-e00588362415 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:00.873670 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d4d30-19e9-4d32-8049-e00588362415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:07:00.873984 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d4d30-19e9-4d32-8049-e00588362415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:00.875642 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d4d30-19e9-4d32-8049-e00588362415 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:00.890007 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1367/2765] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 19:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 19:07:00.894433 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a833b5-469b-46c3-8cf6-01db64de56cb None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:00.903767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a833b5-469b-46c3-8cf6-01db64de56cb None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:00.908648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c0998-6638-4647-9072-3ce17b81a1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:00.909304 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c0998-6638-4647-9072-3ce17b81a1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:00.909588 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c0998-6638-4647-9072-3ce17b81a1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:00.909862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c0998-6638-4647-9072-3ce17b81a1c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:00.910570 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c0998-6638-4647-9072-3ce17b81a1c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:00.912547 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c0998-6638-4647-9072-3ce17b81a1c3 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:01.001404 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1399/2766] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:07:00 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:07:01.005637 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d4d30-19e9-4d32-8049-e00588362415 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:01.016216 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d4d30-19e9-4d32-8049-e00588362415 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:01.077955 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041d0ef-c5ed-4468-a8f8-4db5b72315b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:01.078648 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041d0ef-c5ed-4468-a8f8-4db5b72315b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:01.078935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041d0ef-c5ed-4468-a8f8-4db5b72315b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:01.079214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041d0ef-c5ed-4468-a8f8-4db5b72315b6 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:01.079930 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041d0ef-c5ed-4468-a8f8-4db5b72315b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:01.081922 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041d0ef-c5ed-4468-a8f8-4db5b72315b6 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:01.216310 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1368/2767] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:07:01 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:07:01.220577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c0998-6638-4647-9072-3ce17b81a1c3 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:01.232190 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c0998-6638-4647-9072-3ce17b81a1c3 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:01.236805 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee69147-226b-444f-a3f1-ff06e4406a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:01.237499 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee69147-226b-444f-a3f1-ff06e4406a12 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:01.237785 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee69147-226b-444f-a3f1-ff06e4406a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:01.238062 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee69147-226b-444f-a3f1-ff06e4406a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:01.238798 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee69147-226b-444f-a3f1-ff06e4406a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:01.240405 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee69147-226b-444f-a3f1-ff06e4406a12 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:01.252634 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1400/2768] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:07:01.256810 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041d0ef-c5ed-4468-a8f8-4db5b72315b6 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:01.266966 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041d0ef-c5ed-4468-a8f8-4db5b72315b6 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:01.271797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91a99e-1e2c-459c-9831-76213be9b20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:01.272499 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91a99e-1e2c-459c-9831-76213be9b20c admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:01.272786 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91a99e-1e2c-459c-9831-76213be9b20c admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:01.273063 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91a99e-1e2c-459c-9831-76213be9b20c admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:01.273800 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91a99e-1e2c-459c-9831-76213be9b20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:01.275428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91a99e-1e2c-459c-9831-76213be9b20c admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:01.289207 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1369/2769] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:07:01.293616 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee69147-226b-444f-a3f1-ff06e4406a12 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:01.304588 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee69147-226b-444f-a3f1-ff06e4406a12 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:01.309327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f4b90-92e5-4459-a958-5077a8eb8fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:01.310233 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f4b90-92e5-4459-a958-5077a8eb8fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:01.310575 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f4b90-92e5-4459-a958-5077a8eb8fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:01.310859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f4b90-92e5-4459-a958-5077a8eb8fb8 admin admin] PATH_INFO: `/v3/projects/65b1b80875b34801ba8c135601ed992c/users/d2d6aeb522114f56af90bf6cec63e26f/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:01.325676 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f4b90-92e5-4459-a958-5077a8eb8fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b1b80875b34801ba8c135601ed992c, user_id=d2d6aeb522114f56af90bf6cec63e26f, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:01.328336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f4b90-92e5-4459-a958-5077a8eb8fb8 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:01.330538 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:01.433090 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1401/2770] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:07:01 2022] PUT /identity/v3/projects/65b1b80875b34801ba8c135601ed992c/users/d2d6aeb522114f56af90bf6cec63e26f/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:01.443277 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bac775-2873-4aa2-9ad0-6144af05405f None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:01.443596 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bac775-2873-4aa2-9ad0-6144af05405f None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:01.443927 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bac775-2873-4aa2-9ad0-6144af05405f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:01.472727 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d3bac775-2873-4aa2-9ad0-6144af05405f None None] MFA Rules not processed for user `d2d6aeb522114f56af90bf6cec63e26f`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:01.474051 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d3bac775-2873-4aa2-9ad0-6144af05405f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:01.515259 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:01.544404 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1370/2771] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:01.555628 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f4b90-92e5-4459-a958-5077a8eb8fb8 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:01.557453 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-229f4b90-92e5-4459-a958-5077a8eb8fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:01.633282 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f4b90-92e5-4459-a958-5077a8eb8fb8 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:01.639472 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22e767-bd63-4a75-b91f-ab378f5eb1f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:01.640156 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22e767-bd63-4a75-b91f-ab378f5eb1f9 service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:01.640425 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22e767-bd63-4a75-b91f-ab378f5eb1f9 service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:01.640732 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22e767-bd63-4a75-b91f-ab378f5eb1f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:01.649148 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22e767-bd63-4a75-b91f-ab378f5eb1f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:01.650738 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22e767-bd63-4a75-b91f-ab378f5eb1f9 service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:01.660167 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1402/2772] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:07:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:07:04.846939 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bac775-2873-4aa2-9ad0-6144af05405f None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:04.908384 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bac775-2873-4aa2-9ad0-6144af05405f None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:04.913018 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c80006-cca0-4c25-8b06-3e324fb7413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:04.913912 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80006-cca0-4c25-8b06-3e324fb7413b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:04.914198 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80006-cca0-4c25-8b06-3e324fb7413b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:04.914478 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80006-cca0-4c25-8b06-3e324fb7413b admin admin] PATH_INFO: `/v3/users/d2d6aeb522114f56af90bf6cec63e26f` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:04.915683 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c80006-cca0-4c25-8b06-3e324fb7413b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2d6aeb522114f56af90bf6cec63e26f)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:04.917627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c80006-cca0-4c25-8b06-3e324fb7413b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:05.127794 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-43c80006-cca0-4c25-8b06-3e324fb7413b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2d6aeb522114f56af90bf6cec63e26f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:05.128376 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-43c80006-cca0-4c25-8b06-3e324fb7413b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2d6aeb522114f56af90bf6cec63e26f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:05.205411 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-43c80006-cca0-4c25-8b06-3e324fb7413b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2d6aeb522114f56af90bf6cec63e26f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:05.212740 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-43c80006-cca0-4c25-8b06-3e324fb7413b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2d6aeb522114f56af90bf6cec63e26f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:05.225038 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-43c80006-cca0-4c25-8b06-3e324fb7413b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2d6aeb522114f56af90bf6cec63e26f'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:05.231302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1371/2773] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:07:04 2022] DELETE /identity/v3/users/d2d6aeb522114f56af90bf6cec63e26f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:05.235948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d2ea8-83ce-4091-879a-01393bc48506 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:05.236465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d2ea8-83ce-4091-879a-01393bc48506 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:05.236586 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d2ea8-83ce-4091-879a-01393bc48506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:05.254438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-5d2d2ea8-83ce-4091-879a-01393bc48506 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:05.255631 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5d2d2ea8-83ce-4091-879a-01393bc48506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:05.314676 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1403/2774] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:05.324336 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c80006-cca0-4c25-8b06-3e324fb7413b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:05.329741 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-43c80006-cca0-4c25-8b06-3e324fb7413b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:05.390073 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c80006-cca0-4c25-8b06-3e324fb7413b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:05.393677 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb5015-65e3-4c89-b935-7fdd7d031b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:05.394335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb5015-65e3-4c89-b935-7fdd7d031b35 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:05.394619 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb5015-65e3-4c89-b935-7fdd7d031b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:05.394896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb5015-65e3-4c89-b935-7fdd7d031b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:05.404760 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb5015-65e3-4c89-b935-7fdd7d031b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:05.406401 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb5015-65e3-4c89-b935-7fdd7d031b35 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:05.415757 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1372/2775] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:07:05.841410 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d2ea8-83ce-4091-879a-01393bc48506 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:05.842909 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5d2d2ea8-83ce-4091-879a-01393bc48506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:05.855482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d2ea8-83ce-4091-879a-01393bc48506 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:05.860408 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c6db0-e61e-4b94-8263-34690f8aebdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:05.861323 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c6db0-e61e-4b94-8263-34690f8aebdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:05.861612 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c6db0-e61e-4b94-8263-34690f8aebdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:05.861896 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c6db0-e61e-4b94-8263-34690f8aebdc admin admin] PATH_INFO: `/v3/projects/65b1b80875b34801ba8c135601ed992c` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:05.863104 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c6db0-e61e-4b94-8263-34690f8aebdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=65b1b80875b34801ba8c135601ed992c)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:05.865074 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c6db0-e61e-4b94-8263-34690f8aebdc admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:06.000485 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-0e6c6db0-e61e-4b94-8263-34690f8aebdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65b1b80875b34801ba8c135601ed992c', 'request_id': 'req-0e6c6db0-e61e-4b94-8263-34690f8aebdc'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:06.112953 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-0e6c6db0-e61e-4b94-8263-34690f8aebdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65b1b80875b34801ba8c135601ed992c', 'request_id': 'req-0e6c6db0-e61e-4b94-8263-34690f8aebdc'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:06.120040 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-0e6c6db0-e61e-4b94-8263-34690f8aebdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65b1b80875b34801ba8c135601ed992c', 'request_id': 'req-0e6c6db0-e61e-4b94-8263-34690f8aebdc'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:06.131088 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-0e6c6db0-e61e-4b94-8263-34690f8aebdc admin admin] The token cache is being invalidate because project 65b1b80875b34801ba8c135601ed992c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:07:06.131380 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-0e6c6db0-e61e-4b94-8263-34690f8aebdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:06.132027 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-0e6c6db0-e61e-4b94-8263-34690f8aebdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:06.133638 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1404/2776] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:07:05 2022] DELETE /identity/v3/projects/65b1b80875b34801ba8c135601ed992c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:06.138576 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5294417-b9c3-431a-bfad-18be9a89ec94 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:06.139071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5294417-b9c3-431a-bfad-18be9a89ec94 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:06.139189 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5294417-b9c3-431a-bfad-18be9a89ec94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:06.145527 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:06.157601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f5294417-b9c3-431a-bfad-18be9a89ec94 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:06.161707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f5294417-b9c3-431a-bfad-18be9a89ec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:06.216249 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1373/2777] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:06.224338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd20d5-71c9-4d1d-9efe-89eebc3a287b None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:06.224665 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd20d5-71c9-4d1d-9efe-89eebc3a287b None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:06.224951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd20d5-71c9-4d1d-9efe-89eebc3a287b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:06.231850 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:06.244592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-c2cd20d5-71c9-4d1d-9efe-89eebc3a287b None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:06.245821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-c2cd20d5-71c9-4d1d-9efe-89eebc3a287b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:06.254889 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1405/2778] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:06.258995 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5294417-b9c3-431a-bfad-18be9a89ec94 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:06.269300 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5294417-b9c3-431a-bfad-18be9a89ec94 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:06.274019 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df361958-09ea-41ec-887b-08ca0c213648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:06.274695 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df361958-09ea-41ec-887b-08ca0c213648 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:06.274987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df361958-09ea-41ec-887b-08ca0c213648 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:06.275268 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df361958-09ea-41ec-887b-08ca0c213648 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:06.276177 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df361958-09ea-41ec-887b-08ca0c213648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:07:06.276527 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df361958-09ea-41ec-887b-08ca0c213648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:06.278693 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df361958-09ea-41ec-887b-08ca0c213648 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:06.290911 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1374/2779] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 19:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 19:07:06.295823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd20d5-71c9-4d1d-9efe-89eebc3a287b None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:06.305559 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd20d5-71c9-4d1d-9efe-89eebc3a287b None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:06.310753 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e273852-e6a1-4a08-a900-2288e77e8eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:06.311594 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e273852-e6a1-4a08-a900-2288e77e8eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:06.311901 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e273852-e6a1-4a08-a900-2288e77e8eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:06.312161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e273852-e6a1-4a08-a900-2288e77e8eb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:06.312899 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e273852-e6a1-4a08-a900-2288e77e8eb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:06.314811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e273852-e6a1-4a08-a900-2288e77e8eb4 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:06.436049 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1406/2780] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:07:06 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:07:06.440173 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df361958-09ea-41ec-887b-08ca0c213648 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:06.450215 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df361958-09ea-41ec-887b-08ca0c213648 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:06.507208 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9fd29-954a-4f33-b9a0-143636d8a953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:06.507802 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9fd29-954a-4f33-b9a0-143636d8a953 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:06.508093 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9fd29-954a-4f33-b9a0-143636d8a953 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:06.508376 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9fd29-954a-4f33-b9a0-143636d8a953 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:06.509238 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9fd29-954a-4f33-b9a0-143636d8a953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:06.511168 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9fd29-954a-4f33-b9a0-143636d8a953 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:06.606534 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1375/2781] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:07:06 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:07:06.616927 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e273852-e6a1-4a08-a900-2288e77e8eb4 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:06.627653 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e273852-e6a1-4a08-a900-2288e77e8eb4 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:06.632383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120fd8e-dd69-4d63-829c-66394f8c9089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:06.633127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120fd8e-dd69-4d63-829c-66394f8c9089 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:06.633415 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120fd8e-dd69-4d63-829c-66394f8c9089 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:06.633711 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120fd8e-dd69-4d63-829c-66394f8c9089 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:06.634435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120fd8e-dd69-4d63-829c-66394f8c9089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:06.636043 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120fd8e-dd69-4d63-829c-66394f8c9089 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:06.647318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1407/2782] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:07:06.657321 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9fd29-954a-4f33-b9a0-143636d8a953 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:06.667546 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9fd29-954a-4f33-b9a0-143636d8a953 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:06.672229 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f65f7a-7c4c-48be-a31a-77caf5ca86d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:06.672931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f65f7a-7c4c-48be-a31a-77caf5ca86d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:06.673225 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f65f7a-7c4c-48be-a31a-77caf5ca86d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:06.673511 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f65f7a-7c4c-48be-a31a-77caf5ca86d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:06.674279 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f65f7a-7c4c-48be-a31a-77caf5ca86d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:06.675881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f65f7a-7c4c-48be-a31a-77caf5ca86d3 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:06.685964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1376/2783] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:07:06.690176 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120fd8e-dd69-4d63-829c-66394f8c9089 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:06.700880 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120fd8e-dd69-4d63-829c-66394f8c9089 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:06.705481 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce456872-f075-4e10-8796-5e466809dcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:06.706364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce456872-f075-4e10-8796-5e466809dcc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:06.706650 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce456872-f075-4e10-8796-5e466809dcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:06.706931 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce456872-f075-4e10-8796-5e466809dcc5 admin admin] PATH_INFO: `/v3/projects/472f164255b8499084882f6f86d3f4b2/users/24c61e0d03094ceeadbd5e7c28bd24aa/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:06.722297 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce456872-f075-4e10-8796-5e466809dcc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=472f164255b8499084882f6f86d3f4b2, user_id=24c61e0d03094ceeadbd5e7c28bd24aa, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:06.725010 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce456872-f075-4e10-8796-5e466809dcc5 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:06.817791 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1408/2784] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:07:06 2022] PUT /identity/v3/projects/472f164255b8499084882f6f86d3f4b2/users/24c61e0d03094ceeadbd5e7c28bd24aa/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:06.829673 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fbc15-4bb8-448a-b83f-27b8a06a9d93 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:06.829974 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fbc15-4bb8-448a-b83f-27b8a06a9d93 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:06.830262 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fbc15-4bb8-448a-b83f-27b8a06a9d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:06.857165 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-ce8fbc15-4bb8-448a-b83f-27b8a06a9d93 None None] MFA Rules not processed for user `24c61e0d03094ceeadbd5e7c28bd24aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:06.858381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-ce8fbc15-4bb8-448a-b83f-27b8a06a9d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:06.916844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:06.922268 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1377/2785] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:06.933276 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce456872-f075-4e10-8796-5e466809dcc5 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:06.995403 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce456872-f075-4e10-8796-5e466809dcc5 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:07.000123 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f3471-837c-4094-96e8-a651825e4f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:07.000827 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f3471-837c-4094-96e8-a651825e4f1c admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:07.001242 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f3471-837c-4094-96e8-a651825e4f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:07.001393 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f3471-837c-4094-96e8-a651825e4f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:07.002090 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f3471-837c-4094-96e8-a651825e4f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:07.003995 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f3471-837c-4094-96e8-a651825e4f1c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:07.099516 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1409/2786] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:07:06 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:07:07.103367 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fbc15-4bb8-448a-b83f-27b8a06a9d93 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:07.114971 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fbc15-4bb8-448a-b83f-27b8a06a9d93 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:07.170750 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec21a07-6032-43a5-9adf-eca4e5a0a7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:07.171457 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec21a07-6032-43a5-9adf-eca4e5a0a7a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:07.171703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec21a07-6032-43a5-9adf-eca4e5a0a7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:07.171985 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec21a07-6032-43a5-9adf-eca4e5a0a7a6 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:07.172726 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec21a07-6032-43a5-9adf-eca4e5a0a7a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:07.174650 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec21a07-6032-43a5-9adf-eca4e5a0a7a6 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:07.234604 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1378/2787] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:07:07 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:07:07.238592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f3471-837c-4094-96e8-a651825e4f1c admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:07.249644 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f3471-837c-4094-96e8-a651825e4f1c admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:07.254512 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64baa3-026e-4e78-a9df-3cda711142a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:07.255192 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64baa3-026e-4e78-a9df-3cda711142a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:07.255481 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64baa3-026e-4e78-a9df-3cda711142a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:07.255799 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64baa3-026e-4e78-a9df-3cda711142a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:07.256572 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64baa3-026e-4e78-a9df-3cda711142a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:07.258207 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64baa3-026e-4e78-a9df-3cda711142a6 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:07.269444 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1410/2788] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:07:07.273637 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec21a07-6032-43a5-9adf-eca4e5a0a7a6 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:07.284165 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec21a07-6032-43a5-9adf-eca4e5a0a7a6 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:07.288861 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0acde9-510f-4b72-b207-5aac2110900e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:07.289745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0acde9-510f-4b72-b207-5aac2110900e admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:07.290027 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0acde9-510f-4b72-b207-5aac2110900e admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:07.290302 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0acde9-510f-4b72-b207-5aac2110900e admin admin] PATH_INFO: `/v3/projects/5ab6ebe0c00d40ce92fa9329494761b9/users/e0e08f0559194608a315f53f491658a9/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:07.306243 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0acde9-510f-4b72-b207-5aac2110900e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab6ebe0c00d40ce92fa9329494761b9, user_id=e0e08f0559194608a315f53f491658a9, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:07.309080 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0acde9-510f-4b72-b207-5aac2110900e admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:07.400496 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1379/2789] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:07:07 2022] PUT /identity/v3/projects/5ab6ebe0c00d40ce92fa9329494761b9/users/e0e08f0559194608a315f53f491658a9/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 19:07:07.404914 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64baa3-026e-4e78-a9df-3cda711142a6 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:07.415333 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64baa3-026e-4e78-a9df-3cda711142a6 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:07.473768 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca522d2-d187-4b2c-b921-ce6afb18fdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:07.474456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca522d2-d187-4b2c-b921-ce6afb18fdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:07.474744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca522d2-d187-4b2c-b921-ce6afb18fdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:07.475029 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca522d2-d187-4b2c-b921-ce6afb18fdf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:07.475766 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca522d2-d187-4b2c-b921-ce6afb18fdf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:07.477423 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca522d2-d187-4b2c-b921-ce6afb18fdf0 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:07.487862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1411/2790] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:07:07.492259 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0acde9-510f-4b72-b207-5aac2110900e admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:07.502675 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0acde9-510f-4b72-b207-5aac2110900e admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:07.507290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0eb2b1-779b-488e-ad3a-ffbb778ab2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:07.508180 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0eb2b1-779b-488e-ad3a-ffbb778ab2c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:07.508498 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0eb2b1-779b-488e-ad3a-ffbb778ab2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:07.508779 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0eb2b1-779b-488e-ad3a-ffbb778ab2c4 admin admin] PATH_INFO: `/v3/projects/5ab6ebe0c00d40ce92fa9329494761b9/users/e0e08f0559194608a315f53f491658a9/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:07.510770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0eb2b1-779b-488e-ad3a-ffbb778ab2c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab6ebe0c00d40ce92fa9329494761b9, user_id=e0e08f0559194608a315f53f491658a9, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:07.513972 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0eb2b1-779b-488e-ad3a-ffbb778ab2c4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:07.524378 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1380/2791] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:07:07 2022] PUT /identity/v3/projects/5ab6ebe0c00d40ce92fa9329494761b9/users/e0e08f0559194608a315f53f491658a9/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:07.535061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056fed5-638e-4cb1-81ba-7e92657c63f9 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:07.535358 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056fed5-638e-4cb1-81ba-7e92657c63f9 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:07.535638 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056fed5-638e-4cb1-81ba-7e92657c63f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:07.554876 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:07.563280 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-2056fed5-638e-4cb1-81ba-7e92657c63f9 None None] MFA Rules not processed for user `e0e08f0559194608a315f53f491658a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:07.564535 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2056fed5-638e-4cb1-81ba-7e92657c63f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:07.632744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1412/2792] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:07.644515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0eb2b1-779b-488e-ad3a-ffbb778ab2c4 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:07.646272 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bd0eb2b1-779b-488e-ad3a-ffbb778ab2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:07.704097 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0eb2b1-779b-488e-ad3a-ffbb778ab2c4 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:07.707761 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcc89a-ad87-48f6-b365-a53dbcf45775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:07.708415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcc89a-ad87-48f6-b365-a53dbcf45775 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:07.708736 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcc89a-ad87-48f6-b365-a53dbcf45775 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:07.709813 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcc89a-ad87-48f6-b365-a53dbcf45775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:07.718830 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcc89a-ad87-48f6-b365-a53dbcf45775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:07.720273 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcc89a-ad87-48f6-b365-a53dbcf45775 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:07.729938 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1381/2793] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:07:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:07:07.944901 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056fed5-638e-4cb1-81ba-7e92657c63f9 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:07.954783 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056fed5-638e-4cb1-81ba-7e92657c63f9 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:07.958364 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a870ba2-f234-41af-851a-c80e07d6a668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:07.959011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a870ba2-f234-41af-851a-c80e07d6a668 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:07.959299 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a870ba2-f234-41af-851a-c80e07d6a668 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:07.959578 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a870ba2-f234-41af-851a-c80e07d6a668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:08.016354 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a870ba2-f234-41af-851a-c80e07d6a668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:08.017869 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a870ba2-f234-41af-851a-c80e07d6a668 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:08.026944 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1413/2794] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:07:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:07:16.808910 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcc89a-ad87-48f6-b365-a53dbcf45775 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:16.862138 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:16.873234 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcc89a-ad87-48f6-b365-a53dbcf45775 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:16.877917 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881f414-b27f-42d8-a7fb-b3e750c1b4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:16.878788 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881f414-b27f-42d8-a7fb-b3e750c1b4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:16.879070 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881f414-b27f-42d8-a7fb-b3e750c1b4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:16.879342 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881f414-b27f-42d8-a7fb-b3e750c1b4b8 admin admin] PATH_INFO: `/v3/users/24c61e0d03094ceeadbd5e7c28bd24aa` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:16.880559 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881f414-b27f-42d8-a7fb-b3e750c1b4b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c61e0d03094ceeadbd5e7c28bd24aa)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:16.882480 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881f414-b27f-42d8-a7fb-b3e750c1b4b8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:17.076847 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b881f414-b27f-42d8-a7fb-b3e750c1b4b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c61e0d03094ceeadbd5e7c28bd24aa'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:17.077471 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b881f414-b27f-42d8-a7fb-b3e750c1b4b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c61e0d03094ceeadbd5e7c28bd24aa'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:17.136960 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b881f414-b27f-42d8-a7fb-b3e750c1b4b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c61e0d03094ceeadbd5e7c28bd24aa'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:17.144529 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b881f414-b27f-42d8-a7fb-b3e750c1b4b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c61e0d03094ceeadbd5e7c28bd24aa'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:17.157136 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-b881f414-b27f-42d8-a7fb-b3e750c1b4b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c61e0d03094ceeadbd5e7c28bd24aa'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:17.163156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1382/2795] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:07:16 2022] DELETE /identity/v3/users/24c61e0d03094ceeadbd5e7c28bd24aa => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 19:07:17.167637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38575294-5c39-4e52-a595-d35b6abf4922 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:17.168130 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38575294-5c39-4e52-a595-d35b6abf4922 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:17.168238 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38575294-5c39-4e52-a595-d35b6abf4922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:17.185336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-38575294-5c39-4e52-a595-d35b6abf4922 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:17.186525 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-38575294-5c39-4e52-a595-d35b6abf4922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:17.247245 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1414/2796] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:17.256870 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881f414-b27f-42d8-a7fb-b3e750c1b4b8 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:17.258355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-b881f414-b27f-42d8-a7fb-b3e750c1b4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:17.318055 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881f414-b27f-42d8-a7fb-b3e750c1b4b8 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:17.321793 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e6281-1898-4d3b-b6be-5e79fec21144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:17.322450 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e6281-1898-4d3b-b6be-5e79fec21144 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:17.322742 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e6281-1898-4d3b-b6be-5e79fec21144 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:17.323024 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e6281-1898-4d3b-b6be-5e79fec21144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:17.333249 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e6281-1898-4d3b-b6be-5e79fec21144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:17.334611 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e6281-1898-4d3b-b6be-5e79fec21144 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:17.351097 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1383/2797] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:07:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:07:17.772379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38575294-5c39-4e52-a595-d35b6abf4922 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:17.779484 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-38575294-5c39-4e52-a595-d35b6abf4922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:17.787963 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38575294-5c39-4e52-a595-d35b6abf4922 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:17.793548 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66652c9e-a176-47ee-a44d-4140be3cd5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:17.794629 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66652c9e-a176-47ee-a44d-4140be3cd5c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:17.794886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66652c9e-a176-47ee-a44d-4140be3cd5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:17.795177 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66652c9e-a176-47ee-a44d-4140be3cd5c7 admin admin] PATH_INFO: `/v3/projects/472f164255b8499084882f6f86d3f4b2` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:17.796537 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66652c9e-a176-47ee-a44d-4140be3cd5c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=472f164255b8499084882f6f86d3f4b2)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:17.798536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66652c9e-a176-47ee-a44d-4140be3cd5c7 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:17.916218 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:17.932124 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-66652c9e-a176-47ee-a44d-4140be3cd5c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '472f164255b8499084882f6f86d3f4b2', 'request_id': 'req-66652c9e-a176-47ee-a44d-4140be3cd5c7'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:18.027339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-66652c9e-a176-47ee-a44d-4140be3cd5c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '472f164255b8499084882f6f86d3f4b2', 'request_id': 'req-66652c9e-a176-47ee-a44d-4140be3cd5c7'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:18.034164 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-66652c9e-a176-47ee-a44d-4140be3cd5c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '472f164255b8499084882f6f86d3f4b2', 'request_id': 'req-66652c9e-a176-47ee-a44d-4140be3cd5c7'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:18.045026 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-66652c9e-a176-47ee-a44d-4140be3cd5c7 admin admin] The token cache is being invalidate because project 472f164255b8499084882f6f86d3f4b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:07:18.045317 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-66652c9e-a176-47ee-a44d-4140be3cd5c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:18.045975 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-66652c9e-a176-47ee-a44d-4140be3cd5c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:18.047523 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1415/2798] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:07:17 2022] DELETE /identity/v3/projects/472f164255b8499084882f6f86d3f4b2 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:18.051674 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e6281-1898-4d3b-b6be-5e79fec21144 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:18.061981 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e6281-1898-4d3b-b6be-5e79fec21144 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:18.117545 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aeb57f-aad3-48f9-b935-f34bd2fb81be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:18.118412 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeb57f-aad3-48f9-b935-f34bd2fb81be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:18.118695 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeb57f-aad3-48f9-b935-f34bd2fb81be admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:18.118973 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeb57f-aad3-48f9-b935-f34bd2fb81be admin admin] PATH_INFO: `/v3/users/e0e08f0559194608a315f53f491658a9` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:18.120154 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aeb57f-aad3-48f9-b935-f34bd2fb81be admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e08f0559194608a315f53f491658a9)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:18.122676 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aeb57f-aad3-48f9-b935-f34bd2fb81be admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:18.138617 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:18.338286 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-14aeb57f-aad3-48f9-b935-f34bd2fb81be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e08f0559194608a315f53f491658a9'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:18.338942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-14aeb57f-aad3-48f9-b935-f34bd2fb81be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e08f0559194608a315f53f491658a9'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:18.387246 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-14aeb57f-aad3-48f9-b935-f34bd2fb81be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e08f0559194608a315f53f491658a9'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:18.394858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-14aeb57f-aad3-48f9-b935-f34bd2fb81be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e08f0559194608a315f53f491658a9'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:18.407746 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-14aeb57f-aad3-48f9-b935-f34bd2fb81be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e08f0559194608a315f53f491658a9'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:18.413696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1384/2799] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:07:18 2022] DELETE /identity/v3/users/e0e08f0559194608a315f53f491658a9 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:18.806098 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66652c9e-a176-47ee-a44d-4140be3cd5c7 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:18.808709 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-66652c9e-a176-47ee-a44d-4140be3cd5c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:18.820929 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66652c9e-a176-47ee-a44d-4140be3cd5c7 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:18.896755 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a9d80-fe86-45c7-9b5a-0587915bc999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:18.897638 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a9d80-fe86-45c7-9b5a-0587915bc999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:18.897922 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a9d80-fe86-45c7-9b5a-0587915bc999 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:18.898199 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a9d80-fe86-45c7-9b5a-0587915bc999 admin admin] PATH_INFO: `/v3/projects/5ab6ebe0c00d40ce92fa9329494761b9` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:18.899396 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a9d80-fe86-45c7-9b5a-0587915bc999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab6ebe0c00d40ce92fa9329494761b9)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:18.901365 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a9d80-fe86-45c7-9b5a-0587915bc999 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:18.998734 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f71a9d80-fe86-45c7-9b5a-0587915bc999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab6ebe0c00d40ce92fa9329494761b9', 'request_id': 'req-f71a9d80-fe86-45c7-9b5a-0587915bc999'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:19.050278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f71a9d80-fe86-45c7-9b5a-0587915bc999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab6ebe0c00d40ce92fa9329494761b9', 'request_id': 'req-f71a9d80-fe86-45c7-9b5a-0587915bc999'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:19.056500 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f71a9d80-fe86-45c7-9b5a-0587915bc999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab6ebe0c00d40ce92fa9329494761b9', 'request_id': 'req-f71a9d80-fe86-45c7-9b5a-0587915bc999'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:19.067173 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f71a9d80-fe86-45c7-9b5a-0587915bc999 admin admin] The token cache is being invalidate because project 5ab6ebe0c00d40ce92fa9329494761b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:07:19.069597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f71a9d80-fe86-45c7-9b5a-0587915bc999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:19.069597 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-f71a9d80-fe86-45c7-9b5a-0587915bc999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:19.069867 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1416/2800] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:07:18 2022] DELETE /identity/v3/projects/5ab6ebe0c00d40ce92fa9329494761b9 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 19:07:19.075228 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cd20d-ac58-429e-b0aa-4d816c96fbe4 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:19.075703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cd20d-ac58-429e-b0aa-4d816c96fbe4 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:19.075814 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cd20d-ac58-429e-b0aa-4d816c96fbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:19.093000 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-752cd20d-ac58-429e-b0aa-4d816c96fbe4 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:19.094214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-752cd20d-ac58-429e-b0aa-4d816c96fbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:19.153028 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1385/2801] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:19.162079 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b3bc4-5ae0-4847-80dc-363ebd28f6c3 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:19.162378 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b3bc4-5ae0-4847-80dc-363ebd28f6c3 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:19.162666 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b3bc4-5ae0-4847-80dc-363ebd28f6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:19.181127 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-244b3bc4-5ae0-4847-80dc-363ebd28f6c3 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:19.182332 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-244b3bc4-5ae0-4847-80dc-363ebd28f6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:19.190870 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1417/2802] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:19.195000 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cd20d-ac58-429e-b0aa-4d816c96fbe4 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:19.205290 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cd20d-ac58-429e-b0aa-4d816c96fbe4 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:19.209859 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc381f-477a-405e-a8ed-e0ad9f6c568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:19.210515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc381f-477a-405e-a8ed-e0ad9f6c568b admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:19.210806 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc381f-477a-405e-a8ed-e0ad9f6c568b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:19.211091 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc381f-477a-405e-a8ed-e0ad9f6c568b admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:19.211831 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc381f-477a-405e-a8ed-e0ad9f6c568b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:07:19.212146 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc381f-477a-405e-a8ed-e0ad9f6c568b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:19.213777 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc381f-477a-405e-a8ed-e0ad9f6c568b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:19.225122 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1386/2803] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 19:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 19:07:19.229214 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b3bc4-5ae0-4847-80dc-363ebd28f6c3 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:19.238390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b3bc4-5ae0-4847-80dc-363ebd28f6c3 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:19.243458 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95022c3-a01d-4f40-870a-40add3725f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:19.244115 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95022c3-a01d-4f40-870a-40add3725f1c admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:19.244408 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95022c3-a01d-4f40-870a-40add3725f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:19.244747 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95022c3-a01d-4f40-870a-40add3725f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:19.245961 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95022c3-a01d-4f40-870a-40add3725f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:19.247874 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95022c3-a01d-4f40-870a-40add3725f1c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:19.338335 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1418/2804] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:07:19 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:07:19.340822 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc381f-477a-405e-a8ed-e0ad9f6c568b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:19.351168 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc381f-477a-405e-a8ed-e0ad9f6c568b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:19.406649 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed59334-83c3-4c77-889c-17eebf0696f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:19.407319 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed59334-83c3-4c77-889c-17eebf0696f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:19.407604 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed59334-83c3-4c77-889c-17eebf0696f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:19.407879 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed59334-83c3-4c77-889c-17eebf0696f8 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:19.408600 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed59334-83c3-4c77-889c-17eebf0696f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:19.410487 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed59334-83c3-4c77-889c-17eebf0696f8 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:19.490567 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1387/2805] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:07:19 2022] POST /identity/v3/users => generated 283 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:07:19.497047 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95022c3-a01d-4f40-870a-40add3725f1c admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:19.511471 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95022c3-a01d-4f40-870a-40add3725f1c admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:19.516163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49475897-b21c-4846-af15-dba8d3cc4543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:19.516853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49475897-b21c-4846-af15-dba8d3cc4543 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:19.517139 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49475897-b21c-4846-af15-dba8d3cc4543 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:19.517415 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49475897-b21c-4846-af15-dba8d3cc4543 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:19.518141 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49475897-b21c-4846-af15-dba8d3cc4543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:19.519736 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49475897-b21c-4846-af15-dba8d3cc4543 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:19.531826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1419/2806] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:07:19.535887 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed59334-83c3-4c77-889c-17eebf0696f8 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:19.546796 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed59334-83c3-4c77-889c-17eebf0696f8 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:19.551513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867cdbc-5c4e-450a-9023-4e0d1006b1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:19.552133 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867cdbc-5c4e-450a-9023-4e0d1006b1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:19.552418 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867cdbc-5c4e-450a-9023-4e0d1006b1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:19.552755 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867cdbc-5c4e-450a-9023-4e0d1006b1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:19.553524 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867cdbc-5c4e-450a-9023-4e0d1006b1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:19.555193 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867cdbc-5c4e-450a-9023-4e0d1006b1e2 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:19.561131 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:19.567047 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1388/2807] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:07:19.571183 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49475897-b21c-4846-af15-dba8d3cc4543 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:19.581276 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49475897-b21c-4846-af15-dba8d3cc4543 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:19.585939 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce48a8-1b9f-4fd5-868a-912fdfb311e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:19.586826 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce48a8-1b9f-4fd5-868a-912fdfb311e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:19.587111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce48a8-1b9f-4fd5-868a-912fdfb311e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:19.587389 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce48a8-1b9f-4fd5-868a-912fdfb311e1 admin admin] PATH_INFO: `/v3/projects/69d019fe283d42918c29fe2e8811ab5b/users/77c7f038c8914c3abe825d9e15de5155/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:19.589808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:19.603849 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce48a8-1b9f-4fd5-868a-912fdfb311e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d019fe283d42918c29fe2e8811ab5b, user_id=77c7f038c8914c3abe825d9e15de5155, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:19.607006 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce48a8-1b9f-4fd5-868a-912fdfb311e1 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:19.695494 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1420/2808] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:07:19 2022] PUT /identity/v3/projects/69d019fe283d42918c29fe2e8811ab5b/users/77c7f038c8914c3abe825d9e15de5155/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:19.706118 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce03dbb-f17b-47f3-9678-9bc3b5627976 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:19.706406 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce03dbb-f17b-47f3-9678-9bc3b5627976 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:19.706700 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce03dbb-f17b-47f3-9678-9bc3b5627976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:19.733366 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-0ce03dbb-f17b-47f3-9678-9bc3b5627976 None None] MFA Rules not processed for user `77c7f038c8914c3abe825d9e15de5155`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:19.734589 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-0ce03dbb-f17b-47f3-9678-9bc3b5627976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:19.799043 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1389/2809] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:19.803550 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce48a8-1b9f-4fd5-868a-912fdfb311e1 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:19.863869 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce48a8-1b9f-4fd5-868a-912fdfb311e1 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:19.869011 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea9e7b-2472-47f5-b51c-85daf98ac121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:19.869681 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9e7b-2472-47f5-b51c-85daf98ac121 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:19.869971 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9e7b-2472-47f5-b51c-85daf98ac121 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:19.870255 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9e7b-2472-47f5-b51c-85daf98ac121 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:19.871015 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea9e7b-2472-47f5-b51c-85daf98ac121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:19.872976 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea9e7b-2472-47f5-b51c-85daf98ac121 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:19.948338 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1421/2810] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:07:19 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:07:19.952295 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce03dbb-f17b-47f3-9678-9bc3b5627976 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:19.963019 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce03dbb-f17b-47f3-9678-9bc3b5627976 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:20.018071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba993d67-abb5-4db4-b816-aa3e72f0713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:20.018739 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba993d67-abb5-4db4-b816-aa3e72f0713a admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:20.019023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba993d67-abb5-4db4-b816-aa3e72f0713a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:20.019297 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba993d67-abb5-4db4-b816-aa3e72f0713a admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:20.022340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba993d67-abb5-4db4-b816-aa3e72f0713a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:20.022340 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba993d67-abb5-4db4-b816-aa3e72f0713a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:20.130840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1390/2811] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:07:19 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:07:20.134944 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea9e7b-2472-47f5-b51c-85daf98ac121 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:20.146131 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea9e7b-2472-47f5-b51c-85daf98ac121 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:20.150845 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa348e-168e-4207-ba59-bb9c6b22f512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:20.151511 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa348e-168e-4207-ba59-bb9c6b22f512 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:20.152389 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa348e-168e-4207-ba59-bb9c6b22f512 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:20.152705 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa348e-168e-4207-ba59-bb9c6b22f512 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:20.153439 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa348e-168e-4207-ba59-bb9c6b22f512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:20.155163 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa348e-168e-4207-ba59-bb9c6b22f512 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:20.166701 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1422/2812] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:07:20.170795 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba993d67-abb5-4db4-b816-aa3e72f0713a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:20.180729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba993d67-abb5-4db4-b816-aa3e72f0713a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:20.185372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd5f88-cb4a-463f-a7dd-3154a42a3298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:20.186280 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd5f88-cb4a-463f-a7dd-3154a42a3298 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:20.186563 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd5f88-cb4a-463f-a7dd-3154a42a3298 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:20.186838 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd5f88-cb4a-463f-a7dd-3154a42a3298 admin admin] PATH_INFO: `/v3/projects/84b528c3eec44b17895db080c98c57af/users/b6dd30582bca424c9a09a16bf9e2ce4e/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:20.202388 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd5f88-cb4a-463f-a7dd-3154a42a3298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b528c3eec44b17895db080c98c57af, user_id=b6dd30582bca424c9a09a16bf9e2ce4e, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:20.216571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd5f88-cb4a-463f-a7dd-3154a42a3298 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:20.307679 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1391/2813] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:07:20 2022] PUT /identity/v3/projects/84b528c3eec44b17895db080c98c57af/users/b6dd30582bca424c9a09a16bf9e2ce4e/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:20.317077 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa348e-168e-4207-ba59-bb9c6b22f512 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:20.327760 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa348e-168e-4207-ba59-bb9c6b22f512 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:20.383465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27713229-42e2-4e10-9a19-f0e77e9eff76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:20.384073 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27713229-42e2-4e10-9a19-f0e77e9eff76 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:20.384366 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27713229-42e2-4e10-9a19-f0e77e9eff76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:20.384680 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27713229-42e2-4e10-9a19-f0e77e9eff76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:20.385411 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27713229-42e2-4e10-9a19-f0e77e9eff76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:20.387650 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27713229-42e2-4e10-9a19-f0e77e9eff76 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:20.402477 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1423/2814] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:07:20.406718 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd5f88-cb4a-463f-a7dd-3154a42a3298 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:20.417513 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd5f88-cb4a-463f-a7dd-3154a42a3298 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:20.422501 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1d706-2fb9-4d64-bff4-69d7aa16c46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:20.423407 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1d706-2fb9-4d64-bff4-69d7aa16c46b admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:20.423692 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1d706-2fb9-4d64-bff4-69d7aa16c46b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:20.423967 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1d706-2fb9-4d64-bff4-69d7aa16c46b admin admin] PATH_INFO: `/v3/projects/84b528c3eec44b17895db080c98c57af/users/b6dd30582bca424c9a09a16bf9e2ce4e/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:20.426040 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1d706-2fb9-4d64-bff4-69d7aa16c46b admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b528c3eec44b17895db080c98c57af, user_id=b6dd30582bca424c9a09a16bf9e2ce4e, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:20.428722 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1d706-2fb9-4d64-bff4-69d7aa16c46b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:20.439478 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1392/2815] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:07:20 2022] PUT /identity/v3/projects/84b528c3eec44b17895db080c98c57af/users/b6dd30582bca424c9a09a16bf9e2ce4e/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:20.450140 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ca6ad-eecc-4c29-ade1-cd60c3d031f6 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:20.450438 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ca6ad-eecc-4c29-ade1-cd60c3d031f6 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:20.450715 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ca6ad-eecc-4c29-ade1-cd60c3d031f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:20.476838 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-850ca6ad-eecc-4c29-ade1-cd60c3d031f6 None None] MFA Rules not processed for user `b6dd30582bca424c9a09a16bf9e2ce4e`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:20.478041 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-850ca6ad-eecc-4c29-ade1-cd60c3d031f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:20.518262 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:20.544106 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1424/2816] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:20.556173 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1d706-2fb9-4d64-bff4-69d7aa16c46b admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:20.558415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-eee1d706-2fb9-4d64-bff4-69d7aa16c46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:20.603474 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:20.614665 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1d706-2fb9-4d64-bff4-69d7aa16c46b admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:20.618587 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ba750-c3a5-4e6e-a4d5-f45c848b1e41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:20.619225 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ba750-c3a5-4e6e-a4d5-f45c848b1e41 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:20.619506 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ba750-c3a5-4e6e-a4d5-f45c848b1e41 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:20.619781 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ba750-c3a5-4e6e-a4d5-f45c848b1e41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:20.629030 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ba750-c3a5-4e6e-a4d5-f45c848b1e41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:20.630461 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ba750-c3a5-4e6e-a4d5-f45c848b1e41 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:20.640672 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1393/2817] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:07:20 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:07:20.845497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ca6ad-eecc-4c29-ade1-cd60c3d031f6 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:20.855120 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ca6ad-eecc-4c29-ade1-cd60c3d031f6 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:20.858642 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf244d58-49b8-4ab2-8c99-1282005b22c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:20.859280 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf244d58-49b8-4ab2-8c99-1282005b22c0 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:20.859562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf244d58-49b8-4ab2-8c99-1282005b22c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:20.859837 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf244d58-49b8-4ab2-8c99-1282005b22c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:20.916182 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf244d58-49b8-4ab2-8c99-1282005b22c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:20.918094 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf244d58-49b8-4ab2-8c99-1282005b22c0 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:20.927167 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1425/2818] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:07:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:07:27.277785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ba750-c3a5-4e6e-a4d5-f45c848b1e41 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:27.343157 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ba750-c3a5-4e6e-a4d5-f45c848b1e41 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:27.348860 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476de99b-8fe9-46af-9185-e211380d2849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:27.349741 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476de99b-8fe9-46af-9185-e211380d2849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:27.350025 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476de99b-8fe9-46af-9185-e211380d2849 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:27.350303 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476de99b-8fe9-46af-9185-e211380d2849 admin admin] PATH_INFO: `/v3/users/77c7f038c8914c3abe825d9e15de5155` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:27.351521 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476de99b-8fe9-46af-9185-e211380d2849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77c7f038c8914c3abe825d9e15de5155)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:27.353495 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476de99b-8fe9-46af-9185-e211380d2849 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:27.533632 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-476de99b-8fe9-46af-9185-e211380d2849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77c7f038c8914c3abe825d9e15de5155'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:27.534327 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-476de99b-8fe9-46af-9185-e211380d2849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77c7f038c8914c3abe825d9e15de5155'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:27.604091 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-476de99b-8fe9-46af-9185-e211380d2849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77c7f038c8914c3abe825d9e15de5155'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:27.612363 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-476de99b-8fe9-46af-9185-e211380d2849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77c7f038c8914c3abe825d9e15de5155'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:27.624820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-476de99b-8fe9-46af-9185-e211380d2849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77c7f038c8914c3abe825d9e15de5155'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:27.631205 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1394/2819] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:07:27 2022] DELETE /identity/v3/users/77c7f038c8914c3abe825d9e15de5155 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:27.635771 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276ac98-918a-4e29-b706-ff27d24893f7 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:27.636855 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276ac98-918a-4e29-b706-ff27d24893f7 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:27.636855 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276ac98-918a-4e29-b706-ff27d24893f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:27.654948 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-6276ac98-918a-4e29-b706-ff27d24893f7 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:27.656160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6276ac98-918a-4e29-b706-ff27d24893f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:27.715152 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1426/2820] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:27.724785 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476de99b-8fe9-46af-9185-e211380d2849 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:27.726225 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-476de99b-8fe9-46af-9185-e211380d2849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:27.786274 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476de99b-8fe9-46af-9185-e211380d2849 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:27.789840 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba6786-e96b-4ba9-9fb3-cd5ac7ad9b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:27.790491 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba6786-e96b-4ba9-9fb3-cd5ac7ad9b62 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:27.790769 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba6786-e96b-4ba9-9fb3-cd5ac7ad9b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:27.791042 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba6786-e96b-4ba9-9fb3-cd5ac7ad9b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:27.801090 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba6786-e96b-4ba9-9fb3-cd5ac7ad9b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:27.802573 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba6786-e96b-4ba9-9fb3-cd5ac7ad9b62 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:27.812666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1395/2821] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:07:28.274432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276ac98-918a-4e29-b706-ff27d24893f7 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:28.276137 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6276ac98-918a-4e29-b706-ff27d24893f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:28.291060 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276ac98-918a-4e29-b706-ff27d24893f7 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:28.293640 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a936f3-b110-4767-9598-548277642f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:28.295327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a936f3-b110-4767-9598-548277642f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:28.295327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a936f3-b110-4767-9598-548277642f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:28.295327 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a936f3-b110-4767-9598-548277642f4e admin admin] PATH_INFO: `/v3/projects/69d019fe283d42918c29fe2e8811ab5b` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:28.296565 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a936f3-b110-4767-9598-548277642f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=69d019fe283d42918c29fe2e8811ab5b)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:28.298889 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a936f3-b110-4767-9598-548277642f4e admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:28.475143 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-69a936f3-b110-4767-9598-548277642f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69d019fe283d42918c29fe2e8811ab5b', 'request_id': 'req-69a936f3-b110-4767-9598-548277642f4e'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:28.541567 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-69a936f3-b110-4767-9598-548277642f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69d019fe283d42918c29fe2e8811ab5b', 'request_id': 'req-69a936f3-b110-4767-9598-548277642f4e'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:28.549020 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-69a936f3-b110-4767-9598-548277642f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69d019fe283d42918c29fe2e8811ab5b', 'request_id': 'req-69a936f3-b110-4767-9598-548277642f4e'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:28.556786 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:28.562052 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-69a936f3-b110-4767-9598-548277642f4e admin admin] The token cache is being invalidate because project 69d019fe283d42918c29fe2e8811ab5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:07:28.562387 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-69a936f3-b110-4767-9598-548277642f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:28.563085 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-69a936f3-b110-4767-9598-548277642f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:28.565154 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1427/2822] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:07:28 2022] DELETE /identity/v3/projects/69d019fe283d42918c29fe2e8811ab5b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:28.569355 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba6786-e96b-4ba9-9fb3-cd5ac7ad9b62 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:28.579467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba6786-e96b-4ba9-9fb3-cd5ac7ad9b62 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:28.583152 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:28.639059 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df6ce2-60ca-4b1c-9db4-4225f4a45522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:28.639942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df6ce2-60ca-4b1c-9db4-4225f4a45522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:28.640225 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df6ce2-60ca-4b1c-9db4-4225f4a45522 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:28.640536 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df6ce2-60ca-4b1c-9db4-4225f4a45522 admin admin] PATH_INFO: `/v3/users/b6dd30582bca424c9a09a16bf9e2ce4e` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:28.641745 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df6ce2-60ca-4b1c-9db4-4225f4a45522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6dd30582bca424c9a09a16bf9e2ce4e)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:28.643696 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df6ce2-60ca-4b1c-9db4-4225f4a45522 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:28.869523 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-94df6ce2-60ca-4b1c-9db4-4225f4a45522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6dd30582bca424c9a09a16bf9e2ce4e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:28.870144 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-94df6ce2-60ca-4b1c-9db4-4225f4a45522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6dd30582bca424c9a09a16bf9e2ce4e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:28.956985 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-94df6ce2-60ca-4b1c-9db4-4225f4a45522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6dd30582bca424c9a09a16bf9e2ce4e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:28.966189 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-94df6ce2-60ca-4b1c-9db4-4225f4a45522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6dd30582bca424c9a09a16bf9e2ce4e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:28.978217 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-94df6ce2-60ca-4b1c-9db4-4225f4a45522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6dd30582bca424c9a09a16bf9e2ce4e'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:28.985109 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1396/2823] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:07:28 2022] DELETE /identity/v3/users/b6dd30582bca424c9a09a16bf9e2ce4e => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:29.406933 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a936f3-b110-4767-9598-548277642f4e admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:29.408531 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-69a936f3-b110-4767-9598-548277642f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:29.421935 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a936f3-b110-4767-9598-548277642f4e admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:29.488689 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d493c-01c9-491f-b2ae-f674e608abbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:29.489825 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d493c-01c9-491f-b2ae-f674e608abbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:29.490112 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d493c-01c9-491f-b2ae-f674e608abbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:29.490390 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d493c-01c9-491f-b2ae-f674e608abbc admin admin] PATH_INFO: `/v3/projects/84b528c3eec44b17895db080c98c57af` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:29.491645 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d493c-01c9-491f-b2ae-f674e608abbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=84b528c3eec44b17895db080c98c57af)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:29.493621 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d493c-01c9-491f-b2ae-f674e608abbc admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:29.627322 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-818d493c-01c9-491f-b2ae-f674e608abbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b528c3eec44b17895db080c98c57af', 'request_id': 'req-818d493c-01c9-491f-b2ae-f674e608abbc'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:29.747218 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-818d493c-01c9-491f-b2ae-f674e608abbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b528c3eec44b17895db080c98c57af', 'request_id': 'req-818d493c-01c9-491f-b2ae-f674e608abbc'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:29.755676 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-818d493c-01c9-491f-b2ae-f674e608abbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b528c3eec44b17895db080c98c57af', 'request_id': 'req-818d493c-01c9-491f-b2ae-f674e608abbc'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:29.767607 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-818d493c-01c9-491f-b2ae-f674e608abbc admin admin] The token cache is being invalidate because project 84b528c3eec44b17895db080c98c57af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:07:29.767899 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-818d493c-01c9-491f-b2ae-f674e608abbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:29.768595 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-818d493c-01c9-491f-b2ae-f674e608abbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:29.770183 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1428/2824] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:07:29 2022] DELETE /identity/v3/projects/84b528c3eec44b17895db080c98c57af => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:29.775237 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8787b35-2327-4653-8d53-ad74344e4d21 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:29.775755 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8787b35-2327-4653-8d53-ad74344e4d21 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:29.775874 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8787b35-2327-4653-8d53-ad74344e4d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:29.794962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-d8787b35-2327-4653-8d53-ad74344e4d21 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:29.796174 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-d8787b35-2327-4653-8d53-ad74344e4d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:29.862975 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1397/2825] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:29.871334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227395e-12be-41a6-b94f-bac13d181509 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:29.871624 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227395e-12be-41a6-b94f-bac13d181509 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:29.871902 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227395e-12be-41a6-b94f-bac13d181509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:29.890505 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-6227395e-12be-41a6-b94f-bac13d181509 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:29.891702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6227395e-12be-41a6-b94f-bac13d181509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:29.899552 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1429/2826] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:29.904329 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8787b35-2327-4653-8d53-ad74344e4d21 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:29.914335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8787b35-2327-4653-8d53-ad74344e4d21 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:29.918931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d345e-579e-497c-a8e6-515f929a7ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:29.919590 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d345e-579e-497c-a8e6-515f929a7ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:29.919880 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d345e-579e-497c-a8e6-515f929a7ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:29.920170 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d345e-579e-497c-a8e6-515f929a7ef5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:29.920940 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d345e-579e-497c-a8e6-515f929a7ef5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:07:29.921257 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d345e-579e-497c-a8e6-515f929a7ef5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:29.922855 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d345e-579e-497c-a8e6-515f929a7ef5 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:29.934523 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1398/2827] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 19:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 19:07:29.938806 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227395e-12be-41a6-b94f-bac13d181509 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:29.949795 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227395e-12be-41a6-b94f-bac13d181509 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:29.954497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b955d-2d2f-425b-8682-dc34801896fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:29.955160 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b955d-2d2f-425b-8682-dc34801896fd admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:29.955442 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b955d-2d2f-425b-8682-dc34801896fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:29.955717 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b955d-2d2f-425b-8682-dc34801896fd admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:29.956414 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b955d-2d2f-425b-8682-dc34801896fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:29.958343 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b955d-2d2f-425b-8682-dc34801896fd admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:30.029282 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1430/2828] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:07:29 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:07:30.033459 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d345e-579e-497c-a8e6-515f929a7ef5 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:30.044100 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d345e-579e-497c-a8e6-515f929a7ef5 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:30.054813 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:30.106985 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe0249-ca73-4db0-81ce-29a59e565610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:30.107666 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe0249-ca73-4db0-81ce-29a59e565610 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:30.107954 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe0249-ca73-4db0-81ce-29a59e565610 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:30.108231 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe0249-ca73-4db0-81ce-29a59e565610 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:30.108970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe0249-ca73-4db0-81ce-29a59e565610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:30.110932 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe0249-ca73-4db0-81ce-29a59e565610 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:30.176941 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1399/2829] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:07:30 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:07:30.181337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b955d-2d2f-425b-8682-dc34801896fd admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:30.192063 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b955d-2d2f-425b-8682-dc34801896fd admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:30.197823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9cb7e-ddaf-411f-94b5-70ad48433393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:30.197823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9cb7e-ddaf-411f-94b5-70ad48433393 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:30.197823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9cb7e-ddaf-411f-94b5-70ad48433393 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:30.197823 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9cb7e-ddaf-411f-94b5-70ad48433393 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:30.201854 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9cb7e-ddaf-411f-94b5-70ad48433393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:30.201854 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9cb7e-ddaf-411f-94b5-70ad48433393 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:30.212223 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1431/2830] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:07:30.217071 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe0249-ca73-4db0-81ce-29a59e565610 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:30.227549 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe0249-ca73-4db0-81ce-29a59e565610 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:30.232788 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcc57d-ba94-49f0-ac1d-bad636f0500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:30.233462 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcc57d-ba94-49f0-ac1d-bad636f0500f admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:30.233743 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcc57d-ba94-49f0-ac1d-bad636f0500f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:30.234019 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcc57d-ba94-49f0-ac1d-bad636f0500f admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:30.234880 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcc57d-ba94-49f0-ac1d-bad636f0500f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:30.236777 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcc57d-ba94-49f0-ac1d-bad636f0500f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:30.252964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1400/2831] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:07:30.257727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9cb7e-ddaf-411f-94b5-70ad48433393 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:30.269703 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9cb7e-ddaf-411f-94b5-70ad48433393 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:30.275923 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295fd0b-5fc3-49bf-bd26-2eb229546e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:30.276860 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295fd0b-5fc3-49bf-bd26-2eb229546e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:30.277154 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295fd0b-5fc3-49bf-bd26-2eb229546e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:30.277482 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295fd0b-5fc3-49bf-bd26-2eb229546e08 admin admin] PATH_INFO: `/v3/projects/21dc7e92af404bbbbe33f1345af4ff89/users/89090f2e30b74a77bba0cb4a1328d3ee/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:30.294859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295fd0b-5fc3-49bf-bd26-2eb229546e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21dc7e92af404bbbbe33f1345af4ff89, user_id=89090f2e30b74a77bba0cb4a1328d3ee, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:30.297507 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295fd0b-5fc3-49bf-bd26-2eb229546e08 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:30.381470 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1432/2832] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:07:30 2022] PUT /identity/v3/projects/21dc7e92af404bbbbe33f1345af4ff89/users/89090f2e30b74a77bba0cb4a1328d3ee/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:30.394553 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3147f-5554-4d1f-8f21-a8372d1a8e91 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:30.394842 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3147f-5554-4d1f-8f21-a8372d1a8e91 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:30.395211 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3147f-5554-4d1f-8f21-a8372d1a8e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:30.422749 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-55a3147f-5554-4d1f-8f21-a8372d1a8e91 None None] MFA Rules not processed for user `89090f2e30b74a77bba0cb4a1328d3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:30.423969 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-55a3147f-5554-4d1f-8f21-a8372d1a8e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:30.491889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1401/2833] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:30.497770 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295fd0b-5fc3-49bf-bd26-2eb229546e08 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:30.530665 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:30.566808 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295fd0b-5fc3-49bf-bd26-2eb229546e08 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:30.571552 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070f490-d152-48dc-81c6-351759314742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:30.574334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070f490-d152-48dc-81c6-351759314742 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:30.574334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070f490-d152-48dc-81c6-351759314742 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:30.574334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070f490-d152-48dc-81c6-351759314742 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:30.574334 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070f490-d152-48dc-81c6-351759314742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:30.575972 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070f490-d152-48dc-81c6-351759314742 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:30.657406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1433/2834] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:07:30 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:07:30.661484 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3147f-5554-4d1f-8f21-a8372d1a8e91 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:30.673155 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3147f-5554-4d1f-8f21-a8372d1a8e91 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:30.734084 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc5618-b1dc-4793-9435-095653ea1356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:30.734768 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc5618-b1dc-4793-9435-095653ea1356 admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:30.735054 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc5618-b1dc-4793-9435-095653ea1356 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:30.735332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc5618-b1dc-4793-9435-095653ea1356 admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:30.736045 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc5618-b1dc-4793-9435-095653ea1356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:30.738003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc5618-b1dc-4793-9435-095653ea1356 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:30.879098 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1402/2835] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:07:30 2022] POST /identity/v3/users => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:07:30.883478 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070f490-d152-48dc-81c6-351759314742 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:30.894048 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070f490-d152-48dc-81c6-351759314742 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:30.898648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d0e5a-5379-4727-8373-3a95d75a2df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:30.899367 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d0e5a-5379-4727-8373-3a95d75a2df9 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:30.899653 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d0e5a-5379-4727-8373-3a95d75a2df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:30.899931 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d0e5a-5379-4727-8373-3a95d75a2df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:30.900695 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d0e5a-5379-4727-8373-3a95d75a2df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:30.902289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d0e5a-5379-4727-8373-3a95d75a2df9 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:30.913386 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1434/2836] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:07:30.918058 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc5618-b1dc-4793-9435-095653ea1356 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:30.928428 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc5618-b1dc-4793-9435-095653ea1356 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:30.934896 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845138d0-a8d3-43d6-b3fb-a3ccae375dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:30.935970 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845138d0-a8d3-43d6-b3fb-a3ccae375dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:30.936408 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845138d0-a8d3-43d6-b3fb-a3ccae375dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:30.936839 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845138d0-a8d3-43d6-b3fb-a3ccae375dc4 admin admin] PATH_INFO: `/v3/projects/b63038542bb84a258a434513ebc9e060/users/092a175079f940e490ffb0a4881ef65b/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:30.946663 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:30.954002 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845138d0-a8d3-43d6-b3fb-a3ccae375dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63038542bb84a258a434513ebc9e060, user_id=092a175079f940e490ffb0a4881ef65b, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:30.959897 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845138d0-a8d3-43d6-b3fb-a3ccae375dc4 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:31.061511 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1403/2837] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:07:30 2022] PUT /identity/v3/projects/b63038542bb84a258a434513ebc9e060/users/092a175079f940e490ffb0a4881ef65b/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:31.065437 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d0e5a-5379-4727-8373-3a95d75a2df9 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:31.075497 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d0e5a-5379-4727-8373-3a95d75a2df9 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:31.135900 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ac1f0-f626-4932-900a-e3ab45ee2195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:31.136536 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ac1f0-f626-4932-900a-e3ab45ee2195 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:31.136829 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ac1f0-f626-4932-900a-e3ab45ee2195 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:31.137112 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ac1f0-f626-4932-900a-e3ab45ee2195 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:31.137851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ac1f0-f626-4932-900a-e3ab45ee2195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:31.139464 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ac1f0-f626-4932-900a-e3ab45ee2195 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:31.149459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1435/2838] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:07:31.154271 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845138d0-a8d3-43d6-b3fb-a3ccae375dc4 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:31.164710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845138d0-a8d3-43d6-b3fb-a3ccae375dc4 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:31.170004 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf26a3-4244-4458-9bb6-2da0afb2372a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:31.170889 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf26a3-4244-4458-9bb6-2da0afb2372a admin admin] REQUEST_METHOD: `PUT` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:31.171204 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf26a3-4244-4458-9bb6-2da0afb2372a admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:31.171483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf26a3-4244-4458-9bb6-2da0afb2372a admin admin] PATH_INFO: `/v3/projects/b63038542bb84a258a434513ebc9e060/users/092a175079f940e490ffb0a4881ef65b/roles/416a52031d5d49b6a3fa0e9baa814436` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:31.173501 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf26a3-4244-4458-9bb6-2da0afb2372a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63038542bb84a258a434513ebc9e060, user_id=092a175079f940e490ffb0a4881ef65b, role_id=416a52031d5d49b6a3fa0e9baa814436)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:31.176162 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf26a3-4244-4458-9bb6-2da0afb2372a admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:31.186331 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1404/2839] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:07:31 2022] PUT /identity/v3/projects/b63038542bb84a258a434513ebc9e060/users/092a175079f940e490ffb0a4881ef65b/roles/416a52031d5d49b6a3fa0e9baa814436 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:31.197577 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376591d-7fba-47e6-96fe-883ea8fb9f9d None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:31.197862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376591d-7fba-47e6-96fe-883ea8fb9f9d None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:31.198146 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376591d-7fba-47e6-96fe-883ea8fb9f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:31.229445 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-0376591d-7fba-47e6-96fe-883ea8fb9f9d None None] MFA Rules not processed for user `092a175079f940e490ffb0a4881ef65b`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:31.231209 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-0376591d-7fba-47e6-96fe-883ea8fb9f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:31.304767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1436/2840] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:31.316640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf26a3-4244-4458-9bb6-2da0afb2372a admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:31.318339 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-67bf26a3-4244-4458-9bb6-2da0afb2372a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:31.378703 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf26a3-4244-4458-9bb6-2da0afb2372a admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:31.382396 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30a788-3d30-4cc2-bde0-5e9de3f75ea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:31.383053 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30a788-3d30-4cc2-bde0-5e9de3f75ea0 service cinder] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:31.383344 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30a788-3d30-4cc2-bde0-5e9de3f75ea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:31.383627 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30a788-3d30-4cc2-bde0-5e9de3f75ea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:31.393539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30a788-3d30-4cc2-bde0-5e9de3f75ea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:31.395074 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30a788-3d30-4cc2-bde0-5e9de3f75ea0 service cinder] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:31.405337 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1405/2841] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:07:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:07:31.583862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376591d-7fba-47e6-96fe-883ea8fb9f9d None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:31.594308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376591d-7fba-47e6-96fe-883ea8fb9f9d None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:31.598054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca7dda-03a8-4f78-b23d-a44da55cf59b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:31.598758 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca7dda-03a8-4f78-b23d-a44da55cf59b service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:31.599044 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca7dda-03a8-4f78-b23d-a44da55cf59b service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:31.599328 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca7dda-03a8-4f78-b23d-a44da55cf59b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:31.622955 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:31.672613 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca7dda-03a8-4f78-b23d-a44da55cf59b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:31.674054 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca7dda-03a8-4f78-b23d-a44da55cf59b service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:31.684197 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1437/2842] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:07:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:07:32.138731 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30a788-3d30-4cc2-bde0-5e9de3f75ea0 service cinder] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:32.198923 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30a788-3d30-4cc2-bde0-5e9de3f75ea0 service cinder] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:32.203452 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abce321-4c46-420a-adb2-5a2fb46818cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:32.204315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abce321-4c46-420a-adb2-5a2fb46818cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:32.204633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abce321-4c46-420a-adb2-5a2fb46818cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:32.204912 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abce321-4c46-420a-adb2-5a2fb46818cf admin admin] PATH_INFO: `/v3/users/89090f2e30b74a77bba0cb4a1328d3ee` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:32.206086 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abce321-4c46-420a-adb2-5a2fb46818cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=89090f2e30b74a77bba0cb4a1328d3ee)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:32.207999 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abce321-4c46-420a-adb2-5a2fb46818cf admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:32.406415 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3abce321-4c46-420a-adb2-5a2fb46818cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89090f2e30b74a77bba0cb4a1328d3ee'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:32.407198 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3abce321-4c46-420a-adb2-5a2fb46818cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89090f2e30b74a77bba0cb4a1328d3ee'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:32.477799 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3abce321-4c46-420a-adb2-5a2fb46818cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89090f2e30b74a77bba0cb4a1328d3ee'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:32.489845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3abce321-4c46-420a-adb2-5a2fb46818cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89090f2e30b74a77bba0cb4a1328d3ee'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:32.498801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:32.500006 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-3abce321-4c46-420a-adb2-5a2fb46818cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89090f2e30b74a77bba0cb4a1328d3ee'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:32.506515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1406/2843] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:07:32 2022] DELETE /identity/v3/users/89090f2e30b74a77bba0cb4a1328d3ee => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:32.513876 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2899a2-c33d-44e9-ab04-8c4141eebf57 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:32.513876 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2899a2-c33d-44e9-ab04-8c4141eebf57 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:32.513876 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2899a2-c33d-44e9-ab04-8c4141eebf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:32.530363 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-6b2899a2-c33d-44e9-ab04-8c4141eebf57 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:32.531560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6b2899a2-c33d-44e9-ab04-8c4141eebf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:32.592727 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1438/2844] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:32.602635 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abce321-4c46-420a-adb2-5a2fb46818cf admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:32.604063 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-3abce321-4c46-420a-adb2-5a2fb46818cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:32.662767 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abce321-4c46-420a-adb2-5a2fb46818cf admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:32.666385 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59af2eb-cd05-46c9-b15d-c5fb2d0de7b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:32.667044 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59af2eb-cd05-46c9-b15d-c5fb2d0de7b7 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:32.667332 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59af2eb-cd05-46c9-b15d-c5fb2d0de7b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:32.667700 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59af2eb-cd05-46c9-b15d-c5fb2d0de7b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:32.677641 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59af2eb-cd05-46c9-b15d-c5fb2d0de7b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:32.679085 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59af2eb-cd05-46c9-b15d-c5fb2d0de7b7 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:32.688950 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1407/2845] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 19:07:33.387329 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2899a2-c33d-44e9-ab04-8c4141eebf57 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:33.388851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6b2899a2-c33d-44e9-ab04-8c4141eebf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:33.402688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2899a2-c33d-44e9-ab04-8c4141eebf57 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:33.408357 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30319759-aaba-4c34-9e33-1a7bd3942902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:33.409287 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30319759-aaba-4c34-9e33-1a7bd3942902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:33.409572 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30319759-aaba-4c34-9e33-1a7bd3942902 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:33.409853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30319759-aaba-4c34-9e33-1a7bd3942902 admin admin] PATH_INFO: `/v3/projects/21dc7e92af404bbbbe33f1345af4ff89` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:33.411091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30319759-aaba-4c34-9e33-1a7bd3942902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21dc7e92af404bbbbe33f1345af4ff89)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:33.414379 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30319759-aaba-4c34-9e33-1a7bd3942902 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:33.534219 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-30319759-aaba-4c34-9e33-1a7bd3942902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21dc7e92af404bbbbe33f1345af4ff89', 'request_id': 'req-30319759-aaba-4c34-9e33-1a7bd3942902'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:33.639665 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-30319759-aaba-4c34-9e33-1a7bd3942902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21dc7e92af404bbbbe33f1345af4ff89', 'request_id': 'req-30319759-aaba-4c34-9e33-1a7bd3942902'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:33.646859 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-30319759-aaba-4c34-9e33-1a7bd3942902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21dc7e92af404bbbbe33f1345af4ff89', 'request_id': 'req-30319759-aaba-4c34-9e33-1a7bd3942902'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:33.658969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-30319759-aaba-4c34-9e33-1a7bd3942902 admin admin] The token cache is being invalidate because project 21dc7e92af404bbbbe33f1345af4ff89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:07:33.659275 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-30319759-aaba-4c34-9e33-1a7bd3942902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:33.659925 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-30319759-aaba-4c34-9e33-1a7bd3942902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:33.661744 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1439/2846] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:07:33 2022] DELETE /identity/v3/projects/21dc7e92af404bbbbe33f1345af4ff89 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:33.667926 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59af2eb-cd05-46c9-b15d-c5fb2d0de7b7 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:33.678010 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59af2eb-cd05-46c9-b15d-c5fb2d0de7b7 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:33.735797 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc3e1e-4579-4682-ab12-beebbc701c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:33.736713 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc3e1e-4579-4682-ab12-beebbc701c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:33.737021 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc3e1e-4579-4682-ab12-beebbc701c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:33.737295 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc3e1e-4579-4682-ab12-beebbc701c6d admin admin] PATH_INFO: `/v3/users/092a175079f940e490ffb0a4881ef65b` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:33.738483 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc3e1e-4579-4682-ab12-beebbc701c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=092a175079f940e490ffb0a4881ef65b)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:33.740694 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc3e1e-4579-4682-ab12-beebbc701c6d admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:33.944024 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6ecc3e1e-4579-4682-ab12-beebbc701c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '092a175079f940e490ffb0a4881ef65b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:33.944640 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6ecc3e1e-4579-4682-ab12-beebbc701c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '092a175079f940e490ffb0a4881ef65b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:34.009203 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6ecc3e1e-4579-4682-ab12-beebbc701c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '092a175079f940e490ffb0a4881ef65b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:34.017055 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6ecc3e1e-4579-4682-ab12-beebbc701c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '092a175079f940e490ffb0a4881ef65b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:34.029577 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-6ecc3e1e-4579-4682-ab12-beebbc701c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '092a175079f940e490ffb0a4881ef65b'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:34.035956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1408/2847] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:07:33 2022] DELETE /identity/v3/users/092a175079f940e490ffb0a4881ef65b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:34.488131 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30319759-aaba-4c34-9e33-1a7bd3942902 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:34.491131 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-30319759-aaba-4c34-9e33-1a7bd3942902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:34.503244 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30319759-aaba-4c34-9e33-1a7bd3942902 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:34.549003 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:34.564013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53cc1b-b34e-4ab7-b764-1ad89c8fda8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:34.564988 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53cc1b-b34e-4ab7-b764-1ad89c8fda8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:34.565278 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53cc1b-b34e-4ab7-b764-1ad89c8fda8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:34.565591 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53cc1b-b34e-4ab7-b764-1ad89c8fda8c admin admin] PATH_INFO: `/v3/projects/b63038542bb84a258a434513ebc9e060` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:34.566786 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53cc1b-b34e-4ab7-b764-1ad89c8fda8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b63038542bb84a258a434513ebc9e060)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:34.568788 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53cc1b-b34e-4ab7-b764-1ad89c8fda8c admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:34.667235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-cd53cc1b-b34e-4ab7-b764-1ad89c8fda8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b63038542bb84a258a434513ebc9e060', 'request_id': 'req-cd53cc1b-b34e-4ab7-b764-1ad89c8fda8c'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:34.739853 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-cd53cc1b-b34e-4ab7-b764-1ad89c8fda8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b63038542bb84a258a434513ebc9e060', 'request_id': 'req-cd53cc1b-b34e-4ab7-b764-1ad89c8fda8c'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:34.747329 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-cd53cc1b-b34e-4ab7-b764-1ad89c8fda8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b63038542bb84a258a434513ebc9e060', 'request_id': 'req-cd53cc1b-b34e-4ab7-b764-1ad89c8fda8c'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:34.757976 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-cd53cc1b-b34e-4ab7-b764-1ad89c8fda8c admin admin] The token cache is being invalidate because project b63038542bb84a258a434513ebc9e060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:07:34.760190 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-cd53cc1b-b34e-4ab7-b764-1ad89c8fda8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:34.760190 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-cd53cc1b-b34e-4ab7-b764-1ad89c8fda8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:34.760532 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1440/2848] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:07:34 2022] DELETE /identity/v3/projects/b63038542bb84a258a434513ebc9e060 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:34.767250 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fb599-267a-4ff1-b394-037420b11f5a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:34.767813 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fb599-267a-4ff1-b394-037420b11f5a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:34.767813 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fb599-267a-4ff1-b394-037420b11f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:34.785718 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-828fb599-267a-4ff1-b394-037420b11f5a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:34.786942 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-828fb599-267a-4ff1-b394-037420b11f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:34.801182 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:34.852571 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1409/2849] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:34.860541 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cc1ea-3985-4014-b256-af36c2f64139 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:34.860833 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cc1ea-3985-4014-b256-af36c2f64139 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:34.861118 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cc1ea-3985-4014-b256-af36c2f64139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:34.882401 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-bf8cc1ea-3985-4014-b256-af36c2f64139 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:34.883663 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-bf8cc1ea-3985-4014-b256-af36c2f64139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:34.892328 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1441/2850] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:34.896683 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fb599-267a-4ff1-b394-037420b11f5a None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:34.906814 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fb599-267a-4ff1-b394-037420b11f5a None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:34.911347 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a133d8-e80d-4423-8ad0-867cfbaff6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:34.912004 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a133d8-e80d-4423-8ad0-867cfbaff6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:34.912287 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a133d8-e80d-4423-8ad0-867cfbaff6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:34.912672 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a133d8-e80d-4423-8ad0-867cfbaff6a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:34.913656 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a133d8-e80d-4423-8ad0-867cfbaff6a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:07:34.913792 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a133d8-e80d-4423-8ad0-867cfbaff6a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:34.915338 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a133d8-e80d-4423-8ad0-867cfbaff6a3 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:34.927531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1410/2851] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 19:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 19:07:34.931905 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cc1ea-3985-4014-b256-af36c2f64139 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:34.942024 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cc1ea-3985-4014-b256-af36c2f64139 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:34.946821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34e609-03f1-463a-aa50-878e2fcab71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:34.947485 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e609-03f1-463a-aa50-878e2fcab71d admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:34.947773 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e609-03f1-463a-aa50-878e2fcab71d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:34.948053 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e609-03f1-463a-aa50-878e2fcab71d admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:34.949383 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34e609-03f1-463a-aa50-878e2fcab71d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:34.951294 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34e609-03f1-463a-aa50-878e2fcab71d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:35.067782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1442/2852] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:07:34 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:07:35.071866 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a133d8-e80d-4423-8ad0-867cfbaff6a3 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:35.083494 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a133d8-e80d-4423-8ad0-867cfbaff6a3 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:35.140984 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346de41-8b6a-4263-8a91-81c732b775ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:35.141669 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346de41-8b6a-4263-8a91-81c732b775ae admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:35.141958 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346de41-8b6a-4263-8a91-81c732b775ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:35.142242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346de41-8b6a-4263-8a91-81c732b775ae admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:35.143003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346de41-8b6a-4263-8a91-81c732b775ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:35.144966 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346de41-8b6a-4263-8a91-81c732b775ae admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:35.267256 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1411/2853] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:07:35 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:07:35.271519 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34e609-03f1-463a-aa50-878e2fcab71d admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:35.283980 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34e609-03f1-463a-aa50-878e2fcab71d admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:35.288969 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a5721-24a8-49c1-93f8-80ae91af617d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:35.289665 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a5721-24a8-49c1-93f8-80ae91af617d admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:35.289951 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a5721-24a8-49c1-93f8-80ae91af617d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:35.290230 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a5721-24a8-49c1-93f8-80ae91af617d admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:35.290977 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a5721-24a8-49c1-93f8-80ae91af617d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:35.293235 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a5721-24a8-49c1-93f8-80ae91af617d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:35.304666 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1443/2854] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:07:35.310372 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346de41-8b6a-4263-8a91-81c732b775ae admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:35.322271 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346de41-8b6a-4263-8a91-81c732b775ae admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:35.326009 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6d515-0cf2-49d1-928f-195e8389250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:35.327912 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6d515-0cf2-49d1-928f-195e8389250f admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:35.327912 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6d515-0cf2-49d1-928f-195e8389250f admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:35.327912 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6d515-0cf2-49d1-928f-195e8389250f admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:35.328240 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6d515-0cf2-49d1-928f-195e8389250f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:35.329611 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6d515-0cf2-49d1-928f-195e8389250f admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:35.340267 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1412/2855] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:07:35.344662 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a5721-24a8-49c1-93f8-80ae91af617d admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:35.355610 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a5721-24a8-49c1-93f8-80ae91af617d admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:35.360455 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad3d4f-ffaa-4f1c-8128-bf4d0a5a1708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:35.361435 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad3d4f-ffaa-4f1c-8128-bf4d0a5a1708 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:35.361716 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad3d4f-ffaa-4f1c-8128-bf4d0a5a1708 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:35.361992 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad3d4f-ffaa-4f1c-8128-bf4d0a5a1708 admin admin] PATH_INFO: `/v3/projects/663e183924c7417d9a27a21690667c6e/users/b811de8f8db44f93991f29736c6882cf/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:35.378567 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad3d4f-ffaa-4f1c-8128-bf4d0a5a1708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=663e183924c7417d9a27a21690667c6e, user_id=b811de8f8db44f93991f29736c6882cf, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:35.381296 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad3d4f-ffaa-4f1c-8128-bf4d0a5a1708 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:35.450253 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1444/2856] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:07:35 2022] PUT /identity/v3/projects/663e183924c7417d9a27a21690667c6e/users/b811de8f8db44f93991f29736c6882cf/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 19:07:35.460916 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a77e5c-3665-44dd-bc42-7365f1cf1b95 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:35.461214 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a77e5c-3665-44dd-bc42-7365f1cf1b95 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:35.461502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a77e5c-3665-44dd-bc42-7365f1cf1b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:35.488748 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-e9a77e5c-3665-44dd-bc42-7365f1cf1b95 None None] MFA Rules not processed for user `b811de8f8db44f93991f29736c6882cf`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:35.490228 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-e9a77e5c-3665-44dd-bc42-7365f1cf1b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:35.558190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1413/2857] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:35.569413 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad3d4f-ffaa-4f1c-8128-bf4d0a5a1708 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:35.571117 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-11ad3d4f-ffaa-4f1c-8128-bf4d0a5a1708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:35.633175 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad3d4f-ffaa-4f1c-8128-bf4d0a5a1708 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:35.637105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777749b-1850-4b44-b08c-0650ea173b62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:35.637769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777749b-1850-4b44-b08c-0650ea173b62 service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:35.638059 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777749b-1850-4b44-b08c-0650ea173b62 service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:35.638340 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777749b-1850-4b44-b08c-0650ea173b62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:35.648966 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777749b-1850-4b44-b08c-0650ea173b62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:35.650622 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777749b-1850-4b44-b08c-0650ea173b62 service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:35.660590 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1445/2858] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:07:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:07:35.688839 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a77e5c-3665-44dd-bc42-7365f1cf1b95 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:35.704869 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:35.755201 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a77e5c-3665-44dd-bc42-7365f1cf1b95 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:35.759764 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ffd52-29b0-4fb2-9807-7e64f0f768bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:35.760669 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ffd52-29b0-4fb2-9807-7e64f0f768bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:35.760956 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ffd52-29b0-4fb2-9807-7e64f0f768bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:35.761256 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ffd52-29b0-4fb2-9807-7e64f0f768bd admin admin] PATH_INFO: `/v3/users/b811de8f8db44f93991f29736c6882cf` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:35.762472 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ffd52-29b0-4fb2-9807-7e64f0f768bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b811de8f8db44f93991f29736c6882cf)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:35.764397 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ffd52-29b0-4fb2-9807-7e64f0f768bd admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:35.949905 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c58ffd52-29b0-4fb2-9807-7e64f0f768bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b811de8f8db44f93991f29736c6882cf'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:35.950574 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c58ffd52-29b0-4fb2-9807-7e64f0f768bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b811de8f8db44f93991f29736c6882cf'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:36.032175 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c58ffd52-29b0-4fb2-9807-7e64f0f768bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b811de8f8db44f93991f29736c6882cf'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:36.044922 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c58ffd52-29b0-4fb2-9807-7e64f0f768bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b811de8f8db44f93991f29736c6882cf'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:36.057078 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-c58ffd52-29b0-4fb2-9807-7e64f0f768bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b811de8f8db44f93991f29736c6882cf'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:36.063482 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1414/2859] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:07:35 2022] DELETE /identity/v3/users/b811de8f8db44f93991f29736c6882cf => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:36.068018 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f3ecd-7e9c-4e78-a8cd-fcb25ebf77dc None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:36.068582 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f3ecd-7e9c-4e78-a8cd-fcb25ebf77dc None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:36.068683 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f3ecd-7e9c-4e78-a8cd-fcb25ebf77dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:36.087888 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-5d3f3ecd-7e9c-4e78-a8cd-fcb25ebf77dc None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:36.089791 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5d3f3ecd-7e9c-4e78-a8cd-fcb25ebf77dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:36.099321 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:36.149070 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1446/2860] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:36.159759 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ffd52-29b0-4fb2-9807-7e64f0f768bd admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:36.161197 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c58ffd52-29b0-4fb2-9807-7e64f0f768bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:36.221971 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ffd52-29b0-4fb2-9807-7e64f0f768bd admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:36.225914 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db34f2-687f-4545-8ba9-b08b4fe3d014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:36.226591 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db34f2-687f-4545-8ba9-b08b4fe3d014 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:36.226880 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db34f2-687f-4545-8ba9-b08b4fe3d014 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:36.227161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db34f2-687f-4545-8ba9-b08b4fe3d014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:36.237196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db34f2-687f-4545-8ba9-b08b4fe3d014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:36.238645 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db34f2-687f-4545-8ba9-b08b4fe3d014 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:36.250057 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1415/2861] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:07:36.662071 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f3ecd-7e9c-4e78-a8cd-fcb25ebf77dc None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:36.663546 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-5d3f3ecd-7e9c-4e78-a8cd-fcb25ebf77dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:36.677311 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f3ecd-7e9c-4e78-a8cd-fcb25ebf77dc None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:36.682121 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83452262-3fad-4279-bce0-c2cb335c842d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:36.683539 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83452262-3fad-4279-bce0-c2cb335c842d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:36.683833 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83452262-3fad-4279-bce0-c2cb335c842d admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:36.684105 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83452262-3fad-4279-bce0-c2cb335c842d admin admin] PATH_INFO: `/v3/projects/663e183924c7417d9a27a21690667c6e` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:36.685370 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83452262-3fad-4279-bce0-c2cb335c842d admin admin] RBAC: Authorizing `identity:delete_project(project_id=663e183924c7417d9a27a21690667c6e)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:36.687337 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83452262-3fad-4279-bce0-c2cb335c842d admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:36.793791 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-83452262-3fad-4279-bce0-c2cb335c842d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663e183924c7417d9a27a21690667c6e', 'request_id': 'req-83452262-3fad-4279-bce0-c2cb335c842d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:36.854606 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-83452262-3fad-4279-bce0-c2cb335c842d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663e183924c7417d9a27a21690667c6e', 'request_id': 'req-83452262-3fad-4279-bce0-c2cb335c842d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:36.861956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-83452262-3fad-4279-bce0-c2cb335c842d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663e183924c7417d9a27a21690667c6e', 'request_id': 'req-83452262-3fad-4279-bce0-c2cb335c842d'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:36.873389 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-83452262-3fad-4279-bce0-c2cb335c842d admin admin] The token cache is being invalidate because project 663e183924c7417d9a27a21690667c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:07:36.873688 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-83452262-3fad-4279-bce0-c2cb335c842d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:36.874332 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-83452262-3fad-4279-bce0-c2cb335c842d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:07:36.875897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1447/2862] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:07:36 2022] DELETE /identity/v3/projects/663e183924c7417d9a27a21690667c6e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:36.881173 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2d1f8-f746-49d5-8517-1d5f4a6c6078 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:36.881539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2d1f8-f746-49d5-8517-1d5f4a6c6078 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:36.881858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2d1f8-f746-49d5-8517-1d5f4a6c6078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:36.900504 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-bbc2d1f8-f746-49d5-8517-1d5f4a6c6078 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:36.905912 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-bbc2d1f8-f746-49d5-8517-1d5f4a6c6078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:36.933680 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:36.968983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1416/2863] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:07:37.033525 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ec6fd-1ce7-4dde-9792-7f4ade4a0d99 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:37.033802 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ec6fd-1ce7-4dde-9792-7f4ade4a0d99 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:37.034093 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ec6fd-1ce7-4dde-9792-7f4ade4a0d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:37.058477 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-8d3ec6fd-1ce7-4dde-9792-7f4ade4a0d99 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:37.059767 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-8d3ec6fd-1ce7-4dde-9792-7f4ade4a0d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:37.068919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1448/2864] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:37.073285 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2d1f8-f746-49d5-8517-1d5f4a6c6078 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:37.084386 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2d1f8-f746-49d5-8517-1d5f4a6c6078 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:37.089939 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7c6c4-1119-4677-a417-ee6b411426ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:37.090719 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7c6c4-1119-4677-a417-ee6b411426ef admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:37.091003 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7c6c4-1119-4677-a417-ee6b411426ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:37.091281 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7c6c4-1119-4677-a417-ee6b411426ef admin admin] PATH_INFO: `/v3/domains` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:37.092029 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7c6c4-1119-4677-a417-ee6b411426ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:07:37.092343 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7c6c4-1119-4677-a417-ee6b411426ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:37.094095 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7c6c4-1119-4677-a417-ee6b411426ef admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:37.107843 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1417/2865] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Jun 16 19:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 19:07:37.112257 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ec6fd-1ce7-4dde-9792-7f4ade4a0d99 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:37.122157 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ec6fd-1ce7-4dde-9792-7f4ade4a0d99 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:37.126897 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f1bdf-1766-4948-acd1-eb82ba80faa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:37.127554 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f1bdf-1766-4948-acd1-eb82ba80faa2 admin admin] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:37.127835 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f1bdf-1766-4948-acd1-eb82ba80faa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:37.128111 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f1bdf-1766-4948-acd1-eb82ba80faa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:37.128839 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f1bdf-1766-4948-acd1-eb82ba80faa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:37.130743 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f1bdf-1766-4948-acd1-eb82ba80faa2 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:37.215952 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1449/2866] 10.222.0.93 () {60 vars in 1152 bytes} [Thu Jun 16 19:07:37 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:07:37.220275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7c6c4-1119-4677-a417-ee6b411426ef admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:37.231269 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7c6c4-1119-4677-a417-ee6b411426ef admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:37.288344 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67e195-9854-4498-884e-7b672fd677da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:37.289055 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67e195-9854-4498-884e-7b672fd677da admin admin] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:37.289343 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67e195-9854-4498-884e-7b672fd677da admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:37.289623 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67e195-9854-4498-884e-7b672fd677da admin admin] PATH_INFO: `/v3/users` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:37.290335 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67e195-9854-4498-884e-7b672fd677da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:37.292802 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67e195-9854-4498-884e-7b672fd677da admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:37.410134 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1418/2867] 10.222.0.93 () {60 vars in 1143 bytes} [Thu Jun 16 19:07:37 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:07:37.414432 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f1bdf-1766-4948-acd1-eb82ba80faa2 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:37.425238 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f1bdf-1766-4948-acd1-eb82ba80faa2 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:37.429919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf6f7f-cfd0-4e9c-90cb-2f89457ac275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:37.430586 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf6f7f-cfd0-4e9c-90cb-2f89457ac275 admin admin] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:37.433573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf6f7f-cfd0-4e9c-90cb-2f89457ac275 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:37.433573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf6f7f-cfd0-4e9c-90cb-2f89457ac275 admin admin] PATH_INFO: `/v3/roles` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:37.433573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf6f7f-cfd0-4e9c-90cb-2f89457ac275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:37.433573 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf6f7f-cfd0-4e9c-90cb-2f89457ac275 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:37.444738 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1450/2868] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:07:37.449244 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67e195-9854-4498-884e-7b672fd677da admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:37.459389 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67e195-9854-4498-884e-7b672fd677da admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:37.464844 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafa2dc-2651-4cc0-a87d-fe645acd494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:37.465551 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafa2dc-2651-4cc0-a87d-fe645acd494b admin admin] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:37.465839 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafa2dc-2651-4cc0-a87d-fe645acd494b admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:37.466170 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafa2dc-2651-4cc0-a87d-fe645acd494b admin admin] PATH_INFO: `/v3/roles` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:37.466858 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffafa2dc-2651-4cc0-a87d-fe645acd494b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:37.468515 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffafa2dc-2651-4cc0-a87d-fe645acd494b admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:37.478856 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1419/2869] 10.222.0.93 () {58 vars in 1121 bytes} [Thu Jun 16 19:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:07:37.483907 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf6f7f-cfd0-4e9c-90cb-2f89457ac275 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:37.494923 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf6f7f-cfd0-4e9c-90cb-2f89457ac275 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:37.499560 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1512769-8c29-46da-a86c-c56edc7ca580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:37.500465 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1512769-8c29-46da-a86c-c56edc7ca580 admin admin] REQUEST_METHOD: `PUT` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:37.500760 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1512769-8c29-46da-a86c-c56edc7ca580 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:37.501035 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1512769-8c29-46da-a86c-c56edc7ca580 admin admin] PATH_INFO: `/v3/projects/fbbeb01c3bb04005bbb69df662918a19/users/66dfbf13662f4e70bb528a3b4436ce90/roles/34f07ea559bb44a6b3d81c7c1ff19bbc` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:37.516446 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1512769-8c29-46da-a86c-c56edc7ca580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbbeb01c3bb04005bbb69df662918a19, user_id=66dfbf13662f4e70bb528a3b4436ce90, role_id=34f07ea559bb44a6b3d81c7c1ff19bbc)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:37.519132 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1512769-8c29-46da-a86c-c56edc7ca580 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:37.586287 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1451/2870] 10.222.0.93 () {60 vars in 1482 bytes} [Thu Jun 16 19:07:37 2022] PUT /identity/v3/projects/fbbeb01c3bb04005bbb69df662918a19/users/66dfbf13662f4e70bb528a3b4436ce90/roles/34f07ea559bb44a6b3d81c7c1ff19bbc => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:07:37.596981 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7320c-933a-4b66-91d0-48f946b2426a None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:37.597276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7320c-933a-4b66-91d0-48f946b2426a None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:37.597564 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7320c-933a-4b66-91d0-48f946b2426a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:37.615935 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-63b7320c-933a-4b66-91d0-48f946b2426a None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:37.617198 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-63b7320c-933a-4b66-91d0-48f946b2426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:37.677807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1420/2871] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:37.687458 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1512769-8c29-46da-a86c-c56edc7ca580 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:37.689194 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-f1512769-8c29-46da-a86c-c56edc7ca580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:37.732158 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:37.757061 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1512769-8c29-46da-a86c-c56edc7ca580 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:37.760702 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92992a9d-590b-48d5-8deb-86e6c4499474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:37.761896 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92992a9d-590b-48d5-8deb-86e6c4499474 service neutron] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:37.762175 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92992a9d-590b-48d5-8deb-86e6c4499474 service neutron] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:37.762450 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92992a9d-590b-48d5-8deb-86e6c4499474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:37.772153 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92992a9d-590b-48d5-8deb-86e6c4499474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:37.773862 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92992a9d-590b-48d5-8deb-86e6c4499474 service neutron] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:37.784175 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1452/2872] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:07:39.306870 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd93eb-cad4-4560-ba7b-7acc99e15b55 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:39.307406 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd93eb-cad4-4560-ba7b-7acc99e15b55 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:39.307524 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd93eb-cad4-4560-ba7b-7acc99e15b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:39.341020 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-60bd93eb-cad4-4560-ba7b-7acc99e15b55 None None] MFA Rules not processed for user `66dfbf13662f4e70bb528a3b4436ce90`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:39.342837 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-60bd93eb-cad4-4560-ba7b-7acc99e15b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:39.379304 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:39.414633 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1421/2873] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:39.427907 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92992a9d-590b-48d5-8deb-86e6c4499474 service neutron] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:39.429414 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-92992a9d-590b-48d5-8deb-86e6c4499474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:39.487784 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92992a9d-590b-48d5-8deb-86e6c4499474 service neutron] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:39.491735 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ac629-c664-433e-a935-9d9a808fcd4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3862d73c187e403fb1e1ef4e1984cee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:39.492399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ac629-c664-433e-a935-9d9a808fcd4b service cinder] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:39.492712 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ac629-c664-433e-a935-9d9a808fcd4b service cinder] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:39.492994 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ac629-c664-433e-a935-9d9a808fcd4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:39.502185 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ac629-c664-433e-a935-9d9a808fcd4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:39.503629 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ac629-c664-433e-a935-9d9a808fcd4b service cinder] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:39.512758 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1453/2874] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:07:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:07:41.390684 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d2e67-3899-4cbb-b77d-c9fce63534c7 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:41.391242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d2e67-3899-4cbb-b77d-c9fce63534c7 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:41.391242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d2e67-3899-4cbb-b77d-c9fce63534c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:41.409477 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-f65d2e67-3899-4cbb-b77d-c9fce63534c7 None None] MFA Rules not processed for user `66dfbf13662f4e70bb528a3b4436ce90`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:07:41.410701 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f65d2e67-3899-4cbb-b77d-c9fce63534c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:41.417622 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1422/2875] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:07:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:07:42.076330 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ac629-c664-433e-a935-9d9a808fcd4b service cinder] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:42.077938 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-de8ac629-c664-433e-a935-9d9a808fcd4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:42.150571 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ac629-c664-433e-a935-9d9a808fcd4b service cinder] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:42.155620 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d3a87-a0b3-4ef8-8cf2-f4595e435bd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3abe1d47a1164776bf3a82fe4b129d9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:42.156279 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d3a87-a0b3-4ef8-8cf2-f4595e435bd1 service placement] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:42.156600 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d3a87-a0b3-4ef8-8cf2-f4595e435bd1 service placement] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:42.156883 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d3a87-a0b3-4ef8-8cf2-f4595e435bd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:42.158687 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-298d3a87-a0b3-4ef8-8cf2-f4595e435bd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:42.170602 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d3a87-a0b3-4ef8-8cf2-f4595e435bd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:42.172203 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d3a87-a0b3-4ef8-8cf2-f4595e435bd1 service placement] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:42.182166 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1454/2876] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:07:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:07:45.181131 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d2e67-3899-4cbb-b77d-c9fce63534c7 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:45.182610 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f65d2e67-3899-4cbb-b77d-c9fce63534c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:45.194543 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d2e67-3899-4cbb-b77d-c9fce63534c7 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:45.198723 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf378a-f178-4a00-9df7-9163097b0094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:45.206168 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf378a-f178-4a00-9df7-9163097b0094 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:45.206168 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf378a-f178-4a00-9df7-9163097b0094 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:45.206168 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf378a-f178-4a00-9df7-9163097b0094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:45.206168 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-a3bf378a-f178-4a00-9df7-9163097b0094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:45.211671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf378a-f178-4a00-9df7-9163097b0094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:45.213196 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf378a-f178-4a00-9df7-9163097b0094 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:45.222229 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1423/2877] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:07:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:07:51.338459 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d3a87-a0b3-4ef8-8cf2-f4595e435bd1 service placement] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:07:51.339940 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-298d3a87-a0b3-4ef8-8cf2-f4595e435bd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:51.411184 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d3a87-a0b3-4ef8-8cf2-f4595e435bd1 service placement] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:07:51.416598 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a022d-00f4-485d-a298-801894f423fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:07:51.417261 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a022d-00f4-485d-a298-801894f423fb service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:07:51.417546 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a022d-00f4-485d-a298-801894f423fb service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:07:51.417824 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a022d-00f4-485d-a298-801894f423fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:07:51.419687 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-fc9a022d-00f4-485d-a298-801894f423fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:07:51.428875 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=100 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:51.435728 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a022d-00f4-485d-a298-801894f423fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:07:51.435728 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a022d-00f4-485d-a298-801894f423fb service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:07:51.446533 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1455/2878] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:07:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:07:55.219288 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=22 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:01.539875 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=3 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:10.990250 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad28a53-a0a5-4e25-80a2-d3b3c65b9f38 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:10.990845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad28a53-a0a5-4e25-80a2-d3b3c65b9f38 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:10.990845 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad28a53-a0a5-4e25-80a2-d3b3c65b9f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:11.009467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-5ad28a53-a0a5-4e25-80a2-d3b3c65b9f38 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:08:11.010771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5ad28a53-a0a5-4e25-80a2-d3b3c65b9f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:08:11.019881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1424/2879] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 16 19:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:08:11.038821 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a022d-00f4-485d-a298-801894f423fb service nova] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:08:11.051294 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a022d-00f4-485d-a298-801894f423fb service nova] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:08:11.056687 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaa0a1-8a94-408a-a1fd-b665a27a1efc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:08:11.057399 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaa0a1-8a94-408a-a1fd-b665a27a1efc service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:11.057689 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaa0a1-8a94-408a-a1fd-b665a27a1efc service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:11.058257 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaa0a1-8a94-408a-a1fd-b665a27a1efc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:11.067377 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaa0a1-8a94-408a-a1fd-b665a27a1efc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:08:11.069154 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaa0a1-8a94-408a-a1fd-b665a27a1efc service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:08:11.079561 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1456/2880] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:08:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:08:11.637964 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad28a53-a0a5-4e25-80a2-d3b3c65b9f38 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:08:11.651258 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad28a53-a0a5-4e25-80a2-d3b3c65b9f38 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:08:11.657891 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d47418-0697-4621-b328-0e959bf5954b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:08:11.658618 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d47418-0697-4621-b328-0e959bf5954b service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:11.658987 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d47418-0697-4621-b328-0e959bf5954b service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:11.659248 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d47418-0697-4621-b328-0e959bf5954b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:11.661229 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-69d47418-0697-4621-b328-0e959bf5954b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:08:11.675708 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d47418-0697-4621-b328-0e959bf5954b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:08:11.677502 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d47418-0697-4621-b328-0e959bf5954b service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:08:11.691084 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1425/2881] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:08:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:08:16.264678 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4460d-972a-4f72-ad05-117102af7d2e None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:16.265249 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4460d-972a-4f72-ad05-117102af7d2e None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:16.265249 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4460d-972a-4f72-ad05-117102af7d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:16.284713 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-9ac4460d-972a-4f72-ad05-117102af7d2e None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:08:16.285935 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-9ac4460d-972a-4f72-ad05-117102af7d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:08:16.294450 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1457/2882] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 16 19:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:08:16.308607 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d47418-0697-4621-b328-0e959bf5954b service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:08:16.310250 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-69d47418-0697-4621-b328-0e959bf5954b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:08:16.325608 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d47418-0697-4621-b328-0e959bf5954b service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:08:16.331729 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4418c-c455-4df4-858a-1386664eae41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:08:16.332376 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4418c-c455-4df4-858a-1386664eae41 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:16.332710 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4418c-c455-4df4-858a-1386664eae41 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:16.332979 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4418c-c455-4df4-858a-1386664eae41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:16.341531 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4418c-c455-4df4-858a-1386664eae41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:08:16.343115 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4418c-c455-4df4-858a-1386664eae41 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:08:16.353881 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1426/2883] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:08:19.851761 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2af62a-1b7b-462a-a7fd-946918aeb0e7 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:19.852350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2af62a-1b7b-462a-a7fd-946918aeb0e7 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:19.852350 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2af62a-1b7b-462a-a7fd-946918aeb0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:19.872669 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-6a2af62a-1b7b-462a-a7fd-946918aeb0e7 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:08:19.873919 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6a2af62a-1b7b-462a-a7fd-946918aeb0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:08:19.882489 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1458/2884] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 16 19:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:08:19.897378 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4418c-c455-4df4-858a-1386664eae41 service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:08:19.909649 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4418c-c455-4df4-858a-1386664eae41 service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:08:19.915315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e48956-8d79-4f91-94f0-2f03c2f31aae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:08:19.916025 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e48956-8d79-4f91-94f0-2f03c2f31aae service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:19.916473 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e48956-8d79-4f91-94f0-2f03c2f31aae service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:19.916804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e48956-8d79-4f91-94f0-2f03c2f31aae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:19.925820 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e48956-8d79-4f91-94f0-2f03c2f31aae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:08:19.927468 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e48956-8d79-4f91-94f0-2f03c2f31aae service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:08:19.939668 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1427/2885] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:08:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:08:21.530202 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2af62a-1b7b-462a-a7fd-946918aeb0e7 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:08:21.543295 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2af62a-1b7b-462a-a7fd-946918aeb0e7 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:08:21.549750 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81bc7c-b425-46ee-aac9-e2933c2fa67c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3abe1d47a1164776bf3a82fe4b129d9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:08:21.550456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81bc7c-b425-46ee-aac9-e2933c2fa67c service placement] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:21.550769 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81bc7c-b425-46ee-aac9-e2933c2fa67c service placement] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:21.551056 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81bc7c-b425-46ee-aac9-e2933c2fa67c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:21.553043 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-3d81bc7c-b425-46ee-aac9-e2933c2fa67c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:08:21.566164 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81bc7c-b425-46ee-aac9-e2933c2fa67c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:08:21.567857 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81bc7c-b425-46ee-aac9-e2933c2fa67c service placement] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:08:21.582411 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1459/2886] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:08:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:08:22.836341 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16878da4-c0ec-4d68-842b-312984597467 None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:22.836922 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16878da4-c0ec-4d68-842b-312984597467 None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:22.837182 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16878da4-c0ec-4d68-842b-312984597467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:22.856039 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-16878da4-c0ec-4d68-842b-312984597467 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:08:22.857299 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-16878da4-c0ec-4d68-842b-312984597467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:08:22.865467 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1428/2887] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 16 19:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:08:22.883413 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81bc7c-b425-46ee-aac9-e2933c2fa67c service placement] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:08:22.892986 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81bc7c-b425-46ee-aac9-e2933c2fa67c service placement] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:08:22.898502 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a3609-1055-48af-a7a1-65307fe396fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:08:22.899161 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a3609-1055-48af-a7a1-65307fe396fb service nova] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:22.899445 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a3609-1055-48af-a7a1-65307fe396fb service nova] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:22.899731 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a3609-1055-48af-a7a1-65307fe396fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:22.912091 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a3609-1055-48af-a7a1-65307fe396fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:08:22.914066 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a3609-1055-48af-a7a1-65307fe396fb service nova] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:08:22.925024 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1460/2888] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:08:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:08:25.554193 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16878da4-c0ec-4d68-842b-312984597467 None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:08:25.556459 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-16878da4-c0ec-4d68-842b-312984597467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:08:25.569854 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16878da4-c0ec-4d68-842b-312984597467 None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:08:25.575082 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589d535-43ab-4395-8315-0aed63e135ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:08:25.576096 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589d535-43ab-4395-8315-0aed63e135ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:25.576527 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589d535-43ab-4395-8315-0aed63e135ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:25.582771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589d535-43ab-4395-8315-0aed63e135ba admin admin] PATH_INFO: `/v3/users/bb055af2fca84739a7b5d3b373ab7298` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:25.582771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589d535-43ab-4395-8315-0aed63e135ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb055af2fca84739a7b5d3b373ab7298)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:08:25.582771 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589d535-43ab-4395-8315-0aed63e135ba admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:08:25.749150 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7589d535-43ab-4395-8315-0aed63e135ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb055af2fca84739a7b5d3b373ab7298'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:25.749811 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7589d535-43ab-4395-8315-0aed63e135ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb055af2fca84739a7b5d3b373ab7298'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:25.821326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7589d535-43ab-4395-8315-0aed63e135ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb055af2fca84739a7b5d3b373ab7298'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:25.828780 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7589d535-43ab-4395-8315-0aed63e135ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb055af2fca84739a7b5d3b373ab7298'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:25.841350 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-7589d535-43ab-4395-8315-0aed63e135ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb055af2fca84739a7b5d3b373ab7298'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:25.847818 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1429/2889] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:08:25 2022] DELETE /identity/v3/users/bb055af2fca84739a7b5d3b373ab7298 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:08:26.092782 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a3609-1055-48af-a7a1-65307fe396fb service nova] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:08:26.094807 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f67f8-ba55-4888-a663-e67d17637b2d None None] REQUEST_METHOD: `POST` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:26.095100 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f67f8-ba55-4888-a663-e67d17637b2d None None] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:26.095427 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f67f8-ba55-4888-a663-e67d17637b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:26.107243 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a3609-1055-48af-a7a1-65307fe396fb service nova] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:08:26.115420 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.auth.core [None req-c63f67f8-ba55-4888-a663-e67d17637b2d None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:08:26.116682 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c63f67f8-ba55-4888-a663-e67d17637b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:08:26.173182 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1dafc3-052e-4db9-b8a3-1e416bdb08a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:08:26.174305 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dafc3-052e-4db9-b8a3-1e416bdb08a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:26.174585 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dafc3-052e-4db9-b8a3-1e416bdb08a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:26.174861 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dafc3-052e-4db9-b8a3-1e416bdb08a8 admin admin] PATH_INFO: `/v3/projects/7d0c0f17da8d483ca0a26da401a20029` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:26.176063 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1dafc3-052e-4db9-b8a3-1e416bdb08a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d0c0f17da8d483ca0a26da401a20029)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:08:26.178170 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1dafc3-052e-4db9-b8a3-1e416bdb08a8 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:08:26.184776 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1430/2890] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 16 19:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:08:26.199791 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f67f8-ba55-4888-a663-e67d17637b2d None None] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:08:26.201291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-c63f67f8-ba55-4888-a663-e67d17637b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:08:26.223521 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:26.286764 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f67f8-ba55-4888-a663-e67d17637b2d None None] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:08:26.295947 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ca1dafc3-052e-4db9-b8a3-1e416bdb08a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d0c0f17da8d483ca0a26da401a20029', 'request_id': 'req-ca1dafc3-052e-4db9-b8a3-1e416bdb08a8'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:26.349607 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff67bd0-9779-4aa8-8396-1d402805d598 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:08:26.350188 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff67bd0-9779-4aa8-8396-1d402805d598 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:26.350475 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff67bd0-9779-4aa8-8396-1d402805d598 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:26.350758 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff67bd0-9779-4aa8-8396-1d402805d598 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:26.358308 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ca1dafc3-052e-4db9-b8a3-1e416bdb08a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d0c0f17da8d483ca0a26da401a20029', 'request_id': 'req-ca1dafc3-052e-4db9-b8a3-1e416bdb08a8'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:26.366042 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ca1dafc3-052e-4db9-b8a3-1e416bdb08a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d0c0f17da8d483ca0a26da401a20029', 'request_id': 'req-ca1dafc3-052e-4db9-b8a3-1e416bdb08a8'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:26.377511 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ca1dafc3-052e-4db9-b8a3-1e416bdb08a8 admin admin] The token cache is being invalidate because project 7d0c0f17da8d483ca0a26da401a20029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:08:26.381979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ca1dafc3-052e-4db9-b8a3-1e416bdb08a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:26.381979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-ca1dafc3-052e-4db9-b8a3-1e416bdb08a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:26.381979 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1461/2891] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:08:26 2022] DELETE /identity/v3/projects/7d0c0f17da8d483ca0a26da401a20029 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:08:26.383836 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1dafc3-052e-4db9-b8a3-1e416bdb08a8 admin admin] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:08:26.385184 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-ca1dafc3-052e-4db9-b8a3-1e416bdb08a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:08:26.413477 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff67bd0-9779-4aa8-8396-1d402805d598 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:08:26.415373 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff67bd0-9779-4aa8-8396-1d402805d598 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:08:26.425996 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1431/2892] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:08:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 19:08:26.432209 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:26.455637 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1dafc3-052e-4db9-b8a3-1e416bdb08a8 admin admin] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:08:26.461192 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7376a1-5419-41f2-9242-15f84159499f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:08:26.462217 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7376a1-5419-41f2-9242-15f84159499f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:26.463001 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7376a1-5419-41f2-9242-15f84159499f admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:26.463277 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7376a1-5419-41f2-9242-15f84159499f admin admin] PATH_INFO: `/v3/users/23c87dc079524a6db26f600f42d8892b` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:26.464693 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7376a1-5419-41f2-9242-15f84159499f admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c87dc079524a6db26f600f42d8892b)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:08:26.466626 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7376a1-5419-41f2-9242-15f84159499f admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:08:26.646406 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-5f7376a1-5419-41f2-9242-15f84159499f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c87dc079524a6db26f600f42d8892b'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:26.647098 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-5f7376a1-5419-41f2-9242-15f84159499f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c87dc079524a6db26f600f42d8892b'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:26.714851 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-5f7376a1-5419-41f2-9242-15f84159499f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c87dc079524a6db26f600f42d8892b'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:26.722976 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-5f7376a1-5419-41f2-9242-15f84159499f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c87dc079524a6db26f600f42d8892b'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:26.723690 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-5f7376a1-5419-41f2-9242-15f84159499f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c87dc079524a6db26f600f42d8892b'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:26.741186 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1462/2893] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:08:26 2022] DELETE /identity/v3/users/23c87dc079524a6db26f600f42d8892b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 19:08:27.000730 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff67bd0-9779-4aa8-8396-1d402805d598 service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:08:27.002872 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-dff67bd0-9779-4aa8-8396-1d402805d598 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:08:27.018334 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff67bd0-9779-4aa8-8396-1d402805d598 service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:08:27.066707 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=100 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:27.076609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049aa0bb-8a38-475b-a020-bff242ca65e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:08:27.077673 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049aa0bb-8a38-475b-a020-bff242ca65e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:27.077895 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049aa0bb-8a38-475b-a020-bff242ca65e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:27.078180 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049aa0bb-8a38-475b-a020-bff242ca65e3 admin admin] PATH_INFO: `/v3/projects/90fd4e9cf07242acaa01c103b5fb858c` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:27.079375 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049aa0bb-8a38-475b-a020-bff242ca65e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90fd4e9cf07242acaa01c103b5fb858c)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:08:27.081381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049aa0bb-8a38-475b-a020-bff242ca65e3 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:08:27.216919 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-049aa0bb-8a38-475b-a020-bff242ca65e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90fd4e9cf07242acaa01c103b5fb858c', 'request_id': 'req-049aa0bb-8a38-475b-a020-bff242ca65e3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:27.222931 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-049aa0bb-8a38-475b-a020-bff242ca65e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90fd4e9cf07242acaa01c103b5fb858c', 'request_id': 'req-049aa0bb-8a38-475b-a020-bff242ca65e3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:27.228973 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-049aa0bb-8a38-475b-a020-bff242ca65e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90fd4e9cf07242acaa01c103b5fb858c', 'request_id': 'req-049aa0bb-8a38-475b-a020-bff242ca65e3'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:27.330823 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-049aa0bb-8a38-475b-a020-bff242ca65e3 admin admin] The token cache is being invalidate because project 90fd4e9cf07242acaa01c103b5fb858c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:08:27.331120 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-049aa0bb-8a38-475b-a020-bff242ca65e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:27.331770 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-049aa0bb-8a38-475b-a020-bff242ca65e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:08:27.333381 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1432/2894] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:08:26 2022] DELETE /identity/v3/projects/90fd4e9cf07242acaa01c103b5fb858c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:08:29.364707 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19463a-3dd8-4172-9576-a0748641ba15 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:29.365200 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19463a-3dd8-4172-9576-a0748641ba15 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:29.365310 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19463a-3dd8-4172-9576-a0748641ba15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:29.385628 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-6f19463a-3dd8-4172-9576-a0748641ba15 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:08:29.386822 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6f19463a-3dd8-4172-9576-a0748641ba15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:08:29.444949 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1463/2895] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 16 19:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:08:29.465477 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049aa0bb-8a38-475b-a020-bff242ca65e3 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:08:29.472714 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-049aa0bb-8a38-475b-a020-bff242ca65e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:08:29.544156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049aa0bb-8a38-475b-a020-bff242ca65e3 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:08:29.549993 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce8106-44d0-4034-9cc0-133eafed5d0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:08:29.550660 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce8106-44d0-4034-9cc0-133eafed5d0c service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:29.550953 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce8106-44d0-4034-9cc0-133eafed5d0c service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:29.551315 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce8106-44d0-4034-9cc0-133eafed5d0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:29.560281 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce8106-44d0-4034-9cc0-133eafed5d0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:08:29.561913 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce8106-44d0-4034-9cc0-133eafed5d0c service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:08:29.571659 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1433/2896] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:08:39.437449 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=63,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:39.567276 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=62,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:45.458635 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55295ff2-2aba-4a11-857b-01d4011ef98d None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:45.459133 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55295ff2-2aba-4a11-857b-01d4011ef98d None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:45.459249 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55295ff2-2aba-4a11-857b-01d4011ef98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:45.476780 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-55295ff2-2aba-4a11-857b-01d4011ef98d None None] MFA Rules not processed for user `66dfbf13662f4e70bb528a3b4436ce90`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:08:45.478013 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-55295ff2-2aba-4a11-857b-01d4011ef98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:08:45.533192 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1464/2897] 10.222.0.93 () {58 vars in 957 bytes} [Thu Jun 16 19:08:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:08:45.764507 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce8106-44d0-4034-9cc0-133eafed5d0c service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:08:45.765949 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-01ce8106-44d0-4034-9cc0-133eafed5d0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:08:45.822522 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce8106-44d0-4034-9cc0-133eafed5d0c service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:08:45.826029 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff5add-8171-44f9-ab02-a9e47e870dd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '753728a82bdb406892015f8373932ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:08:45.826671 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff5add-8171-44f9-ab02-a9e47e870dd1 service neutron] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:08:45.826954 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff5add-8171-44f9-ab02-a9e47e870dd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:08:45.827229 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff5add-8171-44f9-ab02-a9e47e870dd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:08:45.829156 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-5cff5add-8171-44f9-ab02-a9e47e870dd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:08:45.838589 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff5add-8171-44f9-ab02-a9e47e870dd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:08:45.840026 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff5add-8171-44f9-ab02-a9e47e870dd1 service neutron] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:08:45.847873 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1434/2898] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:08:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:08:55.526580 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=25 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:55.844320 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=26 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:09:01.781935 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761f3d6-5eb0-49ba-880e-56236b83928e None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:09:01.782562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761f3d6-5eb0-49ba-880e-56236b83928e None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:09:01.782562 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761f3d6-5eb0-49ba-880e-56236b83928e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:09:01.850015 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-6761f3d6-5eb0-49ba-880e-56236b83928e None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:09:01.851214 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6761f3d6-5eb0-49ba-880e-56236b83928e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:09:01.901336 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1465/2899] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 16 19:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:09:01.915350 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff5add-8171-44f9-ab02-a9e47e870dd1 service neutron] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:09:01.938092 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff5add-8171-44f9-ab02-a9e47e870dd1 service neutron] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:09:01.943575 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad83efd-6792-48b2-9030-93436ce5b7c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:09:01.944211 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad83efd-6792-48b2-9030-93436ce5b7c9 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:09:01.944529 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad83efd-6792-48b2-9030-93436ce5b7c9 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:09:01.944804 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad83efd-6792-48b2-9030-93436ce5b7c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:09:01.953291 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad83efd-6792-48b2-9030-93436ce5b7c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:09:01.954885 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad83efd-6792-48b2-9030-93436ce5b7c9 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:09:01.965147 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1435/2900] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:09:05.245571 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7a33b-3717-4ee5-b31a-d44e6cfd522d None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:09:05.246318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7a33b-3717-4ee5-b31a-d44e6cfd522d None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:09:05.246318 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7a33b-3717-4ee5-b31a-d44e6cfd522d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:09:05.265083 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-1ad7a33b-3717-4ee5-b31a-d44e6cfd522d None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:09:05.266289 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-1ad7a33b-3717-4ee5-b31a-d44e6cfd522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:09:05.274310 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1466/2901] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 16 19:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:09:05.291401 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad83efd-6792-48b2-9030-93436ce5b7c9 service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:09:05.292799 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-fad83efd-6792-48b2-9030-93436ce5b7c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:09:05.317609 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad83efd-6792-48b2-9030-93436ce5b7c9 service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:09:05.323698 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680022e-62fe-46d7-ba04-37177e40457e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:09:05.324348 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680022e-62fe-46d7-ba04-37177e40457e service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:09:05.324667 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680022e-62fe-46d7-ba04-37177e40457e service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:09:05.324952 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680022e-62fe-46d7-ba04-37177e40457e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:09:05.333059 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680022e-62fe-46d7-ba04-37177e40457e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:09:05.334631 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680022e-62fe-46d7-ba04-37177e40457e service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:09:05.344245 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1436/2902] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:09:08.110878 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace36df-6482-418e-a09b-9846ca3e2da3 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:09:08.111376 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace36df-6482-418e-a09b-9846ca3e2da3 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:09:08.111484 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace36df-6482-418e-a09b-9846ca3e2da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:09:08.129564 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-dace36df-6482-418e-a09b-9846ca3e2da3 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:09:08.130811 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-dace36df-6482-418e-a09b-9846ca3e2da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:09:08.138737 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1467/2903] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 16 19:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:09:08.154151 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680022e-62fe-46d7-ba04-37177e40457e service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:09:08.166146 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680022e-62fe-46d7-ba04-37177e40457e service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:09:08.171838 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2bd7e-954b-4b78-b338-527e8fda84e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:09:08.172509 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2bd7e-954b-4b78-b338-527e8fda84e9 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:09:08.172801 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2bd7e-954b-4b78-b338-527e8fda84e9 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:09:08.173083 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2bd7e-954b-4b78-b338-527e8fda84e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:09:08.181446 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2bd7e-954b-4b78-b338-527e8fda84e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:09:08.182992 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2bd7e-954b-4b78-b338-527e8fda84e9 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:09:08.192857 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1437/2904] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:09:11.354433 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb66ce-f723-4480-b259-a9c99f1f85f5 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:09:11.354932 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb66ce-f723-4480-b259-a9c99f1f85f5 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:09:11.355031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb66ce-f723-4480-b259-a9c99f1f85f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:09:11.372886 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-2dbb66ce-f723-4480-b259-a9c99f1f85f5 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:09:11.374080 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-2dbb66ce-f723-4480-b259-a9c99f1f85f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:09:11.382648 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1468/2905] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 16 19:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:09:11.400043 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2bd7e-954b-4b78-b338-527e8fda84e9 service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:09:11.411875 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2bd7e-954b-4b78-b338-527e8fda84e9 service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:09:11.418601 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e91ad-5e51-419c-9e88-d1229f09c919 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:09:11.419242 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e91ad-5e51-419c-9e88-d1229f09c919 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:09:11.419525 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e91ad-5e51-419c-9e88-d1229f09c919 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:09:11.419799 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e91ad-5e51-419c-9e88-d1229f09c919 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:09:11.438748 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e91ad-5e51-419c-9e88-d1229f09c919 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:09:11.438748 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e91ad-5e51-419c-9e88-d1229f09c919 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:09:11.439764 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1438/2906] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:09:14.585872 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84e5c2-34ea-4c70-8a31-881d4d1c76d9 None None] REQUEST_METHOD: `POST` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:09:14.586346 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84e5c2-34ea-4c70-8a31-881d4d1c76d9 None None] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:09:14.586457 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84e5c2-34ea-4c70-8a31-881d4d1c76d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:09:14.604800 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.auth.core [None req-6c84e5c2-34ea-4c70-8a31-881d4d1c76d9 None None] MFA Rules not processed for user `69ed26b6c8d84d67907abcc6c154b3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86943) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:09:14.606619 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6c84e5c2-34ea-4c70-8a31-881d4d1c76d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:09:14.614877 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1469/2907] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Jun 16 19:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:09:14.631193 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e91ad-5e51-419c-9e88-d1229f09c919 service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:09:14.642398 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e91ad-5e51-419c-9e88-d1229f09c919 service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:09:14.647929 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07df8b4-8052-4729-95ec-096644a66448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3503ec98bea14693a17a84e686586bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:09:14.648599 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07df8b4-8052-4729-95ec-096644a66448 service nova] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:09:14.648884 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07df8b4-8052-4729-95ec-096644a66448 service nova] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:09:14.649161 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07df8b4-8052-4729-95ec-096644a66448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:09:14.657329 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07df8b4-8052-4729-95ec-096644a66448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:09:14.658892 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07df8b4-8052-4729-95ec-096644a66448 service nova] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:09:14.668821 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1439/2908] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:09:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:09:24.599142 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=53 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:09:24.664015 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=39 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:09:45.916592 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84e5c2-34ea-4c70-8a31-881d4d1c76d9 None None] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:09:45.918002 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-6c84e5c2-34ea-4c70-8a31-881d4d1c76d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:09:45.988456 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84e5c2-34ea-4c70-8a31-881d4d1c76d9 None None] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:09:45.993537 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fef235-e481-49c8-89f6-6cc10751a252 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3abe1d47a1164776bf3a82fe4b129d9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:09:45.995982 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fef235-e481-49c8-89f6-6cc10751a252 service placement] REQUEST_METHOD: `GET` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:09:45.995982 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fef235-e481-49c8-89f6-6cc10751a252 service placement] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:09:45.995982 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fef235-e481-49c8-89f6-6cc10751a252 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:09:45.996554 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.fernet_utils [None req-53fef235-e481-49c8-89f6-6cc10751a252 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86943) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:09:46.008956 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fef235-e481-49c8-89f6-6cc10751a252 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:09:46.010607 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fef235-e481-49c8-89f6-6cc10751a252 service placement] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:09:46.021228 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1470/2909] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:09:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:09:46.052365 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07df8b4-8052-4729-95ec-096644a66448 service nova] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:09:46.053863 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-f07df8b4-8052-4729-95ec-096644a66448 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:09:46.067362 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07df8b4-8052-4729-95ec-096644a66448 service nova] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:09:46.072275 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4577a-0e7d-480a-9c8e-41b5199726b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:09:46.073190 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4577a-0e7d-480a-9c8e-41b5199726b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:09:46.073477 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4577a-0e7d-480a-9c8e-41b5199726b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:09:46.073757 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4577a-0e7d-480a-9c8e-41b5199726b6 admin admin] PATH_INFO: `/v3/users/66dfbf13662f4e70bb528a3b4436ce90` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:09:46.074959 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4577a-0e7d-480a-9c8e-41b5199726b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66dfbf13662f4e70bb528a3b4436ce90)` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:09:46.076922 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4577a-0e7d-480a-9c8e-41b5199726b6 admin admin] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:09:46.276521 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-cdf4577a-0e7d-480a-9c8e-41b5199726b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66dfbf13662f4e70bb528a3b4436ce90'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:09:46.277187 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-cdf4577a-0e7d-480a-9c8e-41b5199726b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66dfbf13662f4e70bb528a3b4436ce90'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:09:46.348533 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-cdf4577a-0e7d-480a-9c8e-41b5199726b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66dfbf13662f4e70bb528a3b4436ce90'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:09:46.355846 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-cdf4577a-0e7d-480a-9c8e-41b5199726b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66dfbf13662f4e70bb528a3b4436ce90'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:09:46.371962 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.notifications [None req-cdf4577a-0e7d-480a-9c8e-41b5199726b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66dfbf13662f4e70bb528a3b4436ce90'} {{(pid=86942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:09:46.378016 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1440/2910] 10.222.0.93 () {58 vars in 1223 bytes} [Thu Jun 16 19:09:46 2022] DELETE /identity/v3/users/66dfbf13662f4e70bb528a3b4436ce90 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:09:46.638220 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fef235-e481-49c8-89f6-6cc10751a252 service placement] Authenticating user token {{(pid=86943) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:09:46.648216 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fef235-e481-49c8-89f6-6cc10751a252 service placement] Validating token access rules against request {{(pid=86943) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:09:46.713468 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b65c88-0397-4749-877a-61009f6d0080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69ed26b6c8d84d67907abcc6c154b3a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '698d167bbea646fcaa71cda553a9912f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86943) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:09:46.714339 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b65c88-0397-4749-877a-61009f6d0080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:09:46.714654 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b65c88-0397-4749-877a-61009f6d0080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:09:46.714935 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b65c88-0397-4749-877a-61009f6d0080 admin admin] PATH_INFO: `/v3/projects/fbbeb01c3bb04005bbb69df662918a19` {{(pid=86943) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:09:46.716131 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b65c88-0397-4749-877a-61009f6d0080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbbeb01c3bb04005bbb69df662918a19)` {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:09:46.718100 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b65c88-0397-4749-877a-61009f6d0080 admin admin] RBAC: Authorization granted {{(pid=86943) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:09:46.828850 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-60b65c88-0397-4749-877a-61009f6d0080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbbeb01c3bb04005bbb69df662918a19', 'request_id': 'req-60b65c88-0397-4749-877a-61009f6d0080'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:09:46.903078 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-60b65c88-0397-4749-877a-61009f6d0080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbbeb01c3bb04005bbb69df662918a19', 'request_id': 'req-60b65c88-0397-4749-877a-61009f6d0080'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:09:46.910031 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-60b65c88-0397-4749-877a-61009f6d0080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbbeb01c3bb04005bbb69df662918a19', 'request_id': 'req-60b65c88-0397-4749-877a-61009f6d0080'} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:09:46.920604 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-60b65c88-0397-4749-877a-61009f6d0080 admin admin] The token cache is being invalidate because project fbbeb01c3bb04005bbb69df662918a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86943) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:09:46.926184 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-60b65c88-0397-4749-877a-61009f6d0080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:09:46.926184 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG keystone.notifications [None req-60b65c88-0397-4749-877a-61009f6d0080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86943) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:09:46.926184 dv-cinder-813229-10-smb devstack@keystone.service[86943]: [pid: 86943|app: 0|req: 1471/2911] 10.222.0.93 () {58 vars in 1232 bytes} [Thu Jun 16 19:09:46 2022] DELETE /identity/v3/projects/fbbeb01c3bb04005bbb69df662918a19 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:09:56.374529 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:09:56.917566 dv-cinder-813229-10-smb devstack@keystone.service[86943]: DEBUG dbcounter [-] [86943] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86943) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:06.283539 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4577a-0e7d-480a-9c8e-41b5199726b6 admin admin] Authenticating user token {{(pid=86942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:10:06.284983 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-cdf4577a-0e7d-480a-9c8e-41b5199726b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:10:06.377023 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4577a-0e7d-480a-9c8e-41b5199726b6 admin admin] Validating token access rules against request {{(pid=86942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:10:06.437488 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f39dc-0428-4989-8eeb-409e7445f8ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3abe1d47a1164776bf3a82fe4b129d9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6d43f779d67418baf199556b8e497c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:10:06.438169 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f39dc-0428-4989-8eeb-409e7445f8ed service placement] REQUEST_METHOD: `GET` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:10:06.438496 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f39dc-0428-4989-8eeb-409e7445f8ed service placement] SCRIPT_NAME: `/identity` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:10:06.438781 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f39dc-0428-4989-8eeb-409e7445f8ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:10:06.440646 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.fernet_utils [None req-066f39dc-0428-4989-8eeb-409e7445f8ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:10:06.452736 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f39dc-0428-4989-8eeb-409e7445f8ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:10:06.454396 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f39dc-0428-4989-8eeb-409e7445f8ed service placement] RBAC: Authorization granted {{(pid=86942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:10:06.464943 dv-cinder-813229-10-smb devstack@keystone.service[86942]: [pid: 86942|app: 0|req: 1441/2912] 10.222.0.93 () {60 vars in 1365 bytes} [Thu Jun 16 19:10:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:10:16.460326 dv-cinder-813229-10-smb devstack@keystone.service[86942]: DEBUG dbcounter [-] [86942] Writing DB stats keystone:SELECT=67 {{(pid=86942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}